← Back to Model Beat
Models·3d ago·all news from October 15, 2026

transformers v5.20.0 — Release v5.20.0

# Release v5.20.0 ## New Model additions ### Muse Spark Open Muse Spark Open is a multimodal mixture-of-experts model from Meta that takes text, images, audio, and video as input and generates text. It has 816B total parameters (42B active per token) and a context window of up to 1,048,576 tokens shared across modalities. It is trained for agentic coding tasks such as multi-file editing, debugging, and tool use. Checkpoints are available in BF16 and NVFP4 formats. **Links:** [Documentation](https://huggingface.co/docs/transformers/main/en/model_doc/muse_spark) | [Blog Post](http://hf.co/blog/meta-muse-spark-open) * Add Muse Spark Open (#49644) by @guarin in [#49644](https://github.com/huggingface/transformers/pull/49644) ### Ling 3.0 Ling 3.0 Flash is a hybrid Mixture-of-Experts language model from InclusionAI. Its decoder groups five Kimi Delta Attention (KDA) layers with one Multi-head Latent Attention (MLA) layer. The MLA blocks use interleaved rotary embeddings and a head-wise output gate, and the feed-forward blocks combine routed and shared experts. It is natively supported in Transformers as…

Covered by 1 source

Related stories

ModelsGemini 4 Argon: Built to solve your hardest problemsOct 13 · 11 sourcesModelsDeepseek V4.1 Flash 1017 beats larger rivals in agentic tasks while once again massively cutting per-task costsOct 16 · 14 sourcesModelsMeta Releases Open AI Model While Keeping Its Best Tech ClosedOct 15 · 9 sourcesModelsAlibaba Unveils $450 AI Glasses in Expanding Push Into GadgetsOct 13 · 21 sources