Soofi Consortium Releases Soofi S 30B-A3B: An Open Hybrid Mamba-Transformer MoE Foundation Model For German And English

The Soofi Consortium has released Soofi S 30B-A3B, an open-source language model that combines Mamba and Transformer architectures using a Mixture of Experts approach. Designed for English and German, the model contains 31.6 billion parameters but activates only 3.2 billion during inference to improve computational efficiency.