Mistral Small 4 Drops: 119B Parameter Open-Source MoE Model Under Apache 2.0
Mistral AI has released Mistral Small 4, a hybrid multimodal mixture-of-experts (MoE) model with 119 billion total parameters and just 6 billion active parameters per token. Released under the Apache…
