LiquidAI Releases LFM2.5-24B-A2B: A Reasoning Model Optimized for Efficient On-Device Inference
By Mr.Xu Community Post
Published:
Summary:LiquidAI has released the LFM2.5-24B-A2B model, a 24B-parameter reasoning model optimized for efficient on-device inference. Utilizing a Mixture of Experts (MoE) architecture, the model activates only 2B parameters per token, achieving significant improvements in inference speed and efficiency. It demonstrates competitive performance with Qwen3.6-35B-A3B on agentic and tool-use tasks in the LiveClaw benchmark, despite having fewer total and active parameters. Additionally, the model supports mul
Technical Mechanism Analysis
The LFM2.5-24B-A2B model employs a Mixture of Experts (MoE) architecture, where a dynamic routing mechanism activates only 2B parameters per token, significantly reducing computational overhead during inference. This design not only enhances inference speed but also substantially decreases memory usage, enabling efficient operation on resource-constrained devices.
Engineering Trade-offs and Performance
- Inference Efficiency: On an Apple M5 Max device, LFM2.5-24B-A2B achieves an inference speed of 184 tokens/s, while on a single NVIDIA B300 GPU, it reaches up to 21K output tokens/s, outperforming traditional MoE models.
- Parameter Efficiency: With a total of 24B parameters but only 2.45B active parameters, the model maintains high performance while reducing computational costs.
- Multilingual Support: The model supports 15 languages, including English, Chinese, and Arabic, demonstrating its capability in multilingual processing.
However, the MoE architecture introduces challenges such as routing complexity and expert selection latency. Although LFM2.5-24B-A2B mitigates some of these issues through optimized routing algorithms, in extreme cases, routing latency may still affect overall performance.
Developer Implementation and Deployment Recommendations
For developers, LFM2.5-24B-A2B is suitable for applications requiring high inference efficiency and low latency, such as intelligent agents and real-time dialogue systems. It is recommended to deploy the model with hardware accelerators (like GPUs or dedicated AI chips) to fully leverage its performance benefits. Additionally, considering its multilingual support, developers can utilize its capabilities to build cross-lingual applications, but should be aware of potential performance variations across different languages.
Conclusion
LFM2.5-24B-A2B showcases LiquidAI's technical prowess in inference optimization and model efficiency. By maintaining high performance while significantly reducing computational costs, it opens new possibilities for intelligent agent applications.
— END —Source: Reddit r/LocalLLaMA (2026-10-13)
Tags: #LiquidAI #Inference Optimization #MoE Architecture #On-Device Inference #Multilingual Model
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments