IFM Releases K2 Horizon: Fully Open-Sourced Model Fleet from 0.9B to 375B Parameters
By Mr.Xu Community Post
Published: · 4 views
Summary:The Institute of Foundation Models (IFM) has released K2 Horizon, a connected fleet of six fully open-sourced models with sizes ranging from 0.9 billion to 375 billion parameters. In addition to model weights, IFM has also open-sourced training data, code, intermediate checkpoints, detailed training logs, and evaluation results. This release provides AI researchers with valuable resources for pre-training, data mixing, on-device small models, sparse attention mechanisms, and deployment strategie
K2 Horizon: A Fully Open-Sourced Model Fleet
The Institute of Foundation Models (IFM) has announced the release of K2 Horizon, a fleet of six fully open-sourced models with sizes ranging from 0.9 billion to 375 billion parameters. In addition to model weights, IFM has also open-sourced the following key resources:
- Training Data and Recipes: Detailed training data and recipes are provided to help researchers and developers better understand the training process.
- Training Code: The complete training code is open-sourced, allowing users to customize the training process.
- Intermediate Checkpoints: Intermediate checkpoints are available for model debugging and optimization.
- Fine-Grained Training Logs and Evaluation Results: Detailed training logs and evaluation results provide important insights into model performance.
Technical Highlights
- Multi-Scale Model Support: K2 Horizon includes models of various sizes, from 0.9B to 375B parameters, catering to different application scenarios.
- Comprehensive Open-Sourcing: Beyond model weights, IFM has open-sourced training data, code, and logs, providing rich resources for the AI research community.
- Sparse Attention Mechanism: K2 Horizon employs MoVA and sparse attention mechanisms, enhancing the model's efficiency in handling long-sequence data.
- Deployment Flexibility: The models support multiple deployment methods, including on-device deployment, expanding application scenarios.
Industry Impact
The open-sourcing of K2 Horizon provides valuable resources for the AI research community, particularly in the fields of pre-training, data mixing, and model deployment. This model fleet offers new tools and ideas for AI researchers and developers, driving further advancements in AI technology.
Developer Recommendations
- Leverage Open-Source Resources: Developers are encouraged to thoroughly explore the open-sourced resources of K2 Horizon, including training data and logs, to optimize their own training processes.
- Focus on Sparse Attention Mechanism: For applications requiring the handling of long-sequence data, it is recommended to focus on the sparse attention mechanism of K2 Horizon to improve model efficiency.
- Explore Multi-Scale Model Applications: Choose the appropriate model size based on specific needs to achieve the best balance of performance and efficiency.
Conclusion
The release of K2 Horizon marks another significant contribution by IFM to the field of open-source AI models, providing the AI research community with rich resources and new research directions.
— END —Source: Reddit r/LocalLLaMA (2026-10-01)
Tags: #IFM #K2 Horizon #Open-Source Models #Model Fleet #MoVA
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments