ZICQ
中 Log in / Sign up
ZICQ Info LLMs & Foundation Models #XingChen-AGI #Large Language Model #Ascend NPU #MindSpore #MoE Architecture

XingChen-AGI Releases Xing4.0-29B-A4B: A Next-Generation Large Language Model Optimized for Complex Engineering Tasks

Avatar of Mr.Xu

By Mr.Xu Community Post

Published: · 14 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:XingChen-AGI has released Xing4.0-29B-A4B, a next-generation large language model (LLM) developed on the Ascend NPU platform using the MindSpore framework. With 29 billion total parameters and 4 billion activated per token, it supports a context length of 256K, extendable to 512K. The model features an agent-oriented architecture (mHC+MLA+MTP) and is deeply optimized for complex engineering tasks. It also boasts a 96% improvement in training efficiency through multi-level co-optimization with As


Release of Xing4.0-29B-A4B: A Next-Generation Large Language Model

XingChen-AGI has unveiled its latest large language model, Xing4.0-29B-A4B, developed on the Ascend NPU platform using the MindSpore framework. Key features include:

  • Parameter Scale and Architecture: With 29 billion total parameters and 4 billion activated per token, it supports a context length of 256K, extendable to 512K. The model employs an mHC+MLA+MTP architecture, optimized for complex engineering tasks.

  • Ascend NPU Co-Optimization: As the first model of this scale trained entirely on the Ascend NPU platform, it leverages the MindSpore/MindFormers framework for co-optimization, achieving a 96% improvement in training efficiency.

  • Multi-Level Optimization Techniques: The model incorporates fine-grained MoE communication optimization, selective recomputation, and DVM automatic graph-operator fusion, significantly enhancing training throughput.

  • Open-Source Ecosystem Compatibility: It supports LLaMA-Factory and MindFormers for fine-tuning and is compatible with tools like SGLang, vLLM, and KTransformers. Additionally, it is tailored for agent frameworks such as OpenCode, Claude Code, OpenClaw, and Hermes, ensuring seamless integration into existing workflows.

  • Domain-Specific Adaptation: The model is designed for easy downstream task fine-tuning, enabling lightweight customization for vertical domains like intent classification, table understanding, contract auditing, and knowledge-based QA.

Technical Highlights

  1. Agent-Oriented Architecture: The mHC+MLA+MTP architecture allows for multi-step planning, tool calling, and complex reasoning chain execution, ensuring task coherence and execution stability.

  2. Ascend NPU Deep Optimization: The model is deeply optimized for Ascend 910C clusters, offering stable and efficient training for large-scale engineering tasks.

  3. Efficient Training and Inference: Multi-level optimization techniques not only boost training efficiency but also provide an efficient solution for inference in resource-constrained environments.

Industry Impact and Developer Recommendations

The release of Xing4.0-29B-A4B marks a significant advancement in AI models for complex engineering tasks. Its deep optimization for Ascend NPU and comprehensive support for the open-source ecosystem make it an ideal choice for AI developers and enterprises. For developers, consider the following:

  • Domain-Specific Customization: Leverage the model's domain-specific adaptation capabilities to rapidly develop AI solutions for specific industries.

  • Open-Source Tool Integration: Take advantage of its compatibility with various open-source tools to optimize existing workflows.

  • Performance Optimization: Focus on Ascend NPU co-optimization techniques to enhance AI model training and inference efficiency.

Conclusion

The release of Xing4.0-29B-A4B opens new possibilities for AI applications in complex engineering and vertical domains. Its efficient training and inference capabilities, along with comprehensive open-source support, make it a milestone in AI technology development.


Source: Reddit r/LocalLLaMA (2026-09-17)

— END —

Tags: #XingChen-AGI #Large Language Model #Ascend NPU #MindSpore #MoE Architecture

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…