OpenBMB Releases MiniCPM-V 4.7-35B-A3B: The First Open-Source MoE Vision-Language Model

Summary:OpenBMB has released MiniCPM-V 4.7-35B-A3B, the latest model in the MiniCPM-V series and the first open-source MoE (Mixture of Experts) vision-language model. This model enhances single-image, multi-image, and video understanding capabilities while optimizing visual encoding and on-device inference efficiency. Key features include: 1) The first open-source MoE model with lossless, smooth on-device inference; 2) A new Pareto frontier in performance and efficiency; 3) An efficient architecture bas

---

Technical Mechanism Analysis

MiniCPM-V 4.7-35B-A3B, the latest release from OpenBMB, is the first open-source MoE (Mixture of Experts) vision-language model. The core architecture leverages MoE technology, which dynamically selects expert subnetworks during inference, achieving higher computational efficiency and stronger model capacity compared to traditional models. The model incorporates the following key technologies:

1. Lookahead Expert Scheduling (LES): This technique optimizes the expert selection strategy during inference through lookahead scheduling, enabling lossless, smooth on-device inference.
2. Fine-Grained Layer Quantization: By finely quantizing different layers of the model, MiniCPM-V 4.7-35B-A3B significantly reduces computational and storage overhead while maintaining high performance.
3. DSpark Speculative Sampling Integration: This technology accelerates the inference process through speculative sampling, further enhancing the model's inference efficiency.
4. Mixed 4x/16x Visual Compression: The model supports a mixed visual compression strategy, allowing developers to balance visual detail and inference cost.

Engineering Trade-offs and Performance

While MiniCPM-V 4.7-35B-A3B makes significant optimizations, it also faces certain trade-offs:

• Performance vs. Efficiency: Although the model achieves a performance breakthrough, the complexity of the MoE architecture may lead to increased latency in high-load scenarios.
• On-Device Inference Challenges: While on-device inference is achieved without loss of performance, the model's memory footprint on resource-constrained devices remains a concern.
• Multi-Platform Support: The model supports multiple platforms and chips, but performance may vary across different platforms, requiring developers to perform targeted optimizations.

According to official benchmarks, MiniCPM-V 4.7-35B-A3B outperforms Qwen3.6 35B-A3B in Instruct mode, achieving a higher overall score in less inference time, demonstrating its advantages in performance and efficiency.

Developer Deployment Recommendations

For developers, MiniCPM-V 4.7-35B-A3B offers a rich set of tools and frameworks:

• Inference Frameworks: Supports mainstream inference frameworks such as SGLang, vLLM, llama.cpp, and Ollama.
• Quantization Schemes: Provides multiple quantization options including GGUF, BNB, AWQ, and GPTQ, with additional FP8 quantization support.
• Fine-Tuning Frameworks: Supports fine-tuning frameworks such as SWIFT and LLaMA-Factory, and introduces Self-Replay Fine-Tuning to help developers extend model capabilities at low cost while reducing forgetting of existing capabilities.

It is recommended that developers choose appropriate quantization schemes and inference frameworks based on specific application scenarios and make full use of the model's multi-platform support to achieve optimal performance and efficiency.

---

Source: Reddit r/LocalLLaMA (2026-10-12)

— END —

Tags: #OpenBMB Follow #MiniCPM-V Follow #MoE Architecture Follow #Vision-Language Model Follow #On-Device Inference Follow