OpenBMB Releases MiniCPM-V 4.7: Multimodal Model Efficiently Runs on Mobile Devices

Summary:OpenBMB has released MiniCPM-V 4.7, a 35B-parameter multimodal model with A3B MoE architecture, capable of running efficiently on mobile devices with ~3GB memory. The key innovation lies in LES (Lookahead Expert Scheduling) technology, which optimizes inference by predicting and preloading expert modules to reduce bottlenecks. Additionally, a lightweight 1B-parameter version is available for more constrained devices. The introduction of Self-Replay Fine-Tuning (SRFT) allows developers to customi

---

Technical Mechanism Analysis

The core innovation of MiniCPM-V 4.7 lies in its multimodal architecture and efficient inference optimization techniques:

• A3B MoE Architecture: This architecture uses a sparse activation mechanism, activating only a subset of expert modules to reduce computational and memory overhead.
• LES (Lookahead Expert Scheduling): This technology predicts the expert modules needed in future inference steps and preloads them to reduce latency bottlenecks during inference.
• Self-Replay Fine-Tuning (SRFT): SRFT allows developers to fine-tune the model for specific tasks while maintaining its general capabilities. This mechanism ensures that the model does not forget its original knowledge by replaying historical data during fine-tuning.

Engineering Trade-offs and Performance

• Memory and Computational Efficiency: MiniCPM-V 4.7 runs efficiently on mobile devices with ~3GB memory, demonstrating its effectiveness in resource-constrained environments. Compared to traditional large models, its memory footprint is significantly reduced.
• Inference Speed: The LES technology effectively reduces inference latency, enabling the model to respond in real-time on mobile devices.
• Model Customization: The SRFT technology provides developers with the flexibility to customize the model for specific applications without compromising its general capabilities.

Developer Implementation and Deployment Recommendations

• Hardware Requirements: Although MiniCPM-V 4.7 performs well on mobile devices, developers should ensure that the hardware has sufficient computational power and memory resources.
• Model Optimization: It is recommended that developers use the SRFT technology to fine-tune the model according to specific application scenarios to achieve optimal performance.
• Multi-version Support: OpenBMB also offers a lightweight 1B-parameter version for a wider range of applications and devices.

Future Outlook

The release of MiniCPM-V 4.7 marks a significant step towards localized, multimodal, and efficient AI assistants. As technology continues to advance, we can expect to see more such multimodal models running efficiently on various devices, providing users with smarter and more convenient services.

---

Source: Reddit r/LocalLLaMA (2026-10-14)

— END —

Tags: #OpenBMB Follow #Multimodal Model Follow #MoE Architecture Follow #Mobile AI Follow #LES Technology Follow