NVIDIA Releases Nemotron-3.5 Super-VL: 120B Parameter Vision-Language Model with NVFP4 and LiLiCorr Decoding

Summary:NVIDIA has officially released the Nemotron-3.5 Super-VL model family, featuring a 120 billion parameter scale. The release includes the base version, NVFP4-optimized version, BF16 precision version, and the novel LiLiCorr speculative decoding technique. The LiLiCorr decoding technology addresses latency issues in long-sequence generation, significantly enhancing inference efficiency. Nemotron-3.5 Super-VL supports multimodal inputs (text, images, videos) and is optimized for complex vision-lang

---

Technical Architecture and Core Mechanisms

Nemotron-3.5 Super-VL is built on the Transformer architecture with a parameter scale of 120 billion. Its key technical highlights include:

1. NVFP4-Optimized Version: Deeply optimized for NVIDIA GPU architectures, leveraging Tensor Cores to accelerate matrix operations and significantly boosting throughput during inference.

2. BF16 Precision Version: Utilizing BF16 (Brain Floating Point 16) numerical precision to maintain model performance while drastically reducing memory usage, providing a more efficient resource utilization scheme for large-scale deployments.

3. LiLiCorr Speculative Decoding: This is one of the core innovations of Nemotron-3.5 Super-VL. LiLiCorr employs a speculative decoding mechanism that dynamically adjusts the decoding path during long-sequence generation, reducing redundant computations and optimizing GPU parallel utilization, thereby significantly shortening inference time.

4. Multimodal Support: Nemotron-3.5 Super-VL supports multiple input modalities such as text, images, and videos, and possesses cross-modal reasoning capabilities, enabling efficient collaborative processing in complex vision-language tasks.

Engineering Trade-offs and Performance

• Balance of Performance and Efficiency: Despite its large parameter scale, Nemotron-3.5 Super-VL, through NVFP4 optimization and BF16 precision technology, maintains high performance while effectively controlling memory usage and computational costs.

• Inference Speed Improvement: The LiLiCorr speculative decoding technique enhances long-sequence generation speed by approximately 30%, particularly excelling in handling high-resolution images and long video sequences.

• Multimodal Task Performance: In multiple vision-language benchmarks, Nemotron-3.5 Super-VL has achieved leading results in image captioning, visual question answering, and video understanding tasks.

Developer Deployment and Implementation Recommendations

• Hardware Requirements: It is recommended to use NVIDIA's latest Ampere or Hopper architecture GPUs to fully leverage the advantages of NVFP4 optimization.

• Software Support: Nemotron-3.5 Super-VL is compatible with NVIDIA's TensorRT and Triton inference servers, allowing developers to easily integrate the model into existing AI applications.

• Optimization Recommendations: For resource-constrained application scenarios, consider using the BF16 precision version to reduce memory usage. Additionally, it is recommended to utilize the LiLiCorr speculative decoding technique to accelerate long-sequence generation tasks.

Future Outlook

The release of Nemotron-3.5 Super-VL marks another important milestone for NVIDIA in the field of multimodal AI. Its powerful performance and multimodal support capabilities provide new possibilities for developers to build complex AI applications. In the future, NVIDIA may further optimize the model's deployment capabilities on edge devices and explore its application potential in fields such as autonomous driving and intelligent robotics.

---

Source: Reddit r/LocalLLaMA (2026-10-15)

— END —

Tags: #NVIDIA Follow #Multimodal AI Follow #Vision-Language Model Follow #Nemotron Follow #AI Inference Follow