ISTA-DASLab Releases DeepSeek-V4.1-Flash-1017 with GSQ-RCO Intelligent Quantization
By Mr.Xu Community Post
Published:
Summary:ISTA-DASLab has released the DeepSeek-V4.1-Flash-1017 model, introducing the GSQ-RCO intelligent quantization technique. This version features a sparse mixture-of-experts architecture with 763.2B parameters and a 1M-token context window, supporting FP8 dense weights and FP4 routed experts. GSQ-RCO optimizes quantization precision by jointly learning grid assignments and group scales, achieving performance close to vector quantization at low bit-widths while remaining deployable in standard GGUF
Technical Architecture and Core Mechanisms
DeepSeek-V4.1-Flash-1017 adopts a sparse mixture-of-experts (MoE) architecture with 384 routed experts per layer, activating 6 experts per token. The model boasts a total of 763.2B parameters and a 1M-token context window. It uses FP8 format for dense weights and FP4 for routed experts.
GSQ (Gumbel-Softmax Quantization) is a post-training scalar quantization method that jointly learns grid assignments and group scales, achieving performance close to vector quantization at low bit-widths while remaining deployable in standard GGUF formats. RCO (Riemannian Constrained Optimization) enforces exact quantization budgets by performing gradient descent on the task loss without per-constraint tuning. It assigns a quantization type to each backbone tensor and sets different quantization ladders for the dense path and routed experts.
Engineering Trade-offs and Benchmark Performance
The introduction of GSQ-RCO aims to optimize model inference efficiency, reducing computational resource requirements while maintaining performance. Here are the benchmark results for the main quantized versions:
- IQ1_M (1.75 bpw, 120.7 GB backbone): AIME25 100.00, GPQA-Diamond 88.38 (vs. baseline 90.91), LiveCodeBench v6 88.57 (vs. baseline 89.71). Average task score 92.32, retaining 98.7% of the performance.
- IQ2_XXS (2.00 bpw, 138.2 GB backbone): AIME25 100.00, GPQA-Diamond 90.91, LiveCodeBench v6 89.71, identical to the base model. Average task score 93.54, reaching 100% of the base model.
- IQ2_XS (2.25 bpw, 155.2 GB backbone): results to follow.
Developer Deployment and Implementation Recommendations
DeepSeek-V4.1-Flash-1017 currently only supports running within the Strata framework and is not compatible with llama.cpp. Strata provides a one-click installer and a local OpenAI-compatible endpoint, allowing deployment on a single NVIDIA GPU with 12 GB of VRAM for all build versions. Developers can access the quantized model files on the Hugging Face platform and refer to the relevant papers and code repositories to gain a deeper understanding of the GSQ and RCO implementations.
Conclusion
DeepSeek-V4.1-Flash-1017, combined with GSQ-RCO technology, significantly reduces resource requirements while maintaining high performance, providing new possibilities for AI model applications in resource-constrained environments. This release demonstrates ISTA-DASLab's innovation in the field of model quantization and lays the foundation for the widespread application of AI technology.
— END —Source: Reddit r/LocalLLaMA (2026-10-24)
Tags: #DeepSeek #Quantized Models #MoE Architecture #GSQ #RCO
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments