Hugging Face Releases RACE Framework: Enhancing Reliability of Long Action Sequences in Robotic Manipulation
By Mr.Xu
Published:
Summary:Hugging Face has introduced RACE (Reliable Action-Chunk Extension), a novel framework designed to address the unreliability of long action sequences in robotic manipulation. By predicting the timing of subskill transitions and conditioning action generation on these predictions, RACE reduces errors at subskill transitions, enabling robots to execute longer action sequences reliably and reduce idle time caused by stop-and-go execution. In simulation benchmarks, RACE outperforms fine-tuning at the
Background and Challenges
In robotic manipulation, Vision-Language-Action (VLA) models serve as unified policies. However, the high inference cost of VLA models forces robots to pause between policy calls, resulting in stop-and-go execution that interrupts smooth motion and prolongs task completion. While extending action sequences can reduce the number of policy calls, predicting further into the future makes long action sequence execution unreliable.
Innovation of the RACE Framework
To address these issues, Hugging Face's research team introduced the RACE (Reliable Action-Chunk Extension) framework. RACE enhances the reliability of long action sequences through the following methods:
- Predicting Subskill Transition Timing: RACE incorporates an auxiliary one-step denoising pass to predict the timing of subskill transitions.
- Conditioning Action Generation: Based on the predicted transition timing, RACE conditions action generation to reduce errors at subskill transitions.
Experimental Results
In multiple simulation benchmarks, RACE outperforms traditional fine-tuning methods at the same chunk length. When the action sequence length is doubled, RACE surpasses existing state-of-the-art and efficient VLA models in terms of success rate; even with a 4x increase in length, RACE remains competitive.
In real-robot experiments, RACE can use 4x longer action sequences, reducing idle time caused by stop-and-go execution by approximately 5x while achieving a higher success rate compared to fine-tuning with the same chunk length.
Technical Highlights
- Subskill Transition Prediction: By predicting transition timing, RACE effectively reduces errors in long action sequences.
- Conditioned Action Generation: Conditioning on transition timing improves the reliability of action execution.
- Long Action Sequence Support: RACE supports longer action sequences, reducing the frequency of stop-and-go execution in robot operations.
Industry Impact and Developer Recommendations
The release of the RACE framework brings a new technical path to the field of robotic manipulation, particularly in tasks requiring long action sequences, such as assembly line operations and navigation in complex environments. Developers can leverage the RACE framework to enhance the fluidity and efficiency of robot operations while reducing task completion time.
Conclusion
The RACE framework demonstrates the potential of handling long action sequences in robotic manipulation and provides a new direction for future research. By further optimizing transition timing prediction and action generation conditioning, RACE is expected to achieve higher reliability and efficiency in a wider range of robotic applications.
— END —Source: Hugging Face Daily Papers (2026-10-05)
Tags: #Hugging Face #Robotic Manipulation #VLA Models #RACE Framework #Long Action Sequences
Community Comments