ArXiv Proposes HSR Framework: Revolutionizing Data-Efficient Adaptation for Vision-Language-Action Models

Summary:The ArXiv team introduces the Hierarchical Skill Retrieval (HSR) framework to address the challenge of data-efficient adaptation for Vision-Language-Action (VLA) models when adapting to new tasks with limited task-specific demonstrations. HSR decomposes target tasks into candidate skill sequences and evaluates each plan based on semantic plausibility and skill reliability estimated from prior datasets. This hybrid retrieval approach, combining subtask-level language retrieval with behavior-featu

---

Background and Challenge

Vision-Language-Action (VLA) models excel in robot manipulation tasks, but their performance can degrade when adapting to new tasks with limited task-specific demonstrations. Existing retrieval methods often rely on visual similarity, state-action representations, or task-level language matching, but these approaches overlook the hierarchical structure of long-horizon manipulation tasks, making it difficult to effectively reuse existing skills.

Core Innovations of the HSR Framework

The ArXiv team addresses these challenges with the Hierarchical Skill Retrieval (HSR) framework through the following steps:

1. Task Decomposition and Skill Sequence Generation: HSR first decomposes the target task into candidate skill sequences, identifying reusable skill units within the task.
2. Semantic Plausibility and Skill Reliability Evaluation: HSR evaluates each plan based on semantic plausibility and skill reliability estimated from prior datasets, ensuring that the selected skill sequences are not only semantically relevant but also reliable in practice.
3. Hybrid Retrieval and Re-ranking: HSR combines subtask-level language retrieval with behavior-feature re-ranking to identify demonstrations that are both semantically relevant and compatible with the target task.
4. Two-Stage Pretraining and Finetuning: Through a two-stage pretraining and finetuning pipeline, HSR separates general skill acquisition from task-specific adaptation, further enhancing the efficiency of model adaptation.

Experimental Results

In the LIBERO benchmark and several real-world robot manipulation tasks, HSR improves the average success rate by 10.3% and 21.3% over the strongest baseline, respectively. These results demonstrate HSR's significant advantages in data-efficient adaptation, particularly in complex, long-horizon robot manipulation tasks.

Technical Highlights

• Hierarchical Skill Retrieval: By hierarchically decomposing tasks, HSR effectively identifies and reuses existing skills, avoiding the performance degradation caused by insufficient task matching in traditional methods.
• Combination of Semantic and Reliability: HSR not only focuses on semantic matching but also combines skill reliability evaluation to ensure that the selected skill sequences have higher success rates in practical applications.
• Hybrid Retrieval Strategy: Combining language retrieval and behavior-feature re-ranking, HSR achieves more accurate demonstration data retrieval.

Industry Impact and Developer Recommendations

The HSR framework provides a new technical path for data-efficient adaptation in robot manipulation tasks, particularly in resource-constrained or data-scarce scenarios. Developers can draw on the design principles of HSR to consider hierarchical skill decomposition and hybrid retrieval strategies when building VLA models, enhancing the model's adaptability in complex tasks. Additionally, the experimental results of HSR provide important benchmark data for future research.

---

Source: ArXiv cs.AI (2026-08-25)

— END —

Tags: #ArXiv #HSR #VLA Model #Data-Efficient Adaptation #Robot Manipulation