ArXiv Open-Sources SMITH Framework: Revolutionizing Tool Creation and Use for LLM Agents
Summary:The ArXiv team introduces SMITH (Schema-grounded Multi-task Iterative Tool Honing), a novel reinforcement learning framework that jointly trains tool creation and use for large language model (LLM) agents. SMITH enhances the accuracy of tool generation and the effectiveness of tool use by employing a multi-task iterative training mechanism. Experiments demonstrate that a 4B Qwen3 model trained with SMITH outperforms an untrained 30B-A3B tool-writer and improves the performance of other models in
SMITH Framework: Revolutionizing Tool Creation and Use for LLM Agents
Key Breakthroughs
- Joint Training Mechanism: SMITH employs a reinforcement learning framework to integrate tool creation and use into a single policy, enabling multi-task iterative training.
- Multi-Axis Reward Mechanism: By capturing failure signals across schema, code, and outcome dimensions, SMITH independently optimizes each failure mode, enhancing overall performance.
- Cross-Task Applicability: In 13 procedural reasoning tasks, the 4B Qwen3 model trained with SMITH achieved a macro-average accuracy of 79.8% on unseen tasks, outperforming the untrained 30B-A3B tool-writer.
Technical Highlights
- Schema-grounded Training: The schema-grounded training mechanism ensures that the generated tool schemas can be effectively invoked by the agent, addressing the disconnection between tool generation and use in traditional methods.
- Independent Reward Signals: Three independent reward axes (schema, code, outcome) allow the model to more precisely optimize each failure mode, improving training efficiency and final performance.
- Cross-Task Transfer Capability: SMITH not only enhances tool creation and use but also improves the model's adaptability in cross-task scenarios. For example, tools generated by SMITH boosted the performance of LFM-2.5-350M and Qwen3-30B-A3B in the same reasoning tasks.
Industry Impact
- Enhancing Agent Tool Use Efficiency: The SMITH framework provides a new technical path for developing smarter and more efficient AI agents, particularly in scenarios requiring complex tool use, such as automated programming, scientific experiments, and data analysis.
- Advancing LLM Toolification: By optimizing the tool creation and use process, SMITH is expected to promote the adoption of large language models in more practical application scenarios, such as intelligent assistants, automated systems, and robotics.
Developer Recommendations
- Explore Reinforcement Learning Applications: Developers can explore applying reinforcement learning to more large language model training scenarios to enhance model performance in complex tasks.
- Investigate Cross-Task Transfer: SMITH demonstrates the potential of cross-task transfer; developers can try applying similar methods to other multi-task learning scenarios.
- Optimize Tool Invocation Mechanisms: The success of SMITH indicates that optimizing tool invocation mechanisms is crucial for enhancing agent performance; developers can further research how to improve tool invocation strategies.
— END —Source: ArXiv cs.AI (2026-08-25)
Tags: #ArXiv #SMITH #Reinforcement Learning #LLMs & Foundation Models #Tool Invocation
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments