arXiv Proposes Hybrid Architecture: Cloud Programs and Local Models Collaborate to Boost Agent Task Success Rates

Summary:A new study on arXiv proposes a hybrid architecture where cloud-written programs defer bounded questions about user data to small local models through function calls. This approach maintains data locality while significantly improving the success rate of agent tasks. In tests on AppWorld, the method showed up to a 14.9 percentage point increase in success rate across six backbone model and test partition combinations, narrowing the gap with cloud-hosted ReAct loops while ensuring user data priva

---

Background and Motivation

In recent years, the reliance of agents on large models for executing user-provided tasks has grown significantly. However, such models typically require access to cloud data, posing privacy risks. On the other hand, smaller models running on edge devices, while ensuring data locality, often yield inferior task performance.

Technical Mechanism

The study proposes a hybrid architecture to address these issues:

1. Cloud Program Writing: A cloud-based large model generates a program that includes bounded queries about user data.
2. Local Model Collaboration: The program delegates data queries to a small local model through function calls during execution.
3. Task Execution and Feedback: The local model processes the queries and returns the results to the cloud program to continue task execution.

This architecture leverages the powerful reasoning capabilities of large models and the data locality of small models. In tests on AppWorld, the method showed improvements in task success rates across six backbone model and test partition combinations, with the highest increase being 14.9 percentage points.

Engineering Trade-offs and Performance

• Advantages:

  • Data Privacy: User data remains on the local device, mitigating cloud data leakage risks.
  • Performance Boost: Task success rates significantly improve compared to methods using only local models.
  • Resource Efficiency: Smaller local models reduce the computational resource requirements of devices.

• Challenges:

  • Latency Issues: Function calls and data transmission may introduce additional latency, necessitating optimization of network communication efficiency.
  • Model Coordination: The collaboration mechanism between the cloud program and local models requires careful design to avoid task interruptions or errors.

Developer Implementation and Deployment Recommendations

1. Prioritize Data Privacy: When designing agent tasks, prioritize data privacy and choose appropriate local models for data processing.
2. Network Optimization: To address latency issues, optimize network communication protocols and consider using edge computing technologies to reduce data transmission distances.
3. Model Coordination Design: Developers should thoroughly understand the interaction mechanism between the cloud program and local models and conduct sufficient testing and optimization to ensure the coherence and reliability of task execution.

Conclusion

This research finds a new balance between data privacy and task performance for agents, demonstrating the significant potential of the hybrid architecture in boosting agent task success rates.

---

Source: ArXiv AI (cs.AI) (2026-10-15)

— END —

Tags: #arXiv Follow #Intelligent Agents Follow #Hybrid Architecture Follow #Data Privacy Follow #Edge Computing Follow