ArXiv Introduces Code-as-World: Revolutionizing Executable World Representations for Physical Reasoning

Summary:ArXiv researchers introduce Code-as-World, a novel paradigm that represents physical worlds through executable code, offering a compact, quantitative, and controllable abstraction for physical reasoning. This approach leverages an abductive reasoning-inspired agentic discovery loop to construct executable world hypotheses from multimodal data such as natural language descriptions or real-world videos. Experiments demonstrate that Code-as-World-VL achieves state-of-the-art performance on the Quan

---

1. Technical Background and Challenges

The core challenge in physical understanding and reasoning is to form compact and generalizable representations of the world. While modern vision-language models can recognize and explain diverse physical events, they often lack explicit representations of underlying mechanisms such as object states, physical parameters, and dynamic evolution, which limits their reliability in complex physical reasoning tasks.

2. Overview of Code-as-World

Code-as-World introduces a new approach to representing the physical world through executable code, offering a novel abstraction for physical reasoning. The core of this method is an agentic discovery loop inspired by abductive reasoning, where an agent proposes, executes, renders, verifies, and iteratively refines executable world hypotheses.

3. Key Technical Highlights

• Executable Code Representation: By representing the physical world as executable code, it provides a highly controllable and quantifiable abstraction of physical mechanisms.
• Agentic Discovery Loop: The abductive reasoning-inspired agent loop constructs and optimizes executable world representations from multimodal data.
• Physical Supervision Training: Verified executable worlds provide scalable physical supervision for training vision-language models.

4. Experimental Results and Performance

Code-as-World-VL demonstrates superior performance on the QuantiPhy benchmark, surpassing existing leading proprietary models and showcasing its strong capabilities in quantitative physical reasoning tasks. The experimental results validate the method's effectiveness and robustness in handling complex physical scenarios.

5. Industry Impact and Future Directions

Code-as-World provides a new foundational approach to physical intelligence, with potential applications in robotics, autonomous driving, and virtual reality. Its executable code representation also opens new avenues for interdisciplinary research, such as in physics engine optimization and simulation environment construction.

6. Recommendations for Developers

• Explore Multimodal Data Fusion: Apply the Code-as-World approach to other multimodal data scenarios, such as audio-visual or tactile-visual data.
• Optimize the Agent Loop: Further research on optimizing the agentic discovery loop to improve the efficiency and accuracy of constructing executable world representations.
• Expand Application Scenarios: Explore the method's potential in areas like robot control, virtual reality, and augmented reality.

---

Source: Hugging Face Daily Papers (2026-08-27)

— END —

Tags: #ArXiv #Physical Reasoning #Multimodal Learning #Agentic Systems #Executable Code