arXiv Proposes Core-Tail World Model (CTWM): Optimizing Memory Efficiency for Long-Horizon Language Agents
Summary:arXiv introduces the Core-Tail World Model (CTWM), a novel approach to optimizing memory usage in long-horizon language agents. The study identifies that agent memory tends to concentrate on a small core while leaving rare states in a long tail, leading to accumulated prediction errors. CTWM addresses this by allocating prompt budgets with a single exponent while retaining a summarized tail. Experiments on Synthetic Graph World, ALFWorld, and LongMemEval demonstrate that CTWM preserves full stat
Background and Motivation
Long-horizon language agents increasingly rely on external memory as a frozen world model. However, current memory systems are typically evaluated solely by task success or token cost, neglecting the importance of memory usage patterns. Under finite context and repeated retrieval, agent memory tends to concentrate on a small core while leaving rare states in a long tail, leading to accumulated prediction errors.
Core-Tail World Model (CTWM) Approach
To address this, the researchers propose the Core-Tail World Model (CTWM), which optimizes memory usage through the following mechanisms:
- Rank-based Memory Controller: CTWM introduces a rank-based memory controller that allocates prompt budgets with a single exponent $\tau$ while retaining a summarized tail.
- Core-Tail Trace Analysis: Through a conservative tail audit, the study finds that memory concentration is reproducible but policy-dependent. Random-walk agents produce log-normal-compatible retrieval artifacts, while semantic LLM policies yield the strongest truncated-power-law-compatible core-tail traces.
Experimental Results
CTWM demonstrates strong performance in multiple benchmarks:
- Synthetic Graph World: CTWM preserves full state and transition coverage, reduces prompt tokens by 5.9%, and lowers bottom-half tail prediction error by 13.6%.
- ALFWorld and LongMemEval: On ALFWorld, CTWM achieves consistent token savings with the baseline; on LongMemEval, it reduces token usage by 24.48% while maintaining aggregate accuracy.
Industry Impact and Developer Recommendations
The introduction of CTWM provides new insights into memory management for long-horizon language agents, with significant implications:
- Enhanced Memory Efficiency: CTWM optimizes memory allocation strategies, reducing unnecessary token consumption and improving agent efficiency.
- Improved Prediction Accuracy: By retaining summarized tail information, CTWM effectively reduces tail prediction errors and enhances prediction accuracy.
- Developer Recommendations: Developers are advised to consider adopting memory management strategies similar to CTWM when designing long-horizon language agents to optimize overall performance.
Future Research Directions
Future research could further explore the application of CTWM in different types of agents and tasks, as well as how to combine it with other optimization techniques (such as pruning and quantization) for even more efficient memory management.
— END —Source: ArXiv AI (cs.AI) (2026-10-02)
Tags: #Long-Horizon Agents #Memory Management #LLMs & Foundation Models #arXiv #CTWM
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments