arXiv Proposes Reflective Prompt Evolution (GEPA): Enhancing Transfer Learning in Multi-Agent Research
Summary:arXiv introduces Reflective Prompt Evolution (GEPA), a novel method for optimizing system prompts in multi-agent deep research agents. Evaluated under a topic-disjoint split, GEPA significantly improves held-out citation reward from 0.702 to 0.781, demonstrating a 0.079 increase. The study reveals that the transfer gains are not due to memorization but rather the decomposed per-dimension feedback mechanism. The success of a handwritten version further validates the method's effectiveness. GEPA p
1. Introduction
Reflective Prompt Evolution (GEPA) is a method for optimizing system prompts in multi-agent deep research agents, addressing the limitations of traditional reinforcement learning in factual tasks. GEPA enhances model performance on unseen topics while avoiding memorization issues.
2. Methodology and Mechanism
The core mechanisms of GEPA include:
- Topic-Disjoint Split: Ensuring no overlap between training, validation, and test sets to guarantee reliable evaluation.
- Decomposed Per-Dimension Feedback: Breaking down feedback into multiple dimensions rather than a single scalar reward to capture finer-grained information.
- Ablation Analysis: Conducting controlled ablation experiments to verify the contribution of memorized content to the reward, showing that memorized content has no significant impact.
3. Experiments and Results
In experiments with multi-agent deep research agents, GEPA improved held-out citation reward from 0.702 to 0.781, demonstrating a 0.079 increase, with the gain replicated across three random seeds. Ablation experiments confirmed that memorized content did not contribute to the reward, validating the authenticity of the transfer gains.
4. Engineering Trade-offs and Challenges
- Strengths: GEPA provides a more granular optimization direction through decomposed per-dimension feedback, avoiding the limitations of a single scalar reward.
- Challenges: In complex tasks, the selection and weighting of feedback dimensions require further research. Additionally, the complexity of ablation analysis may increase computational costs.
5. Developer Recommendations
- Prompt Optimization Evaluation: It is recommended to conduct prompt optimization evaluation based on multi-topic splits and ablation analysis to ensure the reliability of transfer gains.
- Model Deployment: During deployment, attention should be paid to the implementation of the decomposed per-dimension feedback mechanism to fully leverage the advantages of GEPA.
6. Conclusion
GEPA offers a new approach to prompt optimization, emphasizing the importance of multi-topic splits and decomposed per-dimension feedback. Its application in multi-agent deep research agents demonstrates its great potential in enhancing transfer learning capabilities.
— END —Source: ArXiv NLP/LLM (cs.CL) (2026-10-12)
Tags: #Reflective Prompt Evolution #Multi-Agent Research #Transfer Learning #arXiv #Deep Learning
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments