ArXiv Proposes Retrieval-Grounded Voting (RGV) to Revolutionize Voting Mechanisms for Multi-Turn Search Agents

Summary:The ArXiv team introduces Retrieval-Grounded Voting (RGV), a novel method to address the failure of confidence-based voting mechanisms in multi-turn search agents. Traditional confidence-based voting suffers from copy inflation when dealing with retrieved documents, leading to distorted weights. RGV overcomes this by scoring each rollout based on the lexical overlap between the final answer and the retrieved documents, bypassing the contaminated context. This approach consistently outperforms co

---

Background and Challenges

In multi-turn search agents, the agent needs to retrieve external documents and make decisions based on these documents. Traditional confidence-based voting methods aggregate parallel LLM outputs by weighting internal signals such as token log probabilities. However, this approach performs poorly in multi-turn settings because the log probabilities of tokens copied from the retrieved documents are systematically inflated, leading to distorted confidence scores and weakening the weighted vote.

RGV Method

To address this issue, the ArXiv team proposes Retrieval-Grounded Voting (RGV). The core idea of RGV is:

• Lexical Overlap Scoring: RGV scores each rollout based on the lexical overlap between the final answer and the retrieved documents, rather than relying on the log probabilities of tokens in the contaminated context.
• Avoiding Copy Inflation: By comparing the answer directly with the retrieved documents, RGV avoids the problem of copy inflation that affects confidence-based voting.
• No Additional LLM Calls: The computation process of RGV does not require additional LLM calls, further improving efficiency.

Experimental Results

Experiments on four search-agent benchmarks and five LLMs show that RGV significantly improves accuracy compared to confidence-based voting, with gains of up to +5.4%. The advantage of RGV is particularly pronounced in scenarios where the correct answer appears in only a minority of rollouts, with accuracy gains of up to +35%.

Industry Impact and Developer Recommendations

• Multi-Turn Search Agents: RGV provides a new approach to voting mechanisms for multi-turn search agents, effectively improving the decision-making accuracy of the agent.
• Developer Recommendations: For developers working on multi-turn search agents, it is recommended to adopt the RGV method to enhance the performance of the agent. Developers can further explore the combination of RGV with other technologies, such as combining reinforcement learning to dynamically adjust the weights of lexical overlaps.
• Future Directions: Future research can explore the performance of RGV on larger datasets and more complex tasks, as well as how to combine RGV with other multimodal data such as images and videos.

---

Source: ArXiv cs.AI (2026-08-25)

— END —

Tags: #ArXiv #Retrieval-Augmented #Multi-Turn Search #Voting Mechanism #RGV