ArXiv Proposes ProRetrieval: A Program Synthesis-Based Hybrid Retrieval Orchestration Framework

Summary:The ArXiv team introduces ProRetrieval, a novel approach that recasts the language model as a retrieval orchestrator using program synthesis. By leveraging a hybrid domain-specific language (DSL) that interleaves SQL operators with vector-retrieval primitives, ProRetrieval enables complex Boolean logic composition over text and image data. Experimental results demonstrate that ProRetrieval outperforms existing models like GPT-5.5 and Claude Opus 4.7 on e-commerce and email datasets, offering a n

---

Background and Motivation

In real-world retrieval tasks, it is often necessary to combine structured constraints with semantic intents, processing text and image data through arbitrary Boolean logic. However, existing hybrid retrieval methods, such as reciprocal rank fusion or self-querying retrievers, only support fixed forms of composition, while reinforcement-learning-based retrievers train the language model as a query generator for a single backend, failing to incorporate it into the orchestration of heterogeneous retrieval paths.

ProRetrieval Approach

ProRetrieval addresses these limitations by recasting the language model as a retrieval orchestrator. It synthesizes an executable program using a hybrid domain-specific language (DSL) that interleaves SQL operators with vector-retrieval primitives over text and images. The SQL itself provides the logical algebra for fusing heterogeneous candidate sets.

Technical Highlights

1. Hybrid DSL Design: Combines SQL operators with vector-retrieval primitives to enable complex composition over text and image data.
2. Hierarchical Four-Term Reward Mechanism: Trains the Qwen3-4B model using a hierarchical reward mechanism and optimizes with GRPO and DAPO strategies.
3. New Benchmarking: Constructs new benchmarks from Amazon products and Enron emails to validate ProRetrieval's effectiveness.

Experimental Results

ProRetrieval achieves a Hit@1 of 0.81 on the e-commerce dataset, outperforming GPT-5.5's 0.69; on the email dataset, it reaches 0.91, surpassing GPT-5.5's 0.86. Additionally, ProRetrieval outperforms a comprehensive suite of retrieval, LLM-augmented, structured-query, and graph-based baselines.

Industry Impact and Developer Recommendations

ProRetrieval offers a new approach to multimodal retrieval tasks, particularly in handling complex queries and heterogeneous data. Developers can consider applying ProRetrieval in the following scenarios:

• E-commerce Platforms: Enhance product retrieval accuracy and user experience.
• Email Management: Enable smarter email classification and search.
• Multimodal Data Processing: Achieve more efficient cross-modal data retrieval in fields like healthcare and finance.

Future Directions

In the future, ProRetrieval is expected to find applications in more domains and further improve its performance. Researchers can explore combining ProRetrieval with other technologies, such as knowledge graphs and deep learning, to achieve even more powerful retrieval capabilities.

---

Source: ArXiv cs.IR (2026-08-27)

— END —

Tags: #ProRetrieval #Hybrid Retrieval #Program Synthesis #Multimodal AI #ArXiv