ZICQ
中 Log in / Sign up
ZICQ Info Open Source AI #ArXiv #Code Retrieval #Semantic Search #Open Source Tools #MediaWiki

ArXiv Introduces MediaWiki Code2Code Search: Semantic-Driven Open-Source Code Retrieval System

Avatar of Mr.Xu

By Mr.Xu Community Post

Published: · 4 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:The ArXiv team introduces MediaWiki Code2Code Search, a neural retrieval system for semantic code-to-code discovery. By indexing 1.29 million structural entities (functions, types, and templates) across over 2,500 MediaWiki repositories, the system enables retrieval based on computational intent rather than surface tokens. Its split-build architecture decouples GPU-intensive offline indexing from a CPU-only serving layer, significantly reducing resource consumption and meeting the constraints of


Key Breakthroughs

The ArXiv team has developed MediaWiki Code2Code Search, a neural retrieval system designed to address the lexical gap in code search. Key features include:

  • Semantic Retrieval: The system employs a computational intent-based retrieval mechanism to bridge the semantic gap between user queries and code implementation details.
  • Large-Scale Indexing: It indexes 1.29 million structural entities (functions, types, and templates) across over 2,500 MediaWiki repositories.
  • Efficient Architecture: The split-build architecture decouples GPU-intensive offline indexing from a CPU-only serving layer, significantly reducing resource consumption.
  • Resource Optimization: The FAISS IVF-PQ index occupies only 168.6 MB, a 96.6% reduction compared to the flat float32 baseline.
  • Superior Performance: Benchmarks demonstrate superior performance, particularly in handling name-obfuscated tasks, with a P@10 of 0.87 compared to 0.64 for the BM25 baseline.

Technical Highlights

  1. Split-Build Architecture: Decoupling offline indexing from online serving optimizes resource utilization efficiency.
  2. FAISS IVF-PQ Index: The efficient indexing structure achieves significant storage compression.
  3. Cross-Platform Compatibility: The system meets the 6 GiB RAM constraint of Wikimedia Toolforge while maintaining low query latency (1.85 seconds).
  4. Open Source & API: Released under the Apache 2.0 license, the system provides an open RESTful API for easy integration and use by developers.

Industry Impact

The introduction of MediaWiki Code2Code Search brings a new tool to the open-source software ecosystem, particularly excelling in handling large codebases and complex queries. Its semantic retrieval capabilities not only enhance developer efficiency but also open new possibilities for applications such as automated code review, code recommendation, and cross-project code reuse.

Developer Recommendations

  • Integrate into Toolchains: Developers are encouraged to integrate MediaWiki Code2Code Search into their existing development toolchains to improve code retrieval efficiency.
  • Explore Semantic Retrieval: Developers should explore the advantages of semantic retrieval, especially in tasks involving cross-project code reuse and code recommendation.
  • Engage with Open Source Community: Participation in open source community discussions and development is recommended to collectively advance the technology of semantic code retrieval.

Source: ArXiv cs.AI (2026-07-29)

— END —

Tags: #ArXiv #Code Retrieval #Semantic Search #Open Source Tools #MediaWiki

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…