ZICQ
中 Log in / Sign up
ZICQ Info Agentic #Routed #AI Agents #Open Source AI #Local-First #CPU Routing

Routed: Open-Source Local-First Hybrid Router for AI Agent Skills with Sub-20ms Latency

Avatar of Mr.Xu

By Mr.Xu Community Post

Published: · 9 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:iAmQubick has released Routed, an open-source hybrid router for AI agent skills that operates locally on the CPU, delivering sub-20ms response times without sending any prompt data over the network. Routed employs a hybrid scoring pipeline combining dense vector embeddings, lexical relevance, exact/alias matching, and metadata to route prompts to the appropriate skills. It supports over 100 languages and integrates seamlessly with popular AI environments such as Cursor, Claude Code, and LM Studi


Routed: Open-Source Local-First Hybrid Router for AI Agent Skills

Reddit user iAmQubick has released Routed, an open-source hybrid router for AI agent skills that operates entirely on the CPU, delivering sub-20ms response times without sending any prompt data over the network. This approach enhances both performance and user privacy by eliminating network latency and ensuring that sensitive data remains local.

Key Features

  1. Hybrid Scoring Pipeline:

    • Dense Vector Embeddings (60%): Utilizes quantized ONNX models (e.g., Arctic Embed S and MiniLM) for efficient local processing on the CPU.
    • Lexical BM25 (25%): Implements the Okapi BM25 algorithm to ensure strict keyword relevance.
    • Exact/Alias Matching (10%): Enables direct command and alias matching.
    • Metadata (5%): Incorporates heuristics based on recency and usage frequency.
  2. Multilingual Support:

    • The embedding pipeline natively understands inputs in over 100 languages, including German, Spanish, French, and Japanese, and automatically decomposes compound nouns without requiring language tags or manual translation.
  3. Environment Integration:

    • Routed auto-detects and injects adapters into popular AI development environments such as Cursor, Claude Code, LM Studio, Ollama, Antigravity IDE, Windsurf, OpenCode, Continue, and Codex.
  4. Model Context Protocol (MCP) Server:

    • Routed executes on the CPU and selects the exact skill needed, injecting only the necessary schema into the GPU's context window, thus avoiding the overhead of loading multiple tool schemas.

Performance and Advantages

The entire lookup process in Routed completes in under 20 milliseconds, making it highly responsive. This efficiency, combined with its privacy-preserving design, makes Routed an attractive solution for AI agent skill routing. Its multilingual operation and flexible integration capabilities further enhance its appeal to developers.

Use Cases

Routed is well-suited for AI agent applications that require efficient skill routing, such as automated customer service, code assistants, and smart home control systems. By dynamically triggering the best skills, Routed can handle complex compound intent tasks and improve the overall performance of AI agents.

Industry Impact and Developer Recommendations

The release of Routed provides AI agent developers with an efficient, privacy-friendly skill routing solution. Its open-source nature allows developers to customize and extend the tool according to their specific needs. The multilingual support and wide range of integrations make Routed a powerful tool in global application scenarios.

Developers are encouraged to follow Routed's updates and participate in community discussions to contribute to the tool's further development and optimization.

Conclusion

Routed introduces a new paradigm in AI agent skill routing with its local-first approach and hybrid scoring mechanism. It offers developers an efficient and secure solution with broad application prospects.


Source: Reddit r/MachineLearning (2026-09-06)

— END —

Tags: #Routed #AI Agents #Open Source AI #Local-First #CPU Routing

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…