ZICQ
中 Log in / Sign up
Newsroom Open Source AI #AIkitoria #PCI-E P2P #NVIDIA #Open-Source Drivers #Multi-GPU

AIkitoria Open-Sources PCI-E P2P for Consumer NVIDIA Cards: Significant Performance Boost for AI Workloads

Avatar of Mr.Xu

By Mr.Xu Compiled & Reviewed by Editorial

Published: · 48 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:AIkitoria has open-sourced PCI-E Peer-to-Peer (P2P) technology, enabling consumer-grade NVIDIA GPUs to achieve more efficient inter-GPU data transfers. By enabling ReBAR and installing specific patched drivers, users can achieve up to a 25% performance boost in multi-GPU systems. This breakthrough is particularly valuable for AI training and inference workloads that rely on local multi-GPU setups.


Technical Background and Breakthrough

AIkitoria has recently open-sourced a PCI-E Peer-to-Peer (P2P) technology for consumer-grade NVIDIA GPUs. This technology enables direct data transfers over the PCI-E bus, significantly improving the efficiency of data transmission between multiple GPUs in a system. Here are the key steps for implementation:

  1. Hardware Support: Ensure that the motherboard and CPU support Resizable BAR (ReBAR) and enable it in the BIOS.
  2. Driver Installation: Download and install the specially patched GPU kernel drivers from AIkitoria's GitHub repository (https://github.com/aikitoria/open-gpu-kernel-modules).
  3. Environment Variable Configuration: Add the following environment variables when launching VLLM (a popular AI inference framework):
    • NCCL_P2P_DISABLE=0
    • VLLM_SKIP_P2P_CHECK=1
    • NCCL_P2P_LEVEL=SYS

Test Results and Performance Boost

According to tests conducted by Reddit user BidonPomoev, enabling P2P technology resulted in an overall throughput increase of approximately 25% when using the Qwen 3.6-27B-FP8 model for inference. The specific data is as follows:

  • Without P2P Enabled:

    • pp2048 test throughput: 1648.96 ± 8.49 tokens/s
    • pp2048 @ d32768 end-to-end time: 20598.44 ± 65.95 ms
  • With P2P Enabled:

    • pp2048 test throughput: 2305.20 ± 49.73 tokens/s
    • pp2048 @ d32768 end-to-end time: 15224.08 ± 21.55 ms

Technical Value and Application Scenarios

The release of this technology is significant for AI developers, especially in the following scenarios:

  • Multi-GPU Training and Inference: By improving the efficiency of data transmission between GPUs, training and inference times are reduced.
  • Resource-Constrained Environments: For users using consumer-grade hardware for AI computing, this technology provides a more economical performance boost.
  • AI Model Deployment: In edge computing and local deployments, P2P technology can significantly improve model response speed.

Developer Recommendations

  1. Hardware Check: Before attempting to enable P2P technology, ensure that the hardware supports ReBAR and check the BIOS settings.
  2. Driver Compatibility: Use the patched drivers provided by AIkitoria and carefully read the installation instructions to avoid compatibility issues.
  3. Performance Monitoring: After enabling P2P, continuously monitor system performance to ensure that no new bottlenecks are introduced.

Industry Impact

This open-source technology not only provides AI developers with new avenues for performance optimization but may also drive the adoption of consumer-grade hardware in the AI field. As AI model sizes continue to grow, the efficiency boost of multi-GPU systems will become crucial.


Source: Reddit r/LocalLLaMA (2026-08-08)

— END —

Tags: #AIkitoria #PCI-E P2P #NVIDIA #Open-Source Drivers #Multi-GPU

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…