AIkitoria Open-Sources PCI-E P2P for Consumer NVIDIA Cards: Significant Performance Boost for AI Workloads
Summary:AIkitoria has open-sourced PCI-E Peer-to-Peer (P2P) technology, enabling consumer-grade NVIDIA GPUs to achieve more efficient inter-GPU data transfers. By enabling ReBAR and installing specific patched drivers, users can achieve up to a 25% performance boost in multi-GPU systems. This breakthrough is particularly valuable for AI training and inference workloads that rely on local multi-GPU setups.
Technical Background and Breakthrough
AIkitoria has recently open-sourced a PCI-E Peer-to-Peer (P2P) technology for consumer-grade NVIDIA GPUs. This technology enables direct data transfers over the PCI-E bus, significantly improving the efficiency of data transmission between multiple GPUs in a system. Here are the key steps for implementation:
- Hardware Support: Ensure that the motherboard and CPU support Resizable BAR (ReBAR) and enable it in the BIOS.
- Driver Installation: Download and install the specially patched GPU kernel drivers from AIkitoria's GitHub repository (https://github.com/aikitoria/open-gpu-kernel-modules).
- Environment Variable Configuration: Add the following environment variables when launching VLLM (a popular AI inference framework):
NCCL_P2P_DISABLE=0VLLM_SKIP_P2P_CHECK=1NCCL_P2P_LEVEL=SYS
Test Results and Performance Boost
According to tests conducted by Reddit user BidonPomoev, enabling P2P technology resulted in an overall throughput increase of approximately 25% when using the Qwen 3.6-27B-FP8 model for inference. The specific data is as follows:
-
Without P2P Enabled:
pp2048test throughput: 1648.96 ± 8.49 tokens/spp2048 @ d32768end-to-end time: 20598.44 ± 65.95 ms
-
With P2P Enabled:
pp2048test throughput: 2305.20 ± 49.73 tokens/spp2048 @ d32768end-to-end time: 15224.08 ± 21.55 ms
Technical Value and Application Scenarios
The release of this technology is significant for AI developers, especially in the following scenarios:
- Multi-GPU Training and Inference: By improving the efficiency of data transmission between GPUs, training and inference times are reduced.
- Resource-Constrained Environments: For users using consumer-grade hardware for AI computing, this technology provides a more economical performance boost.
- AI Model Deployment: In edge computing and local deployments, P2P technology can significantly improve model response speed.
Developer Recommendations
- Hardware Check: Before attempting to enable P2P technology, ensure that the hardware supports ReBAR and check the BIOS settings.
- Driver Compatibility: Use the patched drivers provided by AIkitoria and carefully read the installation instructions to avoid compatibility issues.
- Performance Monitoring: After enabling P2P, continuously monitor system performance to ensure that no new bottlenecks are introduced.
Industry Impact
This open-source technology not only provides AI developers with new avenues for performance optimization but may also drive the adoption of consumer-grade hardware in the AI field. As AI model sizes continue to grow, the efficiency boost of multi-GPU systems will become crucial.
— END —Source: Reddit r/LocalLLaMA (2026-08-08)
Tags: #AIkitoria #PCI-E P2P #NVIDIA #Open-Source Drivers #Multi-GPU
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments