Deepity Open-Sourced: C++ Library for Predictive Coding Networks Challenges Backpropagation
By Mr.Xu Community Post
Published: · 5 views
Summary:ra4ster has open-sourced Deepity, a C++ machine learning library designed to test alternative credit assignment algorithms like Predictive Coding Networks (PCNs). By implementing recent research on accelerated PCNs and utilizing algorithmic caching, Deepity achieves a test accuracy of 97.73% on MNIST in 59.5 seconds, approaching the performance of traditional backpropagation (98.27% in ~70s). The project aims to scale up with CUDA support and explore its capabilities in continual learning scenar
Key Breakthroughs
Deepity, developed by ra4ster, is an open-sourced C++ machine learning library designed to test alternative credit assignment algorithms, particularly Predictive Coding Networks (PCNs). The library's main technical highlights include:
- Predictive Coding Networks (PCNs) Implementation: PCNs are valued for their biological plausibility and continual learning capabilities, but traditional implementations are slow. Deepity leverages recent research on accelerated PCNs (e.g., Direct Kolen-Pollack Feedback Alignment) to significantly enhance training speed.
- Algorithmic Caching Mechanism: By bypassing redundant forward projections during the inference settling phase, Deepity optimizes performance, enabling it to approach the training speed of backpropagation on a CPU.
- Performance Comparison: On the MNIST dataset, Deepity achieves a test accuracy of 97.73% in 59.5 seconds, compared to PyTorch backpropagation's 98.27% in ~70 seconds.
Future Plans
The developers plan to port the kernels to CUDA to scale up the architecture and explore its capabilities in continual learning scenarios where standard backpropagation struggles. Continual learning is a critical area in AI, and Deepity could offer a novel solution to the limitations of traditional backpropagation.
Industry Impact and Developer Recommendations
- Impact on AI Research: Deepity provides a new technical path for AI research, especially in the areas of biological plausibility and continual learning.
- Recommendations for Developers: For those interested in local learning, alternative credit assignment, or high-performance computing (HPC) for machine learning, Deepity is a project worth following. Developers can contribute to the project on GitHub or visit the project website for more information.
Technical Details
- GitHub Link: https://github.com/ra4ster/deepity
- Project Website: https://ra4ster.github.io/Deepity
Conclusion
The open-sourcing of Deepity marks a significant advancement in the field of alternative credit assignment algorithms. While its performance is currently on par with backpropagation, its potential in continual learning and biological plausibility makes it a project to watch.
— END —Source: Reddit r/MachineLearning (2026-09-02)
Tags: #Deepity #Predictive Coding Networks #Open-Source Library #CPU Optimization #Continual Learning
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments