Study Reveals Significant Impact of Evaluation Resolution on Brain-like Learning Rule Identification

Summary:A new study demonstrates that evaluation resolution significantly impacts the identification of brain-like learning rules. By comparing CNN models with biological visual cortex (V1) performance across different resolutions, the researchers found that the brain-like characteristics exhibited by untrained CNNs at low resolutions are primarily due to artifacts caused by mismatched evaluation resolutions. The study, which involved experiments with varying image sizes and learning rules, concluded th

---

Background and Motivation

In the comparison of models with biological visual cortex, a common assertion is that untrained Convolutional Neural Networks (CNNs) can match or even surpass backpropagation-trained CNNs in the early visual cortex (V1) in Recurrent Self-Attention (RSA). However, this study reveals that this phenomenon is primarily due to artifacts caused by mismatched evaluation resolutions.

Methodology and Experimental Design

The research team designed an experimental setup that included:

• A small CNN trained at 32px resolution (CIFAR-10 subset).
• Five learning rules: random initialization, backpropagation, feedback alignment, predictive coding, and STDP.
• Evaluation on THINGS-fMRI stimuli at six resolutions ranging from 32px to 224px.

During the experiment, weights and normalization parameters were held fixed to ensure the reliability of the results.

Key Findings

1. Non-monotonic Trend in Trained vs. Untrained BP V1 Gap: The study found that the gap between trained and untrained backpropagation (BP) V1 exhibited a non-monotonic trend across different image sizes. Specifically, the gap narrowed from -0.001±0.007 at 32 pixels to +0.044±0.006 at 224 pixels.

2. Elimination of Artifacts: By implementing bit-identical weight normalization, the researchers ruled out artifacts such as train/eval resolution matching, Gabor/pixel low-level structure, uncalibrated batch-norm in the untrained baseline, and convergence of pooled features towards global brightness.

3. Content vs. Pooling Control Experiment: The experiment demonstrated that the dependency is predominantly contingent on image content rather than the number of pooled positions.

4. Persistent Effect Across Resolutions: The backpropagation effect at LOC (Lateral Occipital Complex) was observed at every resolution tested, indicating that the learning process has a significant impact, albeit not in the traditional V1 comparison areas.

Conclusions and Implications

This study underscores the importance of evaluation resolution in the identification of brain-like learning rules and emphasizes the need for careful consideration of train and evaluation resolution matching. The findings have significant implications for the comparison of AI models with biological visual systems and provide new insights for future model design.

Recommendations for Developers

• Be Mindful of Evaluation Resolution: When comparing AI models with biological visual systems, pay close attention to the choice of evaluation resolution to avoid artifacts affecting the results.
• Cross-Resolution Validation: It is advisable to perform validation across multiple resolutions to ensure the reliability and generalizability of the results.
• Focus on Persistent Learning Effects: The impact of the learning process on model performance extends beyond traditional visual areas and may affect other regions as well.

---

Source: Reddit r/MachineLearning (2026-08-22)

— END —

Tags: #Evaluation Resolution #Brain-like Learning #CNN #V1 #RSA