ZICQ
中 Log in / Sign up
Newsroom LLMs & Foundation Models #OCR #Vision-Language Models #Reinforcement Learning #GAD-RL #arXiv

arXiv Introduces GAD-RL: Adaptive Teacher Supervision for Enhanced OCR Transcription Accuracy

Avatar of Mr.Xu

By Mr.Xu Compiled & Reviewed by Editorial

Published: · 9 views

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:arXiv introduces GAD-RL, a novel method to improve the transcription accuracy of vision-language models in OCR tasks. GAD-RL adaptively regulates teacher supervision by dynamically adjusting the distillation process based on the student's current task performance and local distributions. On the CHAOS-Bench benchmark, GAD-RL achieves a Micro Recall of 59.92% on Qwen3.5-2B, surpassing existing methods GRPO and GRPO+OPD by significant margins. Additionally, it scores 91.18 on OmniDocBench v1.6, dem


Background and Motivation

Vision-language models may rewrite anomalous text in images into linguistically plausible expressions, compromising OCR transcription faithfulness. While sequence-level task rewards and local teacher guidance are complementary, the effectiveness of a fixed teacher diminishes as the student model improves.

Method

To address this, researchers introduced GAD-RL (Gate and Attenuated Distillation with Reinforcement Learning). The method adaptively regulates teacher supervision through:

  • Dynamic Distillation Adjustment: Adjusts distillation intensity based on the student's current task performance and local distributions. For response groups containing an output with a task reward of at least 0.95, GAD-RL disables distillation and continuously attenuates distillation strength as the group-mean reward increases.
  • Forward KL Weighting: Weighs the forward KL by the student's probability of the teacher's Top-1 token, moderating local auxiliary updates when the student's support for that candidate is low.

Experimental Results

On the CHAOS-Bench benchmark, GAD-RL achieves a Micro Recall of 59.92% on Qwen3.5-2B, surpassing GRPO and GRPO+OPD (fixed-weight) by 8.45 and 4.43 percentage points, respectively. On OmniDocBench v1.6, GAD-RL scores 91.18, demonstrating its strong performance in handling complex OCR tasks.

Technical Highlights

  • Adaptive Regulation Mechanism: GAD-RL dynamically adjusts teacher supervision based on the student's performance, overcoming the limitations of fixed teacher guidance.
  • Distillation Intensity and KL Weighting: The dynamic adjustment of distillation intensity and forward KL weighting allows GAD-RL to maintain the student's performance while improving transcription accuracy.
  • Cross-Benchmark Excellence: GAD-RL's strong performance across multiple benchmarks validates its general applicability and effectiveness.

Industry Impact and Developer Recommendations

GAD-RL provides a new approach to enhancing OCR technology, particularly in handling complex texts and improving transcription accuracy. Developers can integrate GAD-RL into existing OCR systems to boost model performance. Additionally, the method can be extended to other domains requiring teacher guidance, such as machine translation and speech recognition.


Source: ArXiv AI (cs.AI) (2026-10-01)

— END —

Tags: #OCR #Vision-Language Models #Reinforcement Learning #GAD-RL #arXiv

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…