arXiv Proposes Semantic Routing Calibration Framework to Mitigate LLM Over-Refusal
Summary:Large Language Models (LLMs) often suffer from over-refusal, where they incorrectly reject benign but safety-related instructions. A new arXiv paper analyzes the internal routing conflicts within Transformer attention and identifies a subset of 'Hypersensitive Safety Heads' that misfire on hard-safe prompts. The proposed Semantic Routing Calibration (SRC) framework dynamically suppresses these heads during inference and employs a dual-branch logits fusion mechanism as a safety regularizer. Exten
Background and Problem
Large Language Models (LLMs) often suffer from over-refusal during safety alignment, where they incorrectly reject benign but safety-related instructions. Prior research has primarily attributed this issue to static representation overlap, overlooking the impact of dynamic mechanisms.
Key Contributions
- Mechanistic Analysis: The study analyzes internal routing conflicts within Transformer attention and identifies a subset of 'Hypersensitive Safety Heads' that exhibit abnormal attention entanglement on hard-safe prompts.
- SRC Framework: To address this, the researchers propose the Semantic Routing Calibration (SRC) framework, a lightweight inference method that dynamically suppresses these hypersensitive heads during inference. SRC also employs a dual-branch logits fusion mechanism as a safety regularizer to ensure reliable reasoning in subsequent decoding.
- Experimental Validation: Extensive experiments demonstrate the effectiveness of SRC in mitigating over-refusal while preserving the model's intrinsic safety performance.
Technical Highlights
- Dynamic Suppression: SRC dynamically identifies and suppresses hypersensitive heads during inference, overcoming the limitations of static methods that cannot adapt to dynamic changes.
- Dual-Branch Logits Fusion: The dual-branch logits fusion mechanism ensures that SRC restores reliable reasoning while maintaining safety performance.
- Training-Free: SRC is a lightweight inference framework that does not require retraining, reducing application costs.
Industry Impact and Developer Recommendations
The SRC framework offers a new technical path for LLM safety alignment, particularly for applications requiring high safety and reliability, such as healthcare, finance, and autonomous driving. Developers can leverage SRC's approach to optimize existing models and improve their performance in handling safety-related instructions. Additionally, SRC's lightweight nature makes it easy to integrate into existing inference pipelines, providing practical benefits for real-world applications.
Future Directions
Future research could further explore SRC's applicability to different types of models and tasks and combine it with other techniques, such as reinforcement learning and alignment mechanisms, to achieve more comprehensive safety alignment solutions.
— END —Source: ArXiv NLP/LLM (cs.CL) (2026-09-23)
Tags: #LLMs & Foundation Models #Safety Alignment #Inference Optimization #Transformer #arXiv
Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.
Community Comments