ZICQ
中 Log in / Sign up
Newsroom Research & Papers #Video Diffusion #Autoregressive Generation #Attention Head Disentanglement #Long Video Generation

Disen-Forcing Decouples Attention Heads for Consistent, Dynamic Long-Video Generation

Avatar of Mr.Xu

By Mr.Xu Compiled & Reviewed by Editorial

Published:

中文阅读 (Chinese) English Version
Co-reading Select any sentence in the article to highlight, annotate, or copy a quote card. Join discussion ↓

Summary:Disen-Forcing introduces a distillation-time plug-in for autoregressive video diffusion models. Its central finding challenges the common analogy between frame sinks and attention sinks in large language models: long-range semantic anchoring is handled by a sparse subset of attention heads, while most heads primarily capture local temporal dynamics. By routing pinned initial-frame context selectively and adding motion-disentangling regularization, the method aims to prevent the over-conditionin


Disen-Forcing reframes long-horizon stability in autoregressive video diffusion models as a problem of attention-head specialization. Rather than exposing every attention head to a persistent set of initial frames, it routes that context selectively during distillation and reinforces the division between semantic anchoring and local motion modeling. ## Mechanism: Why Frame Sinks Suppress Motion An AR-VDM generates video sequentially according to `p(V₁:T) = ∏t p(vt | v **Source**: [Hugging Face Daily Papers](https://huggingface.co/papers/2611.02822) (2026-11-02) — END —

Tags: #Video Diffusion #Autoregressive Generation #Attention Head Disentanglement #Long Video Generation

Editorial & Fact-Checking Note: This article is compiled from primary research, official release documentation, and source papers by the ZICQ Newsroom pipeline with automated entity verification and human editorial review. If you notice any technical inaccuracy, please submit a correction via our corrections policy or email our editorial desk directly.

What's your take on this story?
🚀 Explore & Submit Works

Community Comments

Loading live comments and annotations…