ArXiv Introduces GeoNeXt: Revolutionizing Geometry Estimation with Video Generative Models for Enhanced Data Efficiency

Summary:The ArXiv team introduces GeoNeXt, a novel approach that repurposes pretrained video generative models as a unified and data-efficient framework for geometry estimation. GeoNeXt formulates the geometry estimation task as a next-frames prediction problem, leveraging the structured knowledge and rich priors from video models for joint modeling of images and geometric targets. Extensive experiments demonstrate that GeoNeXt outperforms existing task-specific and unified generative methods in zero-sh

---

Background and Challenges

In the field of geometry estimation, traditional generative approaches rely on pretrained image diffusion models and treat the task as image-conditioned generation. These methods either train task-specific geometry models (e.g., for depth and surface normal estimation) independently, missing the opportunity to explore the intrinsic correlation between geometric targets, or jointly fine-tune modified image diffusion backbones (e.g., altered self-attention), which typically requires substantial labeled data.

GeoNeXt Approach

To overcome these limitations, the ArXiv team proposes GeoNeXt, a novel method that repurposes pretrained video generative models as a unified framework for geometry estimation. GeoNeXt formulates the geometry estimation task as a next-frames prediction problem, leveraging the structured knowledge and rich priors from video models for joint modeling of images and geometric targets. This approach enables more efficient and less data-dependent learning processes.

Key Technical Highlights

1. Innovative Application of Video Generative Models: GeoNeXt applies video generative models to geometry estimation tasks, achieving joint modeling of geometric targets through next-frames prediction.
2. Enhanced Data Efficiency: The method significantly reduces data requirements during training while maintaining high performance.
3. Zero-Shot Learning Capability: GeoNeXt demonstrates strong performance in zero-shot monocular depth and surface normal estimation tasks, showcasing its powerful generalization abilities.

Experimental Results

Experiments on multiple datasets show that GeoNeXt outperforms existing task-specific and unified generative methods in zero-shot monocular depth and surface normal estimation. For instance, GeoNeXt's performance is comparable to, and in some cases better than, discriminative state-of-the-art methods trained on over 100 times more data.

Industry Impact and Developer Recommendations

GeoNeXt introduces a new paradigm for geometry estimation, particularly in terms of data efficiency and cross-task modeling. Its success highlights the potential of video generative models in this field. Developers may consider applying similar methods to other tasks that require joint modeling to improve data efficiency and model performance. Additionally, GeoNeXt's zero-shot learning capability offers convenience for rapid deployment in practical application scenarios.

---

Source: Hugging Face Daily Papers (2026-08-28)

— END —

Tags: #GeoNeXt #Geometry Estimation #Video Generative Models #Data Efficiency #Zero-Shot Learning