Pith. sign in

REVIEW 11 cited by

GODIVA: Generating Open-DomaIn Videos from nAtural Descriptions

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.14806 v1 pith:OU26JZVX submitted 2021-04-30 cs.CV

Chenfei Wu , Lun Huang , Qianxi Zhang , Binyang Li , Lei Ji , Fan Yang , Guillermo Sapiro , Nan Duan This is my paper
classification cs.CV
keywords godivavideosgeneratinggenerationmodelopen-domainproposetext
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Generating videos from text is a challenging task due to its high computational requirements for training and infinite possible answers for evaluation. Existing works typically experiment on simple or small datasets, where the generalization ability is quite limited. In this work, we propose GODIVA, an open-domain text-to-video pretrained model that can generate videos from text in an auto-regressive manner using a three-dimensional sparse attention mechanism. We pretrain our model on Howto100M, a large-scale text-video dataset that contains more than 136 million text-video pairs. Experiments show that GODIVA not only can be fine-tuned on downstream video generation tasks, but also has a good zero-shot capability on unseen texts. We also propose a new metric called Relative Matching (RM) to automatically evaluate the video generation quality. Several challenges are listed and discussed as future work.

Discussion (0). Sign in to comment.

Forward citations

Cited by 11 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. RDPO: Real Data Preference Optimization for Physics Consistency Video Generation

    cs.CV 2025-06 conditional novelty 8.0 of 10

    RDPO builds preference pairs by reverse-sampling real video latents with a pre-trained generator, then fine-tunes with Flow-DPO, improving physics consistency metrics on two video models.

  2. Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generation

    cs.CV 2026-02 conditional novelty 7.0 of 10

    Causal Forcing uses an autoregressive teacher for ODE initialization in diffusion distillation to close the causal attention gap and deliver better real-time video generation than Self Forcing.

  3. SymphoMotion: Joint Control of Camera Motion and Object Dynamics for Coherent Video Generation

    cs.CV 2026-04 conditional novelty 6.0 of 10

    SymphoMotion jointly controls camera trajectories and depth-aware object dynamics inside one video diffusion model, supported by the new RealCOD-25K real-world paired-motion dataset.

  4. O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editing

    cs.CV 2025-09 conditional novelty 6.0 of 10

    A video editor trained on randomly distorted objects, then steered by adaptive noise at inference, is claimed to surpass dedicated and unified editors across eight tasks with far less training.

  5. Neural Scene Designer: Self-Styled Semantic Image Manipulation

    cs.CV 2025-09 conditional novelty 6.0 of 10

    NSD uses a contrastively learned style embedding from the input image itself, fed through a second cross-attention branch, to make diffusion-based inpainting results match the surrounding scene's style.

  6. Consistent and Controllable Image Animation with Motion Linear Diffusion Transformers

    cs.CV 2025-08 conditional novelty 6.0 of 10

    MiraMo turns a static image into a video using a linear-attention transformer that learns inter-frame motion residuals, with DCT-based noise refinement and a user-controllable dynamics knob.

  7. ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

    cs.CV 2026-07 conditional novelty 5.0 of 10

    ABot-World-0 claims real-time, long-horizon interactive world rollout on a single desktop GPU using raw keyboard actions, distillation, and low-bit inference, but the results cannot yet be independently checked becaus...

  8. From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence

    cs.RO 2026-07 conditional novelty 4.0 of 10

    Physical intelligence needs an embodied brain that reasons over interventions and emits capability requests, grounded by a physical harness and shared experience contracts rather than direct actuator policies.

  9. Stable Score Distillation

    cs.CV 2025-07 conditional novelty 4.0 of 10

    SSD is a diffusion score-distillation loss for text-guided 2D and 3D editing that combines a CFG cross-prompt term, a null-text cross-trajectory regularizer, and a prompt-enhancement term to stabilize edits.

  10. MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting

    cs.CV 2025-06 conditional novelty 4.0 of 10

    MTADiffusion improves text-guided object inpainting by training on a new 5M-image mask-text dataset with edge prediction and style-consistency losses.

  11. PAROAttention: Pattern-Aware ReOrdering for Efficient Sparse and Quantized Attention in Visual Generation Models

    cs.CV 2025-06 conditional novelty 4.0 of 10

    PAROAttention permutes tokens along frame, height, and width axes to make visual attention block-wise, enabling sparse and INT8/INT4 quantized attention with near-baseline generation quality.

Pith tools