The reviewed record of science sign in
Pith

arxiv: 2303.00848 · v7 · pith:I62MOHNG · submitted 2023-03-01 · cs.LG · cs.AI· stat.ML

Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation

Diederik P. Kingma , Ruiqi Gao This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:I62MOHNGrecord.jsonopen to challenge →

classification cs.LG cs.AIstat.ML
keywords diffusionobjectiveselbostate-of-the-artaugmentationconditiondatadifferent
0
0 comments X
read the original abstract

To achieve the highest perceptual quality, state-of-the-art diffusion models are optimized with objectives that typically look very different from the maximum likelihood and the Evidence Lower Bound (ELBO) objectives. In this work, we reveal that diffusion model objectives are actually closely related to the ELBO. Specifically, we show that all commonly used diffusion model objectives equate to a weighted integral of ELBOs over different noise levels, where the weighting depends on the specific objective used. Under the condition of monotonic weighting, the connection is even closer: the diffusion objective then equals the ELBO, combined with simple data augmentation, namely Gaussian noise perturbation. We show that this condition holds for a number of state-of-the-art diffusion models. In experiments, we explore new monotonic weightings and demonstrate their effectiveness, achieving state-of-the-art FID scores on the high-resolution ImageNet benchmark.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

    cs.CV 2023-10 unverdicted novelty 7.0

    A new shared video-image tokenizer enables large language models to surpass diffusion models on standard visual generation benchmarks.

  2. Bridging Diffusion Pruning and Step Distillation with Teacher-Aligned Repair

    cs.CV 2026-07 conditional novelty 6.0

    A short teacher-alignment repair stage between structured pruning and one-step distillation yields a 20% pruned one-step generator that improves FID from 3.53 to 3.12 on ImageNet-512 while reducing NFE from 63 to 1.

  3. ELT: Elastic Looped Transformers for Visual Generation

    cs.CV 2026-04 unverdicted novelty 6.0

    Elastic Looped Transformers share weights across recurrent blocks and apply intra-loop self-distillation to deliver 4x parameter reduction while matching competitive FID and FVD scores on ImageNet and UCF-101.

  4. Consistency Regularised Gradient Flows for Inverse Problems

    stat.ML 2026-05 unverdicted novelty 5.0

    A consistency-regularized Euclidean-Wasserstein-2 gradient flow performs joint posterior sampling and prompt optimization in latent space for efficient low-NFE inverse problem solving with diffusion models.