Pith. sign in

REVIEW 16 cited by

Tackling the Generative Learning Trilemma with Denoising Diffusion GANs

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2112.07804 v2 pith:NOITT5AN submitted 2021-12-15 cs.LG stat.ML

Zhisheng Xiao , Karsten Kreis , Arash Vahdat This is my paper · ORCID
classification cs.LGstat.ML
keywords denoisingdiffusionmodelsgansgenerativemodelsamplesampling
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

A wide variety of deep generative models has been developed in the past decade. Yet, these models often struggle with simultaneously addressing three key requirements including: high sample quality, mode coverage, and fast sampling. We call the challenge imposed by these requirements the generative learning trilemma, as the existing models often trade some of them for others. Particularly, denoising diffusion models have shown impressive sample quality and diversity, but their expensive sampling does not yet allow them to be applied in many real-world applications. In this paper, we argue that slow sampling in these models is fundamentally attributed to the Gaussian assumption in the denoising step which is justified only for small step sizes. To enable denoising with large steps, and hence, to reduce the total number of denoising steps, we propose to model the denoising distribution using a complex multimodal distribution. We introduce denoising diffusion generative adversarial networks (denoising diffusion GANs) that model each denoising step using a multimodal conditional GAN. Through extensive evaluations, we show that denoising diffusion GANs obtain sample quality and diversity competitive with original diffusion models while being 2000$\times$ faster on the CIFAR-10 dataset. Compared to traditional GANs, our model exhibits better mode coverage and sample diversity. To the best of our knowledge, denoising diffusion GAN is the first model that reduces sampling cost in diffusion models to an extent that allows them to be applied to real-world applications inexpensively. Project page and code can be found at https://nvlabs.github.io/denoising-diffusion-gan

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 16 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ROMS-IMLE: A Minimalist Approach to Competitive Single-Step Generative Modelling

    cs.LG 2026-07 conditional novelty 6.0 of 10

    A single-step IMLE generator with per-stage supervision and a robust loss reports FID 2.56 on ImageNet-256 by filtering ~5% of samples at test time.

  2. MiAD: Mirage Atom Diffusion for De Novo Crystal Generation

    cs.LG 2025-11 conditional novelty 6.0 of 10

    Mirage infusion lets crystal diffusion models vary atom counts during generation and raises the S.U.N. rate on MP-20 to 8.2%.

  3. Friend or Foe

    q-bio.QM 2025-08 conditional novelty 6.0 of 10

    Friend or Foe is a 64-dataset compendium of 26M+ simulated bacterial interaction environments, with benchmarks showing deep tabular models classify interaction type with mean MCC of about 0.64.

  4. Quantum latent distributions in deep generative models

    cs.LG 2025-08 conditional novelty 6.0 of 10

    Quantum latent distributions from boson samplers are shown in theory to expand the output distribution class of invertible Lipschitz generators, and in GAN benchmarks on QM9 to beat Gaussian, Bernoulli, and distinguis...

  5. Dual-Expert Consistency Model for Efficient and High-Quality Video Generation

    cs.CV 2025-06 conditional novelty 6.0 of 10

    By training a semantic expert and a LoRA-based detail expert, DCM reaches nearly teacher-level VBench scores with 4-step video sampling on HunyuanVideo and CogVideoX.

  6. Layer-Parallel Inference Reduces Encrypted Nonlinear Depth in Transformers

    cs.LG 2026-07 conditional novelty 5.5 of 10

    SNLP reduces symbolic FHE bootstraps from 53 to 20 on a 0.5B model with +1.2% PPL degradation and lower polynomial-error amplification than sequential inference.

  7. Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation

    cs.LG 2026-07 conditional novelty 5.0 of 10

    Training on the best of K generated candidates improves image, video, and language generative models, with the reported gains growing with scale and enabling single-pass end-to-end generation.

  8. FAIL: Flow Matching Adversarial Imitation Learning for Image Generation

    cs.CV 2026-02 conditional novelty 5.0 of 10

    Post-training of flow matching can be framed as adversarial imitation learning, and the proposed FAIL methods improve FLUX's generation quality using 13K expert images without preference pairs.

  9. Inference Time Debiasing Concepts in Diffusion Models

    cs.GR 2025-08 reject novelty 5.0 of 10

    DeCoDi subtracts a biased-concept guidance term during diffusion inference to shift generated images away from targeted stereotypes, with evaluation on gender, ethnicity, and age.

  10. Turbulent Injection assisted by Diffusion Models for Scale Resolving Simulations

    physics.flu-dyn 2025-08 conditional novelty 5.0 of 10

    A Reynolds-conditioned diffusion model can generate DHIT turbulence boxes for LES/DNS inflow that match energy spectra and development length, though integral length scale and anisotropy are imperfect.

  11. fastWDM3D: Fast and Accurate 3D Healthy Tissue Inpainting

    eess.IV 2025-07 conditional novelty 5.0 of 10

    fastWDM3D, a wavelet diffusion model with a variance-preserving noise schedule and reconstruction losses, achieves high-quality 3D brain inpainting in two steps and about 1.81 seconds per image.

  12. A Robust Local Fr\'echet Regression Using Unbalanced Neural Optimal Transport with Applications to Dynamic Single-cell Genomics Data

    stat.AP 2025-06 reject novelty 5.0 of 10

    A neural-network local Fréchet regression using unbalanced optimal transport is introduced to interpolate single-cell distributions over time, with applications to three differentiation datasets.

  13. Efficient Difficulty-Aware Dynamic Routing for Diffusion-Based Real-World Image Super-Resolution

    cs.CV 2026-07 reject novelty 4.0 of 10

    DDR-SR routes each real-world low-resolution image to one of two diffusion experts based on a high-frequency-loss difficulty score, using a low-compression VAE for hard images and a high-compression VAE for easy image...

  14. WaFusion: A Wavelet-Enhanced Diffusion Framework for Face Morph Generation

    cs.GR 2025-07 conditional novelty 4.0 of 10

    A hybrid wavelet-diffusion framework that morphs only the low-frequency wavelet sub-band to create efficient, high-quality face morphs.

  15. Conditional diffusion model with spatial attention and latent embedding for medical image segmentation

    eess.IV 2025-02 conditional novelty 4.0 of 10

    A conditional diffusion model with a per-timestep discriminator, spatial attention, and latent embedding reports state-of-the-art accuracy on three medical segmentation datasets using only 2 to 4 diffusion steps.

  16. Reinforcement Learning: From Algorithms To Foundation Models

    cs.AI 2026-07 conditional novelty 3.0 of 10

    A dissertation uniting the author's published results: non-exploitable Nash-DQN policies and the FightLadder benchmark for games, plus diffusion/consistency-model world models for RL — a compilation rather than new results.

Pith tools