REVIEW 9 cited by
CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Sampling
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
While conditional diffusion models are known to have good coverage of the data distribution, they still face limitations in output diversity, particularly when sampled with a high classifier-free guidance scale for optimal image quality or when trained on small datasets. We attribute this problem to the role of the conditioning signal in inference and offer an improved sampling strategy for diffusion models that can increase generation diversity, especially at high guidance scales, with minimal loss of sample quality. Our sampling strategy anneals the conditioning signal by adding scheduled, monotonically decreasing Gaussian noise to the conditioning vector during inference to balance diversity and condition alignment. Our Condition-Annealed Diffusion Sampler (CADS) can be used with any pretrained model and sampling algorithm, and we show that it boosts the diversity of diffusion models in various conditional generation tasks. Further, using an existing pretrained diffusion model, CADS achieves a new state-of-the-art FID of 1.70 and 2.31 for class-conditional ImageNet generation at 256$\times$256 and 512$\times$512 respectively.
Forward citations
Cited by 9 Pith papers
-
Classifier-Free Guidance: From High-Dimensional Analysis to Generalized Guidance Forms
CFG's distortion of the target distribution vanishes as data dimension grows, and a power-law generalization improves fidelity and diversity in high-dimensional generative models.
-
Momentum Guidance: Plug-and-Play Guidance for Flow Models
Momentum Guidance improves flow-model sample quality by extrapolating the current velocity away from an exponential moving average of past velocities, with no extra model evaluations.
-
Zero-Shot Cyclic Peptide Design via Composable Geometric Constraints
CP-Composer trains a geometric diffusion model on linear peptides and imposes cyclization constraints at generation time, achieving 38-84% constraint satisfaction across four cyclization strategies.
-
DIMCIM: A Quantitative Evaluation Framework for Default-mode Diversity and Generalization in Text-to-Image Generative Models
A new evaluation framework, DIMCIM, measures default-mode diversity and prompted generalization in text-to-image models, finding a scale trade-off and a 0.85 correlation between default diversity and training data diversity.
-
Boost-and-Skip: A Simple Guidance-Free Diffusion for Minority Generation
Starting diffusion sampling from variance-boosted noise and skipping early timesteps generates minority samples at guided-method quality with far less compute.
-
EMAG: Self-Rectifying Diffusion Sampling with Exponential Moving Average Guidance
EMAG replaces selected attention maps with their exponential moving average during diffusion sampling, reporting +0.46 HPS over CFG on SD3 and composing with APG/CADS.
-
DP-DocLDM: Differentially Private Document Image Generation using Latent Diffusion Models
DP-DocLDM fine-tunes a latent diffusion model under differential privacy to generate synthetic document images, but the public pretraining set already contains the private benchmark datasets, invalidating the claimed ...
-
Synthetic Data Augmentation using Pre-trained Diffusion Models for Long-tailed Food Image Classification
A two-stage diffusion-based data augmentation pipeline with confusing-class negative prompts improves long-tailed food image classification accuracy on Food101-LT and VFN-LT.
-
How Much To Guide: Revisiting Adaptive Guidance in Classifier-Free Guidance Text-to-Vision Diffusion Models
Using classifier-free guidance for only the first 30-50% of denoising steps preserves generation quality while saving 20-30% inference time across image and video diffusion models.
Discussion (0). Continue with ORCID to comment.