REVIEW 6 cited by
Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Diffusion models benefit from instillation of task-specific information into the score function to steer the sample generation towards desired properties. Such information is coined as guidance. For example, in text-to-image synthesis, text input is encoded as guidance to generate semantically aligned images. Proper guidance inputs are closely tied to the performance of diffusion models. A common observation is that strong guidance promotes a tight alignment to the task-specific information, while reducing the diversity of the generated samples. In this paper, we provide the first theoretical study towards understanding the influence of guidance on diffusion models in the context of Gaussian mixture models. Under mild conditions, we prove that incorporating diffusion guidance not only boosts classification confidence but also diminishes distribution diversity, leading to a reduction in the differential entropy of the output distribution. Our analysis covers the widely adopted sampling schemes including DDPM and DDIM, and leverages comparison inequalities for differential equations as well as the Fokker-Planck equation that characterizes the evolution of probability density function, which may be of independent theoretical interest.
Forward citations
Cited by 6 Pith papers
-
What Exactly Does Guidance Do in Masked Discrete Diffusion Models
With exact scores and no discretization error, CFG in 1D masked discrete diffusion samples exactly the tilted distribution; in 2D it does not, and the TV convergence rate is double-exponential in guidance strength.
-
Provable Diffusion Posterior Sampling for Bayesian Inversion
A diffusion posterior sampler using Monte Carlo Langevin score estimation and warm start is proven to converge in Wasserstein-2 distance under semi-log-concavity and sub-Gaussian assumptions, and outperforms DPS/TV on...
-
Fast Convergence for High-Order ODE Solvers in Diffusion Probabilistic Models
A TV convergence bound O(d^{7/4} ε^{1/2} + d(dH)^p) is proved for p-th order (exponential) Runge-Kutta samplers of probability-flow ODEs under C² smoothness of the learned score.
-
Efficiently Access Diffusion Fisher: Within the Outer Product Span Space
The diffusion Fisher matrix of a Gaussian-perturbed distribution is expressed in the span of data outer products, enabling two faster approximation algorithms for trace and matrix-vector access.
-
Solving Inverse Problems via Diffusion-Based Priors: An Approximation-Free Ensemble Sampling Approach
A weighted-particle sampler evolves the posterior through the diffusion model's reverse dynamics, with theoretical error bounds and improved image reconstructions.
-
Non-asymptotic convergence bound of conditional diffusion models
CARD's generated conditional distribution is shown to converge in Wasserstein distance to the true conditional distribution, with a separate score-estimation error bound controlled by network resolution and distributi...
Discussion (0). Sign in to comment.