REVIEW 10 cited by
Denoising Diffusion Samplers
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution. Samples from the generative model are then obtained by simulating an approximation of the time-reversal of this diffusion initialized by Gaussian samples. Practically, the intractable score terms appearing in the time-reversed process are approximated using score matching techniques. We explore here a similar idea to sample approximately from unnormalized probability density functions and estimate their normalizing constants. We consider a process where the target density diffuses towards a Gaussian. Denoising Diffusion Samplers (DDS) are obtained by approximating the corresponding time-reversal. While score matching is not applicable in this context, we can leverage many of the ideas introduced in generative modeling for Monte Carlo sampling. Existing theoretical results from denoising diffusion models also provide theoretical guarantees for DDS. We discuss the connections between DDS, optimal control and Schr\"odinger bridges and finally demonstrate DDS experimentally on a variety of challenging sampling tasks.
Forward citations
Cited by 10 Pith papers
-
Stochastic Quantization as Optimal Control
Stochastic quantization is re-expressed as finite-time optimal control, in which a learned Doob force plus exact path weights reach the Gibbs measure without waiting for equilibrium.
-
Solving Inverse Problems with Flow-based Models via Model Predictive Control
MPC-Flow applies model predictive control to guide pretrained flow models through inverse problems, with a single-step variant that avoids backpropagation and scales to 32B-parameter models on consumer hardware.
-
Path Integral Optimiser: Global Optimisation via Neural Schr\"odinger-F\"ollmer Diffusion
A neural Schrödinger-Föllmer diffusion, trained like the Path Integral Sampler, is repurposed as a global optimizer, with new conditional convergence bounds and competitive results on small tasks only.
-
Amortized In-Context Bayesian Posterior Estimation
A benchmark of in-context Bayesian posterior estimators shows the reverse-KL objective with transformers and normalizing flows outperforms forward-KL neural posterior estimation on predictive and out-of-distribution tasks.
-
Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlo
An SMC importance-sampling algorithm debiases discrete diffusion guidance, asymptotically sampling from the target tempered distribution p0(x0)p(ζ|x0)^α.
-
Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling
A train-then-correct Hamiltonian Monte Carlo with learned stochastic paths gives exact Boltzmann corrections via a recorded generalized work, with limited but honest empirical validation.
-
Diffusion-Augmented Markov Decision Processes for Maximum Entropy Reinforcement Learning
Diffusion policies can be inserted into maximum-entropy RL by minimizing an upper bound on reverse KL, yielding DiffPPO, DiffSAC, and DiffWPO.
-
Continuously Tempered Diffusion Samplers
CTDS trains neural samplers with a controlled Langevin dynamics over both position and a continuous temperature coordinate, and reports improved sampling on a 40-mode Gaussian mixture.
-
Towards Adaptive External Communication in Autonomous Vehicles: A Conceptual Design Framework
A three-layer framework (input, processing, output) for adaptive external human-machine interfaces in autonomous vehicles is introduced to systematize design and analysis.
-
Neural Flow Samplers with Shortcut Models
Neural Flow Shortcut Sampler (NFS2) estimates the partition-function derivative with velocity-driven SMC and Stein control variates, and adds a generalized shortcut consistency loss for few-step sampling.
Discussion (0). Continue with ORCID to comment.