REVIEW 8 cited by
Flow Annealed Importance Sampling Bootstrap
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
abstract
Normalizing flows are tractable density models that can approximate complicated target distributions, e.g. Boltzmann distributions of physical systems. However, current methods for training flows either suffer from mode-seeking behavior, use samples from the target generated beforehand by expensive MCMC methods, or use stochastic losses that have high variance. To avoid these problems, we augment flows with annealed importance sampling (AIS) and minimize the mass-covering $\alpha$-divergence with $\alpha=2$, which minimizes importance weight variance. Our method, Flow AIS Bootstrap (FAB), uses AIS to generate samples in regions where the flow is a poor approximation of the target, facilitating the discovery of new modes. We apply FAB to multimodal targets and show that we can approximate them very accurately where previous methods fail. To the best of our knowledge, we are the first to learn the Boltzmann distribution of the alanine dipeptide molecule using only the unnormalized target density, without access to samples generated via Molecular Dynamics (MD) simulations: FAB produces better results than training via maximum likelihood on MD samples while using 100 times fewer target evaluations. After reweighting the samples, we obtain unbiased histograms of dihedral angles that are almost identical to the ground truth.
Forward citations
Cited by 8 Pith papers
-
Temperature-Annealed Boltzmann Generators
High-temperature reverse-KL pretraining followed by reweighting-based annealing lets normalizing flows sample Boltzmann distributions of peptides up to hexapeptide without mode collapse and with fewer target energy ev...
-
BoostMD: Accelerating molecular sampling by leveraging ML force field features from previous time-steps
BoostMD accelerates MLFF molecular dynamics by predicting energy changes from previous-step node features and positional displacements, reporting 8x speedup and matching the reference model's sampled free energy surfa...
-
Tensor Train Diffusion: Leveraging Low-Rank Structures for High-Dimensional Score-Based Sampling
Functional tensor trains plus BSDE regression solve the HJB score PDE, yielding a fast low-rank sampler that outperforms neural diffusion methods on multimodal targets.
-
Efficient Online Reinforcement Learning for Diffusion Policy
Diffusion policies can be trained online with reweighted score matching using only Q-functions, and the resulting DPMD and SDAC algorithms beat SAC and prior diffusion-policy RL on most MuJoCo tasks.
-
Sampling from Boltzmann densities with physics informed low-rank formats
A low-rank tensor-train solver for the continuity equation along an annealing path, combined with resampling and Langevin steps, samples Boltzmann densities with low energy distance on benchmarks.
-
Neural Non-Equilibrium Hamiltonian Monte Carlo for Corrected Boltzmann Sampling
A train-then-correct Hamiltonian Monte Carlo with learned stochastic paths gives exact Boltzmann corrections via a recorded generalized work, with limited but honest empirical validation.
-
Coarse-Grained Boltzmann Generators
Coarse-grained Boltzmann generators reweight flow-model samples using a learned potential of mean force, recovering equilibrium statistics from biased or short simulations.
-
Towards Adaptive External Communication in Autonomous Vehicles: A Conceptual Design Framework
A three-layer framework (input, processing, output) for adaptive external human-machine interfaces in autonomous vehicles is introduced to systematize design and analysis.
Discussion (0). Continue with ORCID to comment.