Pith. sign in

Sticking the landing: Simple, lower-variance gradient estimators for variational inference

2 Pith papers cite this work, alongside 73 external citations. Polarity classification is still indexing.

2 Pith papers citing it
73 external citations · Pith
abstract

We propose a simple and general variant of the standard reparameterized gradient estimator for the variational evidence lower bound. Specifically, we remove a part of the total derivative with respect to the variational parameters that corresponds to the score function. Removing this term produces an unbiased gradient estimator whose variance approaches zero as the approximate posterior approaches the exact posterior. We analyze the behavior of this gradient estimator theoretically and empirically, and generalize it to more complex variational distributions such as mixtures and importance-weighted posteriors.

fields

cs.CE 1 cs.CV 1

years

2026 1 2022 1

representative citing papers

DreamFusion: Text-to-3D using 2D Diffusion

cs.CV · 2022-09-29 · accept · novelty 7.0 · 2 refs

Optimizes a Neural Radiance Field via probability density distillation from a 2D diffusion model to produce text-conditioned 3D scenes viewable from any angle.

citing papers explorer

Showing 2 of 2 citing papers.