REVIEW 4 major objections 5 minor 2 cited by
CoDe: Blockwise Control for Denoising Diffusion Models
T0 review · 4 major / 5 minor · reviewed 2026-08-09 · deepseek-v4-flash
Pith's one-line read CoDe steers a frozen diffusion model toward a downstream reward at inference time by applying best-of-N selection blockwise during denoising, with no gradients or fine-tuning.
desk verdict CoDe is a simple, honest blockwise best-of-N for diffusion with real empirical support; the optimality claim rests on cited work and the Tweedie value approximation at early steps is the main unquantified risk, with a secondary runtime-table contradiction. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the blockwise value-guided selection loop built on Theorem 2.1's tilted posterior. The value function $V(x_t;p,c)=E_{x_0\sim p(x_0|x_t,c)}[r(x_0)]$ is approximated by $r(\hat{x}_0)$, with $\hat{x}_0=(x_t-\sqrt{1-\bar\alpha_t}\,\varepsilon_\theta(x_t,c,t))/\sqrt{\bar\alpha_t}$ from Tweedie's formula. Every $B$ steps, CoDe draws $N$ independent $B$-step continuations, scores them with this value estimate, and keeps the argmax; this repeated selection is the Monte Carlo stand-in for sampling from $\pi^*_\lambda$, with the block size $B$ controlling how often selection pressure is applied and therefore how far the output drifts from the base distribution.
What would settle it
Run the Gaussian mixture case study with the exact value $V(x_t)=E[r(x_0)|x_t]$ computed from the known mixture, and compare CoDe's selected branches, win rate, and KL divergence against the Tweedie-approximated version; if exact-value CoDe does not match or beat the claimed best-of-N frontier, the blockwise selection is not doing the work claimed. A sharper version uses a nonlinear reward such as $r(x)=\|x-\mu\|^2$, where $r(E[x_0|x_t])$ and $E[r(x_0)|x_t]$ visibly diverge at large $t$, and checks whether CoDe's early block choices track the exact-value optimum.
Extended reading notes
Core claim
CoDe's central claim is that the optimal solution of the KL-regularized reward objective, $\pi^*_\lambda(x_{t-1}|x_t) \propto p(x_{t-1}|x_t)\,e^{\lambda V(x_{t-1})}$ (Theorem 2.1), can be approximated at inference time by a blockwise best-of-N procedure on a frozen diffusion model. Every $B$ denoising steps the sampler unrolls $N$ candidate continuations from the base model, scores each with the value estimate $V(x_t)\approx r(\hat{x}_0)$, where $\hat{x}_0$ is the Tweedie clean-image prediction, and keeps the highest-value candidate before continuing. Full best-of-N is the $B=T$ case and per-step selection is the $B=1$ case, so CoDe positions itself as an interpolation that stays close to the optimal reward-versus-divergence frontier: the Gaussian mixture study shows on-par win-rate-versus-KL performance with best-of-N using roughly 10-15 times fewer samples, and the image experiments report competitive reward alignment with better prompt fidelity and lower divergence than gradient-based guidance baselines.
Load-bearing premise
The method's value estimate treats the reward of the average predicted clean image as the average reward; early in denoising that equality can fail badly, and wrong branch choices would defeat the alignment even though each candidate is a valid base-model sample.
Editorial extensions
If this is right
- A frozen diffusion model can be aligned to differentiable or non-differentiable rewards without fine-tuning and without gradient access, using only base-model samples and reward queries.
- CoDe interpolates between best-of-N and per-step selection, so $N$, $B$, and $\eta$ give the user a tunable trade-off among reward, divergence from the base model, and compute.
- In the Gaussian mixture study, CoDe reaches the same win-rate-versus-KL frontier as best-of-N with $N\in[2,10]$ rather than $N\in[30,500]$, a roughly 10-15x sample-efficiency gain.
- The KL divergence from the base model is bounded by $(\log N - (N-1)/N)\,\eta T / B$, so divergence grows logarithmically in $N$, shrinks with larger blocks, and is further controlled by the noise-conditioning ratio $\eta$.
- On image tasks, CoDe and its noise-conditioned variant CoDe($\eta$) report competitive reward while keeping better text alignment and lower divergence than gradient-based guidance methods, at lower runtime than per-step and universal guidance.
Reading between the lines
- The efficiency gain over best-of-N plausibly comes from applying selection pressure before the final image exists, so one surviving trajectory amortizes the cost of many rejected continuations; the paper demonstrates the gain but does not decompose it.
- If the Tweedie value approximation is the active weakness, a learned or ensemble value function accurate at high noise levels would likely push CoDe's frontier further; this is a natural next step the paper does not take.
- The adaptive-control ablation suggests the optimal block schedule is task-dependent: compression benefits from late-block control, while tasks that fix global layout early would likely benefit from early-block control.
- Since CoDe only needs samples and a scalar reward, it transfers to any generative diffusion setting, such as molecules or audio, where the reward is non-differentiable or black-box.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes CoDe (Controlled Denoising), an inference-time, gradient-free guidance method for frozen diffusion models. The method performs blockwise best-of-N sampling: every B denoising steps it draws N candidate continuations from the base model, scores them with a value function approximated by r(E[x0|xt]) via Tweedie's formula, and keeps only the highest-scoring candidate. The authors claim that this procedure approximately samples from the optimal KL-regularized reward-tilted posterior of Theorem 2.1, and they evaluate it on a 2D Gaussian mixture model and on Stable Diffusion across style, face, stroke, compression, and aesthetic guidance tasks, comparing against DPS, UG, MPGD, Freedom, BoN, and SVDD-PM. The headline empirical claims are that CoDe matches the reward-versus-divergence trade-off of BoN with roughly 10-15x fewer samples in the GMM study, and that it offers competitive image/text alignment with lower divergence than several baselines.
Significance. If the central claims hold, CoDe is a practically attractive contribution: it requires no gradient access, no fine-tuning, and no trained value network, and it naturally handles non-differentiable rewards. The paper also ships code, which is a concrete strength. However, the most load-bearing claims are not fully supported. The approximation in Eq. (12) replaces E[r(x0)|xt] with r(E[x0|xt]), which is uncontrolled at early denoising steps, and the paper does not prove that blockwise argmax selection (beam width 1) actually samples from the optimal KL-regularized objective. A separate internal inconsistency in Section 6.4, where CoDe is called faster than BoN while Table 5 shows the opposite, weakens the efficiency narrative. The empirical work is extensive and suggests the method works reasonably in practice, but the theoretical positioning needs substantial revision.
major comments (4)
- [Section 3, Eq. (12)] The value function approximation V(xt) ≈ r(E[x0|xt]) is not justified with any error bound. V(xt) is defined in Eq. (6) as E_{x0∼p(x0|xt)}[r(x0)], and replacing the expectation inside r is exact only for linear rewards or point-mass posteriors. At early denoising steps p(x0|xt) is broad, so the surrogate can select branches that do not maximize true expected reward. Because CoDe keeps a single survivor per block (beam width 1), a wrong early selection cannot be repaired later. This directly affects Contribution I, which claims CoDe samples from the optimal KL-regularized objective of Theorem 2.1, since that theorem requires the true value function. The paper's own caveat that the approximation is 'expected to be more accurate towards the end of denoising' is not a substitute for a bound or correction. Please either provide an analysis of the approximation gap, or revise the optimality claim to clearly state that CoDe optimizes a surrogate objective.
- [Appendix A, Eq. (18)] The proof of Theorem 2.1 contains a mathematical error in the definition of the normalizing constant. Eq. (18) defines Zλ(xt,c) = E_{xt−1∼p}[p(xt−1|xt,c)e^{λV(xt−1;p,c)}], but the density p(xt−1|xt,c) should not appear inside the expectation; the correct normalizer is Zλ(xt,c) = E_{xt−1∼p(·|xt,c)}[e^{λV(xt−1;p,c)}]. As written, the derivation of Eq. (19)-(23) is internally inconsistent, even though the theorem statement itself is a standard variational result. This needs to be corrected.
- [Section 6.4, Table 5] The text in Section 6.4 states that 'CoDe, CoDe(η) with its blockwise guidance remains to be faster and more efficient than BoN', but Table 5 reports CoDe at 489.00 s/img versus BoN at 266.77 s/img, and Table 9 shows CoDe slower than BoN in all three scenarios (e.g., style: 441.81 vs 266.02; face: 583.12 vs 268.43; stroke: 442.08 vs 265.86). Moreover, CoDe has NT/B reward queries versus BoN's N, so it is not more query-efficient either. The efficiency claim is therefore contradicted by the paper's own tables and must be corrected. If the intent is to claim efficiency per unit of achieved reward at a lower N, that should be stated explicitly and supported with the trade-off curves in Fig. 10.
- [Section 3, 'Why blockwise BoN is almost optimal'] The paper asserts that blockwise argmax selection with beam width 1 approximates the optimal reward-tilted posterior of Theorem 2.1, but no proof is given for this blockwise algorithm with a single survivor. The cited results (Beirami et al. 2024; Yang et al. 2024; Mudgal et al. 2024) concern best-of-N sampling and controlled decoding in particular settings; they do not directly imply that CoDe's resampling every B steps with one survivor samples from π*_λ in Eq. (10). The connection in Appendix C (argmax as a zero-temperature categorical) is a selection rule, not a statement about the final sample distribution. Please either provide a theoretical argument specific to CoDe, or explicitly reclassify it as a heuristic approximation to the optimal sampler.
minor comments (5)
- [Section 5] The claim that CoDe is 'roughly 10-15× more efficient than BoN' should be qualified as 'requires 10-15× fewer samples N' rather than 'more efficient' without qualification, since CoDe incurs additional per-block reward queries and inference steps as shown in Table 5.
- [Figure 5 caption / Appendix F] Figure 5's caption says 'Reward vs. KL-divergence', but for image experiments Appendix F only provides an upper bound on KL (Lemma F.1) and does not describe an empirical estimate for images. Please state clearly whether the plotted quantity is the theoretical upper bound or an empirical estimate.
- [Section 6.4] The text in Section 6.4 says CoDe offers a '4× faster runtime than UG', but Table 5 gives 489.00 vs 1241.47 s/img, which is approximately 2.5×. Please check this number.
- [Throughout] There are several typos, including 'comptetitive' in Section 4, 'scneario' near Table 1, and 'SVPP-PM' in Appendix E. A light proofreading pass is needed.
- [Section 2.2, Eq. (10)] In Theorem 2.1 and the surrounding text, the theorem is stated for the unconditional setting, while the algorithm conditions on c. The conditional extension is deferred to Appendix A, which is fine, but the main text should flag this distinction earlier to avoid confusion.
Circularity Check
No significant circularity: Theorem 2.1 is proved directly and the empirical comparisons are independent; the value approximation and runtime-table issues are correctness risks, not tautologies.
full rationale
The derivation chain is self-contained at its core. Theorem 2.1 is proved in Appendix A by standard variational calculus: the KL-regularized objective is rewritten as -KL(pi || p_lambda) plus a constant, so the optimum is p_lambda. Algorithm 1 is an explicit blockwise selector, not a quantity derived from the objective; its reward/divergence behavior is measured empirically against BoN, SVDD-PM, DPS, and UG in the GMM and image experiments. The near-optimality of blockwise BoN is imported from Beirami/Yang/Mudgal; although these works share an author with the present paper, they are external theorems about BoN asymptotics that do not incorporate this paper's fitted values, so they are independent support under the stated rules. The Tweedie surrogate V(x_t) approximately r(E[x_0|x_t]) (Eq. 12) is a stated approximation rather than a tautology: it can diverge from E[r(x_0)] at early steps, which is a correctness risk the paper concedes ('expected to be more accurate towards the end of denoising'), but it is not an input-output equivalence. The runtime claim in Section 6.4 contradicts Table 5 (CoDe at 489.00 s/img versus BoN at 266.77 s/img) and is a consistency/correctness issue, not circularity. Therefore no circular step is exhibited.
Assumptions & free parameters
free parameters (4)
- lambda (KL-regularization coefficient)
- N (candidate count per block) =
swept from 2 to 500; best settings typically 40 to 100
- B (block size) =
swept from 1 to 320; best settings typically 5 to 80
- eta (noise-conditioning ratio) =
best values: 0.6 for style/stroke, 0.7 for face, 0.8 for compression
assumptions (5)
- domain assumption Tweedie's formula gives an accurate estimate of E[r(x0)] via r(E[x0|xt]) (Eq. 12).
- domain assumption Blockwise best-of-N sampling is almost optimal for the KL-regularized reward objective (Eq. 9).
- domain assumption The KL divergence bound in Lemma F.1, KL(CoDe) <= (log N minus (N-1)/N) times T/B, holds for the implemented algorithm.
- domain assumption Reward functions used in evaluation (CLIP cosine similarity, JPEG size, FaceNet negative L1, aesthetic predictor) are valid proxies for the stated alignment goals.
- domain assumption In Case Study I, KL divergence between guided and base distributions can be estimated by fitting a Gaussian to 1000 samples.
Cite this review
Pith. "Pith review of CoDe: Blockwise Control for Denoising Diffusion Models." pith.science (2026). https://pith.science/paper/QZ54L2VW
@misc{pith2026250200968,
author = {Pith},
title = {Pith review of: CoDe: Blockwise Control for Denoising Diffusion Models},
year = {2026},
howpublished = {\url{https://pith.science/paper/QZ54L2VW}},
note = {Machine review of arXiv:2502.00968}
}
read the original abstract
Aligning diffusion models to downstream tasks often requires finetuning new models or gradient-based guidance at inference time to enable sampling from the reward-tilted posterior. In this work, we explore a simple inference-time gradient-free guidance approach, called controlled denoising (CoDe), that circumvents the need for differentiable guidance functions and model finetuning. CoDe is a blockwise sampling method applied during intermediate denoising steps, allowing for alignment with downstream rewards. Our experiments demonstrate that, despite its simplicity, CoDe offers a favorable trade-off between reward alignment, prompt instruction following, and inference cost, achieving a competitive performance against the state-of-the-art baselines. Our code is available at: https://github.com/anujinho/code.
Figures
Figures from the paper (21 more)
Forward citations
Cited by 2 Pith papers
-
Superbunched random fiber laser
A fiber-integrated random laser uses Rayleigh scattering, cascaded Brillouin scattering, and four-wave mixing to generate multi-wavelength superbunched light with g(2)(0) up to ~26 and improved temporal ghost imaging.
-
Scaling Image and Video Generation via Test-Time Evolutionary Search
Evolutionary search over denoising trajectories improves image and video generation quality and diversity as test-time compute increases, without retraining the generative model.
Reference graph
Works this paper leans on
-
[1]
Cold diffusion: Inverting arbitrary image transforms without noise
Arpit Bansal, Eitan Borgnia, Hong-Min Chu, Jie Li, Hamid Kazemi, Furong Huang, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Cold diffusion: Inverting arbitrary image transforms without noise. Advances in Neural Information Processing Systems, 36, 2024 a
work page 2024
-
[2]
Universal Guidance for Diffusion Models
Arpit Bansal, Hong-Min Chu, Avi Schwarzschild, Soumyadip Sengupta, Micah Goldblum, Jonas Geiping, and Tom Goldstein. Universal Guidance for Diffusion Models . In The Twelfth International Conference on Learning Representations. IEEE, 2 2024 b . doi:10.48550/arXiv.2302.07121. URL http://arxiv.org/abs/2302.07121
-
[3]
Lumiere: A space-time diffusion model for video generation
Omer Bar-Tal, Hila Chefer, Omer Tov, Charles Herrmann, Roni Paiss, Shiran Zada, Ariel Ephrat, Junhwa Hur, Yuanzhen Li, Tomer Michaeli, et al. Lumiere: A space-time diffusion model for video generation. arXiv preprint arXiv:2401.12945, 2024
arXiv 2024
-
[4]
Theoretical guarantees on the best-of-n alignment policy
Ahmad Beirami, Alekh Agarwal, Jonathan Berant, Jacob Eisenstein, Chirag Nagpal, Ananda Theertha Suresh, Google Research, and Google DeepMind. Theoretical guarantees on the best-of-n alignment policy . 1 2024. URL https://arxiv.org/abs/2401.01879v1
arXiv 2024
-
[5]
Training Diffusion Models with Reinforcement Learning
Kevin Black, Michael Janner, Yilun Du, Ilya Kostrikov, and Sergey Levine. Training Diffusion Models with Reinforcement Learning . 5 2023. URL https://arxiv.org/abs/2305.13301v4
arXiv 2023
-
[6]
Large language monkeys: Scaling inference compute with repeated sampling
Bradley Brown, Jordan Juravsky, Ryan Ehrlich, Ronald Clark, Quoc V Le, Christopher R \'e , and Azalia Mirhoseini. Large language monkeys: Scaling inference compute with repeated sampling. arXiv preprint arXiv:2407.21787, 2024
arXiv 2024
-
[7]
Monte Carlo guided Diffusion for Bayesian linear inverse problems
Gabriel Cardoso, Yazid Janati, E L Idrissi, Sylvain Le Corff, and Eric Moulines. Monte Carlo guided Diffusion for Bayesian linear inverse problems . 8 2023. URL https://arxiv.org/abs/2308.07983v2
arXiv 2023
-
[8]
Adaptively-realistic image generation from stroke and sketch with diffusion model
Shin-I Cheng, Yu-Jie Chen, Wei-Chen Chiu, Hung-Yu Tseng, and Hsin-Ying Lee. Adaptively-realistic image generation from stroke and sketch with diffusion model. In 2023 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, January 2023. doi:10.1109/wacv56688.2023.00404. URL http://dx.doi.org/10.1109/WACV56688.2023.00404
Show all 74 references
-
[9]
Improving diffusion models for inverse problems using manifold constraints
Hyungjin Chung, Byeongsu Sim, Dohoon Ryu, and Jong Chul Ye. Improving diffusion models for inverse problems using manifold constraints. Advances in Neural Information Processing Systems, 35: 0 25683--25696, 2022
2022
-
[10]
Mccann, Marc L
Hyungjin Chung, Jeongsol Kim, Michael T. Mccann, Marc L. Klasky, and Jong Chul Ye. Diffusion Posterior Sampling for General Noisy Inverse Problems . In The Eleventh International Conference on Learning Representations, 9 2023. URL https://arxiv.org/abs/2209.14687v4
2023 arXiv
-
[11]
Kevin Clark, Paul Vicol, Kevin Swersky, and David J. Fleet. Directly fine-tuning diffusion models on differentiable rewards. In The Twelfth International Conference on Learning Representations, 2024. URL https://openreview.net/forum?id=1vmSEVL19f
2024
-
[12]
Diffusion Models Beat GANs on Image Synthesis
Prafulla Dhariwal and Alex Nichol. Diffusion Models Beat GANs on Image Synthesis . Advances in Neural Information Processing Systems, 11: 0 8780--8794, 5 2021. ISSN 10495258. URL https://arxiv.org/abs/2105.05233v4
2021 arXiv
-
[13]
Tweedie’s formula and selection bias
Bradley Efron. Tweedie’s formula and selection bias. Journal of the American Statistical Association, 106 0 (496): 0 1602--1614, 2011
2011
-
[14]
DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models
Ying Fan, Olivia Watkins, Yuqing Du, Hao Liu, Moonkyung Ryu, Craig Boutilier, Pieter Abbeel, Mohammad Ghavamzadeh, Kangwook Lee, and Kimin Lee. DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Models . 5 2023. URL https://arxiv.org/abs/2305.16381v3
2023 arXiv
-
[15]
Scaling Laws for Reward Model Overoptimization
Leo Gao, John Schulman, and Jacob Hilton. Scaling Laws for Reward Model Overoptimization . Proceedings of Machine Learning Research, 202: 0 10835--10866, 10 2022. ISSN 26403498. URL https://arxiv.org/abs/2210.10760v1
2022 arXiv
-
[16]
Image style transfer using convolutional neural networks
Leon A Gatys, Alexander S Ecker, and Matthias Bethge. Image style transfer using convolutional neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 2414--2423, 2016
2016
-
[17]
Diffusion-rpo: Aligning diffusion models through relative preference optimization, 2024
Yi Gu, Zhendong Wang, Yueqin Yin, Yujia Xie, and Mingyuan Zhou. Diffusion-rpo: Aligning diffusion models through relative preference optimization, 2024
2024
-
[18]
BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling
Lin Gui, Cristina G \^ a rbacea, and Victor Veitch. BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling . 6 2024. URL https://arxiv.org/abs/2406.00832v2
2024 arXiv
-
[19]
Gradient Guidance for Diffusion Models: An Optimization Perspective
Yingqing Guo, Hui Yuan, Yukang Yang, Minshuo Chen, and Mengdi Wang. Gradient Guidance for Diffusion Models: An Optimization Perspective . 4 2024. URL https://arxiv.org/abs/2404.14743v1
2024 arXiv
-
[20]
Manifold preserving guided diffusion
Yutong He, Naoki Murata, Chieh-Hsin Lai, Yuhta Takida, Toshimitsu Uesaka, Dongjun Kim, Wei-Hsiang Liao, Yuki Mitsufuji, J Zico Kolter, Ruslan Salakhutdinov, and Stefano Ermon. Manifold preserving guided diffusion. In The Twelfth International Conference on Learning Representat...
2024
-
[21]
Clipscore: A reference-free evaluation metric for image captioning
Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, and Yejin Choi. Clipscore: A reference-free evaluation metric for image captioning. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, 2...
2021 doi
-
[22]
Gans trained by a two time-scale update rule converge to a local nash equilibrium, 2017
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilibrium, 2017
2017
-
[23]
Denoising Diffusion Probabilistic Models
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising Diffusion Probabilistic Models . Advances in Neural Information Processing Systems, 33: 0 6840--6851, 2020. URL https://github.com/hojonathanho/diffusion
2020
-
[24]
Classifier-Free Diffusion Guidance
Jonathan Ho, Google Research, and Tim Salimans. Classifier-Free Diffusion Guidance . In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications, 12 2021
2021
-
[25]
Rethinking fid: Towards a better evaluation metric for image generation
Sadeep Jayasumana, Srikumar Ramalingam, Andreas Veit, Daniel Glasner, Ayan Chakrabarti, and Sanjiv Kumar. Rethinking fid: Towards a better evaluation metric for image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ ...
2024
-
[26]
Elucidating optimal reward-diversity tradeoffs in text-to-image diffusion models, 2024
Rohit Jena, Ali Taghibakhshi, Sahil Jain, Gerald Shen, Nima Tajbakhsh, and Arash Vahdat. Elucidating optimal reward-diversity tradeoffs in text-to-image diffusion models, 2024
2024
-
[27]
Leveraging early-stage robustness in diffusion models for efficient and high-quality image synthesis
Yulhwa Kim, Dongwon Jo, Hyesung Jeon, Taesu Kim, Daehyun Ahn, Hyungjun Kim, and jae-joon kim. Leveraging early-stage robustness in diffusion models for efficient and high-quality image synthesis. In Thirty-seventh Conference on Neural Information Processing Systems, 2023. URL ...
2023
-
[28]
Genie: Generative hard negative images through diffusion, 2023
Soroush Abbasi Koohpayegani, Anuj Singh, K L Navaneet, Hadi Jamali-Rad, and Hamed Pirsiavash. Genie: Generative hard negative images through diffusion, 2023
2023
-
[29]
Tomasz Korbak, Ethan Perez, and Christopher L. Buckley. RL with KL penalties is better viewed as Bayesian inference . Findings of the Association for Computational Linguistics: EMNLP 2022, pp.\ 1083--1091, 5 2022. doi:10.18653/v1/2022.findings-emnlp.77. URL https://arxiv.org/a...
2022 arXiv
-
[30]
Direct consistency optimization for compositional text-to-image personalization, 2024
Kyungmin Lee, Sangkyung Kwak, Kihyuk Sohn, and Jinwoo Shin. Direct consistency optimization for compositional text-to-image personalization, 2024
2024
-
[31]
Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding , 8 2024
Xiner Li, Yulai Zhao, Chenyu Wang, Gabriele Scalia, Gokcen Eraslan, Surag Nair, Tommaso Biancalani, Aviv Regev, Sergey Levine, and Masatoshi Uehara. Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding , 8 2024. URL https://arxiv....
2024 arXiv
-
[32]
Gligen: Open-set grounded text-to-image generation
Yuheng Li, Haotian Liu, Qingyang Wu, Fangzhou Mu, Jianwei Yang, Jianfeng Gao, Chunyuan Li, and Yong Jae Lee. Gligen: Open-set grounded text-to-image generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 22511--22521, 2023
2023
-
[33]
SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations
Chenlin Meng, Yutong He, Yang Song, Jiaming Song, Jiajun Wu, Jun Yan Zhu, and Stefano Ermon. SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations . ICLR 2022 - 10th International Conference on Learning Representations, 8 2021. URL https://arxiv.org...
2022 arXiv
-
[34]
FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition
Sicheng Mo, Fangzhou Mu, Kuan Heng Lin, Yanli Liu, Bochen Guan, Yin Li, and Bolei Zhou. FreeControl: Training-Free Spatial Control of Any Text-to-Image Diffusion Model with Any Condition . 12 2023. URL https://arxiv.org/abs/2312.07536v1
2023 arXiv
-
[35]
T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models
Chong Mou, Xintao Wang, Liangbin Xie, Yanze Wu, Jian Zhang, Zhongang Qi, and Ying Shan. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, pp.\ 429...
2024
-
[36]
Information theoretic guarantees for policy alignment in large language models
Youssef Mroueh. Information theoretic guarantees for policy alignment in large language models. arXiv preprint arXiv:2406.05883, 2024
2024 arXiv
-
[37]
Controlled Decoding from Language Models
Sidharth Mudgal, Jong Lee, Harish Ganapathy, YaGuang Li, Tao Wang, Yanping Huang, Zhifeng Chen, Heng-Tze Cheng, Michael Collins, Trevor Strohman, Jilin Chen, Alex Beutel, and Ahmad Beirami. Controlled Decoding from Language Models . In Forty-first International Conference on M...
2024 arXiv
-
[38]
Improved Denoising Diffusion Probabilistic Models , 7 2021
Alexander Quinn Nichol and Prafulla Dhariwal. Improved Denoising Diffusion Probabilistic Models , 7 2021. ISSN 2640-3498. URL https://proceedings.mlr.press/v139/nichol21a.html
2021
-
[39]
Particle Denoising Diffusion Sampler
Angus Phillips, Hai Dang Dau, Michael John Hutchinson, Valentin De Bortoli, George Deligiannidis, and Arnaud Doucet. Particle Denoising Diffusion Sampler . Proceedings of Machine Learning Research, 235: 0 40688--40724, 2 2024. ISSN 26403498. URL https://arxiv.org/abs/2402.06320v2
2024 arXiv
-
[40]
Aligning Text-to-Image Diffusion Models with Reward Backpropagation
Mihir Prabhudesai, Anirudh Goyal, Deepak Pathak, and Katerina Fragkiadaki. Aligning Text-to-Image Diffusion Models with Reward Backpropagation . 10 2023. URL https://arxiv.org/abs/2310.03739v1
2023 arXiv
-
[41]
Spontaneous symmetry breaking in generative diffusion models
Gabriel Raya and Luca Ambrogioni. Spontaneous symmetry breaking in generative diffusion models. Advances in Neural Information Processing Systems, 36: 0 66377--66389, 2023
2023
-
[42]
High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bjorn Ommer. High-Resolution Image Synthesis with Latent Diffusion Models . Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2022-June: 0 10674--10685, 12 2021. ...
2022
-
[43]
Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation
Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven generation. In 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, June 2023. d...
2023
-
[44]
Seyedmorteza Sadat, Jakob Buhmann, Derek Bradley, Otmar Hilliges, and Romann M. Weber. CADS: Unleashing the Diversity of Diffusion Models through Condition-Annealed Sampling . In The Twelfth International Conference on Learning Representations, 10 2024. URL https://arxiv.org/a...
2024 arXiv
-
[45]
Facenet: A unified embedding for face recognition and clustering
Florian Schroff, Dmitry Kalenichenko, and James Philbin. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 815--823, 2015
2015
-
[46]
Laion-400m: Open dataset of clip-filtered 400 million image-text pairs, 2021
Christoph Schuhmann, Richard Vencu, Romain Beaumont, Robert Kaczmarczyk, Clayton Mullis, Aarush Katta, Theo Coombes, Jenia Jitsev, and Aran Komatsuzaki. Laion-400m: Open dataset of clip-filtered 400 million image-text pairs, 2021
2021
-
[47]
Laion-5b: An open large-scale dataset for training next generation image-text models
Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, et al. Laion-5b: An open large-scale dataset for training next generation image-text models. Advances in neural informa...
2022
-
[48]
A phase transition in diffusion models reveals the hierarchical nature of data
Antonio Sclocchi, Alessandro Favero, and Matthieu Wyart. A phase transition in diffusion models reveals the hierarchical nature of data. Proceedings of the National Academy of Sciences, 122 0 (1): 0 e2408799121, 2025
2025
-
[49]
Very deep convolutional networks for large-scale image recognition
Karen Simonyan and Andrew Zisserman. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556, 2014
2014 arXiv
-
[50]
Scaling llm test-time compute optimally can be more effective than scaling model parameters
Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. Scaling llm test-time compute optimally can be more effective than scaling model parameters. arXiv preprint arXiv:2408.03314, 2024
2024 arXiv
-
[51]
Measuring Style Similarity in Diffusion Models
Gowthami Somepalli, Anubhav Gupta, Kamal Gupta, Shramay Palta, Micah Goldblum, Jonas Geiping, Abhinav Shrivastava, and Tom Goldstein. Measuring Style Similarity in Diffusion Models . 4 2024. URL https://arxiv.org/abs/2404.01292v1
2024 arXiv
-
[52]
Denoising Diffusion Implicit Models
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising Diffusion Implicit Models . ICLR 2021 - 9th International Conference on Learning Representations, 10 2020. URL https://arxiv.org/abs/2010.02502v4
2021 arXiv
-
[53]
Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song and Stefano Ermon. Generative Modeling by Estimating Gradients of the Data Distribution . Advances in Neural Information Processing Systems, 32, 2019
2019
-
[54]
Going deeper with convolutions
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 1--9, 2015
2015
-
[55]
Understanding Reinforcement Learning-Based Fine-Tuning of Diffusion Models: A Tutorial and Review
Masatoshi Uehara, Yulai Zhao, Tommaso Biancalani, and Sergey Levine. Understanding Reinforcement Learning-Based Fine-Tuning of Diffusion Models: A Tutorial and Review . 7 2024 a . URL https://arxiv.org/abs/2407.13734v1
2024 arXiv
-
[56]
Understanding reinforcement learning-based fine-tuning of diffusion models: A tutorial and review, 2024 b
Masatoshi Uehara, Yulai Zhao, Tommaso Biancalani, and Sergey Levine. Understanding reinforcement learning-based fine-tuning of diffusion models: A tutorial and review, 2024 b
2024
-
[57]
Diffusion Model Alignment Using Direct Preference Optimization
Bram Wallace, Meihua Dang, Rafael Rafailov, Linqi Zhou, Aaron Lou, Senthil Purushwalkam, Stefano Ermon, Caiming Xiong, Shafiq Joty, and Nikhil Naik. Diffusion Model Alignment Using Direct Preference Optimization . 11 2023. URL https://arxiv.org/abs/2311.12908v1
2023 arXiv
-
[58]
Bayesian learning via stochastic gradient Langevin dynamics
Max Welling and Yee W Teh. Bayesian learning via stochastic gradient Langevin dynamics . Proceedings of the 28th international conference on machine learning, 2011. URL https://citeseerx.ist.psu.edu/document?repid=rep1&type=pdf&doi=56f89ce43d7e386bface3cba63e674fe748703fc
2011
-
[59]
Diffusion-based molecule generation with informative prior bridges
Lemeng Wu, Chengyue Gong, Xingchao Liu, Mao Ye, and Qiang Liu. Diffusion-based molecule generation with informative prior bridges. Advances in Neural Information Processing Systems, 35: 0 36533--36545, 2022
2022
-
[60]
Practical and Asymptotically Exact Conditional Sampling in Diffusion Models
Luhuan Wu, Brian L Trippe, Christian A Naesseth, David M Blei, and John P Cunningham. Practical and Asymptotically Exact Conditional Sampling in Diffusion Models . Advances in Neural Information Processing Systems, 36: 0 31372--31403, 12 2023. URL https://github.com/blt2114/tw...
2023
-
[61]
Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models
Yuchen Wu, Minshuo Chen, Zihao Li, Mengdi Wang, and Yuting Wei. Theoretical Insights for Diffusion Guidance: A Case Study for Gaussian Mixture Models . 3 2024. URL https://arxiv.org/abs/2403.01639v1
2024 arXiv
-
[62]
Asymptotics of language model alignment
Joy Qiping Yang, Salman Salamatian, Ziteng Sun, Ananda Theertha Suresh, and Ahmad Beirami. Asymptotics of language model alignment. International Symposium on Information Theory (ISIT), July 2024
2024
-
[63]
FUDGE: Controlled Text Generation With Future Discriminators
Kevin Yang and Dan Klein. FUDGE: Controlled Text Generation With Future Discriminators . NAACL-HLT 2021 - 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, pp.\ 3511--3535...
2021 arXiv
-
[64]
TFG: Unified Training-Free Guidance for Diffusion Models
Haotian Ye, Haowei Lin, Jiaqi Han, Minkai Xu, Sheng Liu, Yitao Liang, Jianzhu Ma, James Zou, and Stefano Ermon. TFG: Unified Training-Free Guidance for Diffusion Models . 9 2024
2024
-
[65]
Improving style transfer with calibrated metrics
Mao-Chuang Yeh, Shuai Tang, Anand Bhattad, Chuhang Zou, and David Forsyth. Improving style transfer with calibrated metrics. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 3160--3168, 2020
2020
-
[66]
Freedom: Training-free energy-guided conditional diffusion model
Jiwen Yu, Yinhuai Wang, Chen Zhao, Bernard Ghanem, and Jian Zhang. Freedom: Training-free energy-guided conditional diffusion model. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 23174--23184, 2023
2023
-
[67]
Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvement , 7 2023
Hui Yuan, Kaixuan Huang, Chengzhuo Ni, Minshuo Chen, and Mengdi Wang. Reward-Directed Conditional Diffusion: Provable Distribution Estimation and Reward Improvement , 7 2023. URL https://arxiv.org/abs/2307.07055v1
2023 arXiv
-
[68]
Joint face detection and alignment using multitask cascaded convolutional networks
Kaipeng Zhang, Zhanpeng Zhang, Zhifeng Li, and Yu Qiao. Joint face detection and alignment using multitask cascaded convolutional networks. IEEE signal processing letters, 23 0 (10): 0 1499--1503, 2016
2016
-
[69]
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding Conditional Control to Text-to-Image Diffusion Models . Proceedings of the IEEE International Conference on Computer Vision, pp.\ 3813--3824, 2 2023. ISSN 15505499. doi:10.1109/ICCV51070.2023.00355. URL https://arxiv.org/abs/...
2023
-
[70]
Denoising diffusion models for plug-and-play image restoration
Yuanzhi Zhu, Kai Zhang, Jingyun Liang, Jiezhang Cao, Bihan Wen, Radu Timofte, and Luc Van Gool. Denoising diffusion models for plug-and-play image restoration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 1219--1229, 2023
2023
-
[71]
@esa (Ref
\@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...
-
[72]
\@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...
-
[73]
A woman sitting in a restaurant with a pizza in front of her
@open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...
2024 arXiv
-
[74]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 9, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.