REVIEW 3 major objections 6 minor 12 references
One-coefficient fix stops CFG oversaturation at zero extra cost
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · glm-5.2
2026-07-09 03:02 UTC pith:VWTBBVMK
load-bearing objection One-coefficient CFG repair derived from a clean terminal-exactness argument on a Gaussian calibration model; theory is solid but only proven on that model, with learned-checkpoint evidence that is suggestive but indirect. the 3 major comments →
Guidance Breaks the Fitted Operator: A Terminal-Fitted Repair for Classifier-Free Guidance
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central object is the guided terminal exponent: on a commuting Gaussian calibration model, CFG re-stiffens the discriminative subspace (directions present in the marginal but collapsed in the class) to contraction exponent 1+w instead of the unguided exponent 1. This exits the class of fitted operators for which the DDIM step is layer-exact, causing a sigma_min-divergent residual blow-up on coarse meshes. The paper proves this is governed by three ordered step-size thresholds (sign preservation, residual amplification, absolute stability) and shows that the coefficient replacement w(r-1) -> r^(1+w) - r is the unique spectrum-free repair that restores terminal exactness, removes the blow-
What carries the argument
The guided terminal exponent mu_w = (1+w)A - wB, where A and B are per-coordinate contraction rates of the conditional and unconditional denoisers on a commuting Gaussian model. The three-threshold guided clock barrier (h_flat, h_sharp, h_infinity) in terms of step size h and guidance weight w. The fitted coefficient r^(1+w) - r, derived by a gauge change that rectifies the anomalous exponent back to 1, then transporting the sigma-clock Euler step through it.
Load-bearing premise
The entire theoretical analysis is carried out on a linear Gaussian model where the class and marginal covariances commute and the class is narrower in every direction. Real neural network checkpoints need not satisfy this, and the paper acknowledges the learned diagnostics are only 'consistent with' but do not verify the model's structural predictions.
What would settle it
If on real learned checkpoints the directional variance ordering between conditional and unconditional denoisers does not follow the class-subset pattern (a_i <= b_i), the exponent-1+w re-stiffening mechanism may not be the operative cause of oversaturation, and the fitted coefficient's improvements could stem from a different effect than the one the theory describes.
If this is right
- Practitioners using high guidance scales (g >= 7.5) can replace one coefficient in their DDIM+CFG sampler to reduce oversaturation and residual amplification at zero additional compute cost, as a drop-in one-line code change.
- The three-threshold barrier provides a parameter-free prediction for the terminal edge of limited-interval guidance schedules, potentially replacing tuned guidance-interval cutoffs with a derived one.
- The finding that oversaturation is a solver artifact (discretization mismatch) rather than a property of the continuous guided law suggests that other guidance pathologies at high w may also have discretization-induced components separable from the continuous-flow distortion.
- The reverse-ordering case (class wider than marginal in some direction) creates a continuous-flow instability at exponent -w that no solver can repair, marking a hard boundary on where any discretization-level fix can help.
Where Pith is reading between the lines
- If the discriminative-subspace re-stiffening mechanism holds on non-Gaussian or non-commuting geometries, the fitted coefficient could serve as a general-purpose terminal stabilizer for any flow-matching or diffusion sampler using CFG, not just DDIM.
- The O(w^2) prefactor in the accuracy bound (not uniform in w) suggests there may be a w-dependent step-count requirement even with the repair, implying an optimal guidance-weight-to-step-count tradeoff curve that the paper does not fully characterize.
- The FID/KID split (fitted wins FID, CFG wins KID) may reflect a fundamental tension between reducing discretization artifacts and preserving the distributional properties that KID measures—worth investigating whether the KID penalty is causally linked to the oversaturation removal or is an independent effect.
- The class-subset hypothesis (class narrower than marginal in every direction) may be approximately testable on real checkpoints by estimating directional variances of conditional vs. unconditional denoisers, which would bridge the gap between the calibration model and the learned-checkpoint diagnostics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper analyzes classifier-free guidance (CFG) through a numerical-analysis lens, building on a prior fitted-operator framework for unguided DDIM. On a commuting Gaussian calibration model (Hypothesis 1), the author shows that guidance re-stiffens the discriminative subspace to an anomalous terminal exponent 1+w, causing DDIM+CFG's terminal residual to diverge as sigma_min → 0 on coarse meshes. A guided clock barrier with three ordered step-size thresholds is proven (Theorem 1), and a one-coefficient, zero-extra-NFE repair—replacing w(r-1) by r^(1+w)-r on the guidance direction—is derived as the unique spectrum-free terminal-exact coefficient (Lemma 2). On the discriminative crossover, this repair removes the sigma_min-divergent blow-up and is first-order accurate against the exact guided flow (Theorem 2, Proposition 4). Empirical diagnostics on learned CIFAR-10 EDM checkpoints and a Stable Diffusion 1.5 smoke test show reduced residual amplification, clipping, and saturation, with 9/9 FID wins over CFG on the tested grid, though KID favors CFG and the dense-reference L2 diagnostic shows the fitted step is not a uniformly better integrator.
Significance. The paper provides a clean, parameter-free derivation of a one-coefficient CFG repair from terminal-exactness on a calibration model, with explicit constants and complete proofs (Appendix A). The barrier thresholds (Theorem 1) yield a falsifiable, parameter-free prediction for the terminal edge of limited-interval guidance (Remark 3). The empirical program is honestly scoped: the author reports the KID split, the dense-reference L2 failure (Appendix H), and the reverse-ordering instability boundary (Remark 4) alongside the positive results. The zero-extra-NFE, one-line implementation delta and the cross-domain SD 1.5 smoke test add practical value. The theory-to-practice gap—between the commuting Gaussian model and learned checkpoints—is the main limitation, and the author is transparent about it.
major comments (3)
- §4, Table 2 and Appendix H: The practical evidence is honestly scoped but the central tension between the theoretical mechanism and the empirical results is underdeveloped. The KID split (CFG wins every block) and the dense-reference L2 diagnostic (Table 5, ratios >1) show the fitted step is not a uniformly better integrator. Meanwhile, the theoretical motivation for the specific coefficient r^(1+w)-r rests on the commuting Gaussian model, and the learned-checkpoint diagnostics (Table 1) are described as 'consistent with' the model ordering without directly verifying that the guided terminal exponent on the discriminative subspace of a learned checkpoint approaches 1+w as sigma → 0 (Proposition 1's prediction). The paper would be substantially strengthened by a direct measurement attempting to estimate the effective terminal exponent on the discriminative subspace of the CIFAR-10 EDM den
- §3, Proposition 4 / Theorem 2: The first-order accuracy result is proven only for a single discriminative coordinate (a=0 < b) on the commuting model. The paper explicitly states: 'Extending this crossover accuracy to the tangential layers and learned geometry needs the spectrum-aware Gaussian factor (6) and is future work.' On the commuting model coordinates decouple, so this is less concerning there, but the gap to the multi-coordinate learned setting is not bridged even at the level of a multi-coordinate Gaussian model where the spectrum-aware factor (6) could be evaluated. A numerical experiment on a multi-coordinate commuting Gaussian (e.g., 2-3 coordinates with different b_i values) showing that the single-coordinate accuracy result does or does not extend would help clarify the scope of the theory.
- §2, Hypothesis 1 and Remark 4: The class-subset hypothesis (a_i ≤ b_i) is a load-bearing assumption, and the reverse ordering (b=0 < a) creates a continuous-flow instability. The paper acknowledges that 'real learned checkpoints need not obey it' but does not provide any diagnostic or argument for why the EDM CIFAR-10 checkpoints used in §4 might satisfy it, or how common the reverse ordering is in practice. Even an indirect argument (e.g., relating the class-subset property to the training setup where the unconditional model is a mixture of class-conditional models) would help readers assess the applicability of the theory.
minor comments (6)
- Figure 1: The caption says 'schematic' but the axes are unlabeled beyond the text annotations. Adding axis labels (e.g., sigma or lambda on the horizontal axis, exponent on the vertical) would improve clarity.
- §3, Eq. (15): The notation r^(1+w) could be confused with r raised to the power (1+w) in typeset form; the paper is consistent but a brief note on first use that this is exponentiation would help.
- Table 1: The 'clip_delta' column is defined as 'fitted CFG minus CFG for the median fraction of final-denoised pixels outside [-1,1]' but the negative values (improvement) are not immediately intuitive; a note that negative means improvement would help.
- §4, Table 3: The target accuracy for fitted CFG at w=8, N=16 jumps to 99.3%, notably higher than CFG's 93.8%. The paper notes 'the high fitted value at N=16 should not be read as fuller conditional fidelity, as it may partly reflect reduced diversity,' but this large jump deserves more discussion or investigation.
- Appendix F: The Stable Diffusion smoke test uses float16, which could introduce numerical artifacts at high guidance. A note on whether this was checked would be useful.
- Reference [12] is by the same author and is the foundational fitted-operator result this paper builds on. This dependency is clearly stated, but the paper could more explicitly delineate what is novel in this work versus [12].
Simulated Author's Rebuttal
We thank the referee for a careful and constructive report. The recommendation is minor revision, and all three major comments are actionable. We agree with the substance of each: (1) the theory-to-practice gap should be bridged by a direct terminal-exponent measurement on learned checkpoints; (2) the single-coordinate accuracy result should be tested on a multi-coordinate Gaussian; and (3) the class-subset hypothesis needs an explicit argument connecting it to the EDM training setup. We commit to all three additions in the revision and explain below what each will contain, including honest accounting of what we can and cannot claim.
read point-by-point responses
-
Referee: The central tension between the theoretical mechanism and the empirical results is underdeveloped. The KID split and dense-reference L2 diagnostic show the fitted step is not a uniformly better integrator. Meanwhile, the theoretical motivation rests on the commuting Gaussian model, and the learned-checkpoint diagnostics are described as 'consistent with' the model ordering without directly verifying that the guided terminal exponent on the discriminative subspace of a learned checkpoint approaches 1+w as sigma → 0 (Proposition 1's prediction). The paper would be substantially strengthened by a direct measurement attempting to estimate the effective terminal exponent on the discriminative subspace of the CIFAR-10 EDM denoiser.
Authors: We agree completely. The gap between 'consistent with the model ordering' and a direct exponent measurement is the weakest link in the current manuscript, and the referee is right that closing it—even partially—would substantially strengthen the paper. We will add a new diagnostic in Section 4 that attempts to estimate the effective terminal exponent on the discriminative subspace of the EDM CIFAR-10 checkpoints. Concretely: along sampling trajectories at high guidance (w=6.5, 8), we will compute the local contraction ratio of the guidance direction (D_u - D_c) across consecutive steps in the small-sigma regime and fit a power-law exponent in sigma. The commuting model predicts this exponent should approach 1+w on discriminative directions; we will report whatever the data shows, including if the exponent does not cleanly approach 1+w. We are honest that this is an indirect measurement: the learned denoiser's Jacobian does not diagonalize into clean eigen-coordinates, so we are measuring an effective exponent on a projected subspace, not verifying Proposition 1 literally. We will state this limitation explicitly. If the measurement is inconclusive or contradicts the prediction, we will say so rather than cherry-pick. We believe this is feasible with the existing checkpoints and sampling infrastructure, and we commit to including it in the revision. revision: yes
-
Referee: The first-order accuracy result (Theorem 2) is proven only for a single discriminative coordinate (a=0 < b) on the commuting model. The gap to the multi-coordinate learned setting is not bridged even at the level of a multi-coordinate Gaussian model where the spectrum-aware factor (6) could be evaluated. A numerical experiment on a multi-coordinate commuting Gaussian (e.g., 2-3 coordinates with different b_i values) showing that the single-coordinate accuracy result does or does not extend would help clarify the scope of the theory.
Authors: This is a fair and concrete suggestion. On the commuting model, coordinates decouple, so the single-coordinate accuracy result (Theorem 2) extends component-wise to any number of coordinates with different b_i values—the log-defect bound applies independently per coordinate and the W_2 bound sums. However, the referee's point is deeper: the practical question is whether the spectrum-free coefficient r^(1+w) - r, which is exact only on the pure discriminative terminal layer (A=1, B=0), remains accurate when different coordinates are at different points in their crossovers (different b_i values, hence different B_i at a given sigma). The honest answer is that it does not remain uniformly accurate in that regime—the spectrum-aware factor (6) would be needed for exactness, and the fitted step pays a finite O(1+w) crossover tax per coordinate (Proposition 4). We will add a numerical experiment on a 3-coordinate commuting Gaussian with distinct b_i values, showing the per-coordinate accuracy and the aggregate W_2 error as sigma_min → 0, on both uniform and non-uniform meshes. This will make the scope of Theorem 2 precise: the single-coordinate bound extends by independence, but the practical accuracy depends on how many coordinates are mid-crossover at the terminal steps, which is a mesh- and spectrum-dependent question the theory does not fully resolve. revision: yes
-
Referee: The class-subset hypothesis (a_i ≤ b_i) is a load-bearing assumption, and the reverse ordering (b=0 < a) creates a continuous-flow instability. The paper acknowledges that 'real learned checkpoints need not obey it' but does not provide any diagnostic or argument for why the EDM CIFAR-10 checkpoints used in §4 might satisfy it, or how common the reverse ordering is in practice. Even an indirect argument (e.g., relating the class-subset property to the training setup where the unconditional model is a mixture of class-conditional models) would help readers assess the applicability of the theory.
Authors: The referee is right that we left this hanging. We will add an explicit argument and a diagnostic. The argument: in the EDM CIFAR-10 setup, the unconditional model is trained on the full data distribution (a mixture over all classes), while each class-conditional model is trained on a single class. Under a Gaussian approximation, the marginal covariance C_u is the mixture covariance E[C_c | class] + Cov(mean_c), which is at least as large as any single class covariance C_c in the PSD order—this is the class-subset property a_i ≤ b_i at the population level. The reverse ordering (class wider than marginal in some direction) would require a class whose covariance exceeds the mixture covariance in some eigen-direction, which is possible for atypical classes but structurally disfavored by the mixture construction. We will state this argument in Section 2 and add a diagnostic in Section 4: we will estimate the effective class and marginal variances along the guidance direction (D_u - D_c) at small sigma for the EDM checkpoints and check whether the ordering holds in practice. If some classes show reverse ordering, we will report that honestly and note that the theory's applicability is partial. We cannot fully verify the hypothesis on learned checkpoints (the Jacobian structure is not Gaussian), but the indirect argument plus the diagnostic gives readers a concrete basis to assess applicability. revision: yes
Circularity Check
Central derivation is parameter-free and self-contained; one load-bearing self-citation establishes the unguided framework but is not itself the target result.
specific steps
-
self citation load bearing
[Section 2, paragraph 'The unguided flow'; Section 1, paragraph 'Guidance re-stiffens the discriminative subspace']
"A fitted-operator analysis of the unguided terminal layer [12] shows that a frozen-field Euler step is layer-exact if and only if its clock is affine in σ, making the σ-clock step—algebraically the deterministic DDIM update [11]—the unique fitted operator up to affine reparameterization... The present paper asks what survives of that protection under guidance."
Reference [12] (same author, arXiv:2607.04113) establishes the unguided fitted-operator framework: DDIM is the unique layer-exact frozen-field Euler step on the terminal layer. The present paper builds on this to analyze guidance. However, the self-citation is not circular in the target-result sense: [12] proves a result about the UNGUIDED flow (exponent 1, DDIM exactness), while the present paper's central contribution is about the GUIDED flow (exponent 1+w, the coefficient r^(1+w)-r). The guided exponent (Proposition 1, Eq. 5) and the fitted coefficient (Lemma 2) are derived from scratch within this paper from the guided flow equation (2) and the commuting Gaussian model (Hypothesis 1), not imported from [12]. The self-citation provides scaffolding (the fitted-operator concept, the σ-aff
full rationale
The paper's central derivation is parameter-free and self-contained. The coefficient r^(1+w)-r is derived in Lemma 2 by requiring terminal exactness on the pure discriminative layer (A=1, B=0): the exact factor is r^(1+w) (Lemma 1, Eq. 7), the scalar update gives factor r+α, and exactness forces α = r^(1+w)-r. This is a direct algebraic derivation from the model, not a fit to data. The barrier thresholds (Theorem 1) follow analytically from the elementary function G_w(h) = (1+w)e^{-h} - w. Proposition 4's bounded amplification and Theorem 2's first-order accuracy are proven from the exact factor (Lemma 1) and the fitted factor (Proposition 3) without fitting. The one load-bearing self-citation is to [12] (same author), which establishes the unguided fitted-operator framework. This is a dependency on prior work for scaffolding, but [12]'s result concerns the unguided flow (exponent 1, DDIM exactness), while the present paper's target result concerns the guided flow (exponent 1+w, the new coefficient). The guided exponent and the fitted coefficient are derived within this paper from the guided flow equation and the commuting model, not imported from [12]. The self-citation is real but not circular: it provides the conceptual framework, not the target result. Score 2: one minor self-citation that is not load-bearing for the paper's central claim.
Axiom & Free-Parameter Ledger
free parameters (1)
- w (guidance weight) =
set by practitioner (e.g., 6.5, 8.0)
axioms (4)
- domain assumption Hypothesis 1: Commuting class-marginal pair with a_i ≤ b_i (class-subset hypothesis)
- domain assumption Variance-exploding (VE) family: p_sigma = p_data * N(0, sigma^2 I)
- ad hoc to paper The unguided DDIM step is the unique fitted operator for the terminal layer (from [12])
- standard math D_w is not a VE posterior mean with PSD Tweedie covariance
read the original abstract
Classifier-free guidance (CFG) is the standard way to strengthen class-conditioning in diffusion and flow-matching samplers, yet at large guidance it oversaturates and destabilizes, symptoms practitioners suppress with more steps or limited-interval schedules. We analyze CFG through an asymptotic-preserving, numerical-analysis lens. Building on a recent result that the deterministic DDIM step is the unique fitted operator for the unguided terminal layer, exact on the final small-sigma stretch of sampling, we show that guidance re-stiffens exactly the discriminative subspace to an anomalous exponent 1+w. DDIM is therefore no longer fitted there, and on coarse meshes its guided residual diverges as sigma_min goes to zero. We prove a guided clock barrier with three ordered step-size thresholds, and read one-step oversaturation as its endpoint: a solver artifact on the calibration model rather than the continuous guided law. The same analysis yields a one-coefficient, zero-extra-NFE repair: replace CFG's w(r-1) by r^(1+w)-r on the guidance direction. On the calibration model's discriminative crossover, this removes CFG's sigma_min-divergent blow-up and is first-order accurate against the exact guided flow as sigma_min goes to zero. On learned CIFAR-10 checkpoints, and as a cross-domain smoke test on Stable Diffusion 1.5 DDIM, it acts as a high-guidance stabilizer at no extra cost rather than a universal quality knob: it cuts residual amplification and saturation, gives 9/9 point-FID wins over CFG on the tested grid, and preserves classifier-proxy target accuracy in the hard-cell blocks. We report the limits alongside: it is not a universal image-quality win, and against a dense vanilla-CFG reference it is not a uniformly better integrator of that field.
Figures
Reference graph
Works this paper leans on
-
[1]
Classifier-Free Guidance is a Predictor-Corrector
Arwen Bradley and Preetum Nakkiran. Classifier-free guidance is a predictor-corrector.Trans- actions on Machine Learning Research (TMLR), 2025. arXiv:2408.09000
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[2]
What does guidance do? A fine-grained analysis in a simple setting
Muthu Chidambaram, Khashayar Gatmiry, Sitan Chen, Holden Lee, and Jianfeng Lu. What does guidance do? a fine-grained analysis in a simple setting. InAdvances in Neural Informa- tion Processing Systems (NeurIPS), 2024. arXiv:2409.13074
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[3]
CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Models
Hyungjin Chung, Jeongsol Kim, Geon Yeong Park, Hyelin Nam, and Jong Chul Ye. CFG++: Manifold-constrained classifier free guidance for diffusion models. InInternational Confer- ence on Learning Representations (ICLR), 2025. arXiv:2406.08070
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[4]
Bradley Efron. Tweedie’s formula and selection bias.Journal of the American Statistical Association, 106(496):1602–1614, 2011
work page 2011
-
[5]
CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Models
Weichen Fan, Amber Yijia Zheng, Raymond A. Yeh, and Ziwei Liu. CFG-Zero*: Improved classifier-free guidance for flow matching models.arXiv preprint arXiv:2503.18886, 2025
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[6]
C$^2$FG: Control Classifier-Free Guidance via Score Discrepancy Analysis
Jiayang Gao, Tianyi Zheng, Jiayang Zou, Fengxiang Yang, Shice Liu, Luyao Fan, Zheyu Zhang, Hao Zhang, Jinwei Chen, Peng-Tao Jiang, Bo Li, and Jia Wang. C 2FG: Control classifier-free guidance via score discrepancy analysis. InProceedings of the IEEE/CVF 10 Conference on Computer Vision and Pattern Recognition (CVPR), pp. 34398–34407, 2026. arXiv:2603.08155
work page internal anchor Pith review Pith/arXiv arXiv 2026
-
[7]
Classifier-Free Diffusion Guidance
Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022
work page internal anchor Pith review Pith/arXiv arXiv 2022
-
[8]
Elucidating the design space of diffusion-based generative models
Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. InAdvances in Neural Information Processing Systems (NeurIPS), 2022
work page 2022
-
[9]
Applying Guidance in a Limited Interval Improves Sample and Distribution Quality in Diffusion Models
Tuomas Kynk ¨a¨anniemi, Miika Aittala, Tero Karras, Samuli Laine, Timo Aila, and Jaakko Lehtinen. Applying guidance in a limited interval improves sample and distribution quality in diffusion models. InAdvances in Neural Information Processing Systems (NeurIPS), 2024. arXiv:2404.07724
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[10]
Seyedmorteza Sadat, Otmar Hilliges, and Romann M. Weber. Eliminating oversaturation and artifacts of high guidance scales in diffusion models. InInternational Conference on Learning Representations (ICLR), 2025. arXiv:2410.02416
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[11]
Denoising diffusion implicit models
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. In International Conference on Learning Representations (ICLR), 2021
work page 2021
-
[12]
Asymptotic-Preserving A Posteriori Analysis of Diffusion and Flow-Matching Samplers
Shiheng Zhang. Asymptotic-preserving a posteriori analysis of diffusion and flow-matching samplers.arXiv preprint arXiv:2607.04113, 2026. A DEFERRED PROOFS Proof of Proposition 1.Fora= 0one hasA≡1, soµ w = (1 +w)−wB= 1 +w(1−B) = 1+wb/(b+σ 2); the limits and monotonicity are immediate. Cases (i) and (ii) follow fromA, B→1 andA, B→0respectively. Proof of Le...
work page internal anchor Pith review Pith/arXiv arXiv 2026
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.