Pith. sign in

REVIEW 4 major objections 5 minor 59 references

BAG: Budget-Aware Gating for Diffusion Caching

T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A learned gate with under 1,000 parameters decides per denoising step whether to recompute or reuse cached features, and this paper shows it improves all three reconstruction metrics over static and heuristic schedulers at matched compute…

desk verdict A solid empirical method paper that delivers a practical 2-5x caching speedup with a tiny learned gate, but the distillation story would be stronger with a direct gate-vs-oracle comparison. read the letter →

arxiv 2608.09231 v1 pith:5NVAWUFJ submitted 2026-08-10 cs.CV

Tong Zhao , Mingkun Lei , Yucheng Han , Chi Zhang This is my paper · ORCID
classification cs.CV
keywords diffusioncachingbudget-awareschedulingtransformeraccelerationlearnedgatingscheduledistillationfeaturereuseimageandvideogenerationcache
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Diffusion caching speeds up image and video generation by reusing intermediate features across denoising steps instead of running the full network every time. Existing caching policies are either online heuristics, which react to the current trajectory but ignore how much budget remains, or static schedules, which meet the budget exactly but apply the same plan to every prompt. This paper claims that both lose quality compared with per-prompt searched schedules, and that the loss can be recovered by a learned gate of under 1,000 parameters. The gate takes six scalar signals—three budget indicators and three trajectory indicators—and decides at each step whether to compute or reuse, spending exactly the requested number of function evaluations by construction. On held-out prompts from an image and a video diffusion transformer, the paper reports that this single gate per backbone improves PSNR, SSIM, and LPIPS over the strongest baselines at every tested budget tier.

What carries the argument

The load-bearing object is the gate $g_\theta$, an MLP with under 1K parameters that outputs a compute-or-reuse decision from six scalar features: budget state $[B/T,\ (B-c_t)/B,\ (B-c_t)/(T-t)]$ and trajectory state $[t-t_{\mathrm{last}},\ \lVert x_t-x_{t_{\mathrm{last}}} \rVert / \lVert x_{t_{\mathrm{last}}} \rVert,\ \lVert x_t-x_{t-1} \rVert / \lVert x_{t-1} \rVert]$, where $B$ is the budget, $T$ the total steps, $c_t$ evaluations spent, and $x_t$ the post-patch-embedding token tensor. These features are exactly the two contexts prior paradigms each lack: global budget pacing and local rollout feedback. The gate is trained by offline-to-online schedule distillation: a matched-NFE search minimizes LPIPS over masks with exactly $B$ ones, its rollouts supply labeled per-step states, and a class-balanced BCE loss fits the gate in about a minute. At deployment, boundary rules—compute the remainder when budget equals remaining steps, reuse when budget is exhausted—make the realized NFE exactly $B$ without prescribing where the evaluations go.

What would settle it

Take a held-out prompt, run the paper's search to obtain the best schedule for a budget, then run the gate at that budget; if the gate's reconstruction is farther from the full-compute output than the searched schedule is, the distillation has lost information.

Watch

Extended reading notes

Core claim

The central claim is that one budget-aware, trajectory-conditioned gating network can reproduce most of the benefit of expensive per-prompt schedule search at runtime. For training prompts and budgets, the authors run a matched-NFE offline search that minimizes LPIPS distance to the full-compute output over binary cache masks with exactly $B$ evaluations, then decompose the searched rollouts into per-step examples. A small MLP is trained with binary cross-entropy to map the six-feature state to the search's compute-or-reuse decision. At inference, the same frozen gate makes closed-loop decisions on unseen prompts, with boundary rules that force the realized NFE to equal $B$. The paper reports that at every tested budget on FLUX.1-dev and Wan2.1, this gate improves all three reconstruction metrics over the strongest baseline using the same or fewer evaluations, with PSNR gains up to about 2.6 dB, and stays ahead under changed seeds, resolutions, guidance scales, and 25- or 28-step samplers.

Load-bearing premise

The load-bearing premise is that the offline search over compute-or-reuse patterns on the training prompts finds schedules good enough to supervise the gate, and that six hand-picked scalar signals can express what makes those schedules good; if either fails on unseen prompts and budgets, the gate inherits the search's blind spots or cannot represent the searched policy.

Editorial extensions

If this is right

  • One checkpoint per backbone serves every tested budget and step count; the same gate produced all reported BAG numbers without retraining or re-search.
  • The budget is a runtime input, so an operator can set the speedup directly and the gate will spend exactly that many evaluations, eliminating threshold sweeps.
  • Because BAG changes only the schedule, it can be combined with orthogonal accelerators such as fast ODE solvers or mechanism-level feature reuse.
  • The reported robustness to seed, resolution, guidance, and 25/28-step samplers means the trained gate transfers beyond its training configuration.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A testable extension the paper does not run: train one gate on a small backbone family and check whether it transfers to a larger DiT without retraining.
  • Because the search objective is a free choice, the same distillation pipeline could be aimed at human-preference scores; the paper's own HPSv2 variant already points this way.
  • The paper acknowledges an off-policy state-distribution shift; on-policy relabeling in the style it cites is the obvious next step and would clarify how much headroom remains.
  • The budget features are all ratio-scaled, so the gate may generalize to arbitrary step counts and budgets; only a few out-of-range points are tested, so this is an inference, not a claim.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes BAG, a budget-aware gating policy for diffusion transformer caching. An offline matched-NFE local search over cache masks (Eq. 2) generates reference schedules for each training prompt and budget; the per-step decisions of those schedules are distilled into a sub-1K-parameter MLP that reads six scalar budget and trajectory features (Eq. 3) and outputs a binary compute-or-reuse decision (Eq. 4). At inference the frozen gate runs closed-loop inside the sampler, with two deterministic boundary rules in Algorithm 2 guaranteeing that the realized NFE equals the requested budget. Experiments on FLUX.1-dev and Wan2.1 report consistent PSNR/SSIM/LPIPS improvements over TeaCache, MagCache, SeaCache, TaylorSeer, BudCache, and naive step reduction at matched or lower NFE, using one gate per backbone across multiple budgets and across shifts in step count, seed, resolution, and guidance.

Significance. If the results hold, BAG is a practically useful and well-engineered advance: the deployed policy is budget-exact by construction, instance-adaptive through trajectory feedback, and tiny (449–785 parameters), and one checkpoint per backbone serves many budgets. The protocol is unusually careful in several respects: evaluation is on held-out prompts (GenEval→DrawBench, VBench splits with overlap filtering), baseline thresholds are swept on the test set (which favors the baselines), BudCache is run under both its official protocol and a variant using the authors' search, and ablations in Tab. 3 and Tab. A5 show that both halves of the state matter. Tab. A6 is a strong control, showing that the budget-conditioned gate rather than the specific feature set is the key ingredient. The main weakness is that the mechanistic claim of 'learning the scheduler, not the schedule' is never tested against its own offline oracle: the paper validates the search (Fig. 2) and the final gate (Tabs. 1–2) but not the transfer between them. Main-table uncertainty is also unreported, with significance tests limited to SeaCache.

major comments (4)
  1. [§3.2, §4.3; Eqs. (2)–(4)] The paper's central claim is that offline-searched schedules are distilled into a compact online gate, but no experiment compares the deployed gate with the searched reference on the same held-out prompts at the same budget. The off-policy state-distribution shift is explicitly acknowledged in App. A.2 ('distillation incurs an off-policy state-distribution shift') and in App. E, yet its effect is never quantified; the gains in Tabs. 1–2 could in principle be driven largely by the deterministic budget-exact boundary rules of Algorithm 2 rather than by successful transfer of the searched policy. Please report, for the held-out DrawBench/VBench prompts at each budget, the gate's per-prompt LPIPS (and ideally the agreement rate between gate decisions and reference mask) against the reference schedule, e.g., a scatter plot analogous to Fig. 2, together with the realized-NFE distribution. This is the direct evidence needed for the 'learning the scheduler, not the schedule' claim.
  2. [§4.1, Tabs. 1–2, Tab. A2] The main tables report a single run per cell with no error bars or per-prompt variance, so the claim that BAG 'consistently outperforms' all baselines on all three metrics is supported only by point estimates. The paired Wilcoxon tests in Tab. A2 are against SeaCache only, and several margins are small (e.g., FLUX B=20 LPIPS 0.0835→0.0773, Wan B=24 SSIM 0.943→0.947). Per-prompt difference distributions or bootstrap intervals for the runner-up at each tier are needed to establish that the ranking is not noise; this matters especially for the looser tiers where the paper itself notes the gains are not significant on the perceptual metrics.
  3. [Eq. (2), Tabs. 1–2] The offline search in Eq. (2) minimizes LPIPS, and LPIPS is one of the three headline metrics in the main tables, so part of the LPIPS gain is inherited from the search objective and the comparison on that metric is partly circular. PSNR and SSIM gains provide independent corroboration, and the paper should state this explicitly in the main text, or report the LPIPS improvement of the searched reference itself on held-out prompts (Fig. 2 currently shows only aggregate comparisons against one baseline per backbone) so the reader can separate objective-match effects from policy-transfer effects.
  4. [§3.2, Eq. (3), Tab. A6] The six hand-picked features are shown to be necessary (Tab. 3, Tab. A5) but not sufficient to express the reference policy; Tab. A6 shows that SeaCache's own signals fed through the BAG gate recover most of the gain, which is reassuring, but the expressiveness loss of the specific feature set relative to the searched oracle is still unmeasured. In the requested oracle-versus-gate comparison, please also report the per-step agreement and the per-prompt quality gap, which would quantify how much of the reference policy is lost by the six-scalar state representation.
minor comments (5)
  1. [§3.2, Eq. (3)] The 'post-patch-embedding token tensor' used for the trajectory features should be specified precisely (which block or layer, whether the conditional or unconditional branch is used under CFG, and how the norm is computed) so that the six features are exactly reproducible.
  2. [§4.1] The resolution formatting '1024 2' should read '1024×1024'; the same rendering artifact may affect other dimensions in the supplementary material.
  3. [App. B] The statement that 'SeaCache's δ=0.6 spends 26% of the steps at T=50 but 40% at T=25' should clarify whether this refers to a particular prompt set or to the average over the evaluation prompts, since Tab. 5 keeps δ=0.6 and lists different realized NFEs for the 25-step sampler.
  4. [References] There are minor formatting issues in the bibliography, such as 'PmLR' in [33], lowercase 'science' in [17], and inconsistent arXiv/venue formatting; these should be normalized.
  5. [Algorithm 2] The two boundary rules in lines 6–7 are correct because T−t>0 at t<T, but adding a one-line comment explaining why they cannot conflict would help readers verify the budget-exactness guarantee.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the gate is a learned policy trained from offline-searched labels and evaluated on held-out prompts; the budget-exactness is a counting constraint, and no headline metric reduces to a fitted parameter.

full rationale

I walked the derivation chain: Eq. (2) searches reference schedules that minimize LPIPS per (prompt, budget) cell; Eq. (4) trains a sub-1K-parameter gate by per-step BCE against those searched decisions; Algorithm 2 deploys the frozen gate with count-exact boundary rules. The headline tables measure PSNR/SSIM/LPIPS against same-seed full-compute outputs on held-out prompt sets (GenEval to DrawBench on FLUX; a disjoint VBench split on Wan), and the evaluation includes budgets not seen in training on FLUX (B=9, B=20) and on Wan (B=19). No equation in the paper defines a reported result in terms of the trained gate's own parameters or in terms of the evaluation metrics: the gate's decisions are not derived from the metric values, and the exact-NFE property is a forced counting rule, not a predicted quantity. The self-citations (BudCache as a baseline, DAgger as future work) are not load-bearing; BudCache is re-run under both its official protocol and the authors' search, with official numbers reported in App. B. The one legitimate closeness concern is that the offline search objective is LPIPS, the same perceptual metric used in the main evaluation, so part of the LPIPS gain is inherited from the label generation procedure rather than independently predicted. The paper discloses this trade-off, and on held-out prompts the gate must generalize searched decisions, which is an objective-alignment choice rather than a circular reduction. The absence of a direct oracle-versus-gate comparison on held-out prompts is a validation gap, not circularity. The paper is self-contained against external benchmarks, so the fair finding is no significant circularity.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The central claim rests on no invented physical or mathematical entities. The free parameters are the learned gate weights, the decision cutoff, and the offline search effort, all disclosed. The main assumptions are about search quality, feature sufficiency, evaluation objective, and cross-prompt generalization. None of these is circular by construction, but the LPIPS label/evaluation overlap is the closest thing to a fitted objective.

free parameters (3)
  • Gate parameters (FLUX 449, Wan 785) = 449 (FLUX), 785 (Wan)
    The decision rule itself is learned by supervised classification on reference decisions; there is no closed-form justification for these weights.
  • Inference cutoff tau = 0.5
    Chosen in advance as the default decision threshold. A sensitivity sweep shows LPIPS is lowest at the default among tested values, but the cutoff still influences which steps are computed.
  • Offline search effort per (prompt, budget) cell = about 450 rollouts on FLUX, about 100 on Wan
    Chosen as a compute budget for reference search; the paper shows cutting search time degrades quality gracefully, so the number is a hand-set cost-quality knob.
assumptions (4)
  • ad hoc to paper The matched-NFE local search in Eq. (2) approximates the true best schedule well enough to serve as training label.
    If the search returns poor or biased schedules, distillation inherits the bias. The paper checks reference quality against baselines but provides no proof of search optimality.
  • ad hoc to paper The six scalar features in Eq. (3), budget ratios and feature-drift norms, capture the state relevant to compute-or-reuse decisions.
    Ablations show both halves of the state matter, but there is no guarantee that other signals would not perform better; the feature set is a design choice.
  • domain assumption LPIPS distance to the same-seed full-compute output is the right objective for schedule quality.
    Reconstruction fidelity is one valid goal for caching, but preference metrics can disagree; the authors show BAG-R for preference, confirming the objective is a choice rather than a universal target.
  • domain assumption A gate trained on 96 GenEval prompts (FLUX) or 50 VBench prompts (Wan) generalizes to disjoint test prompts.
    Held-out evaluation supports this empirically, but there is no theoretical guarantee, and the Wan gate is trained without a validation split due to the small label set.

how reviews work

0 comments
Cite this review

Pith. "Pith review of BAG: Budget-Aware Gating for Diffusion Caching." pith.science (2026). https://pith.science/paper/5NVAWUFJ

@misc{pith2026260809231,
  author       = {Pith},
  title        = {Pith review of: BAG: Budget-Aware Gating for Diffusion Caching},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5NVAWUFJ}},
  note         = {Machine review of arXiv:2608.09231}
}
read the original abstract

Diffusion caching is a lightweight strategy that accelerates Diffusion Transformers (DiTs) by reusing intermediate features across denoising steps, but existing paradigms face a fundamental trade-off: online heuristics lack global budget awareness, whereas static schedules lack instance adaptivity and fail to flexibly adapt to varying runtime budget constraints. To bridge this gap, we present BAG (Budget-Aware Gating), a novel caching policy that unifies global budget pacing with dynamic, instance-adaptive feature reuse. Rather than relying on hand-crafted rules, BAG employs a lightweight gating network that dynamically decides whether to execute a full computation or reuse cached features at each step by jointly conditioning on the budget state and local trajectory feedback. We train this policy via offline-to-online schedule distillation, transferring the decision-making of offline-searched schedules into a compact online gate. Extensive experiments on FLUX.1-dev and Wan2.1 demonstrate that BAG consistently outperforms state-of-the-art caching methods across various speedup tiers while remaining robust across different resolutions, seeds, and guidance scales. Code will be released.

Figures

Figures reproduced from arXiv: 2608.09231 by the authors.

Figure 1
Figure 1. BAG overview: learn the scheduler, not the schedule. Among the compared scheduling paradigms, BAG deploys the only per-step rule that reads both the remaining budget and the realized trajectory. (1) Search (training only, once per backbone): for each (prompt, budget) cell, a matched-NFE search produces a reference schedule: a full-horizon allocation of exactly B evaluations, optimized to preserve the full￾compute ou… view at source ↗
Figure 2
Figure 2. Both paradigms are suboptimal per prompt at matched NFE. (a) FLUX.1-dev, 100 prompts at three budgets: per-prompt re￾construction LPIPS of the searched schedule vs. MagCache at the same NFE; points below the dashed line favor the searched schedule. (b) Wan2.1, 50 prompts: against SeaCache, the mean LPIPS to the full-compute output drops by 22–32% (ticks: 90th percentile). At a given budget the deployed allocation is… view at source ↗
Figure 3
Figure 3. Qualitative results on FLUX.1-dev at the ∼5× (B=9) and ∼2.4× (B=20) tiers, with the 50-step original leftmost. At matched compute the accelerated baselines drift in composition and object identity, while BAG stays closer to the full-compute output. More qualitative results in App. D [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Qualitative results on Wan2.1 at the ∼3.4× tier (B=15, six frames). At matched NFE BAG follows the full-compute motion (the horse’s gait, the locomotive’s smoke) while SeaCache blurs fast motion and drifts. More qualitative results in App. D. Cache [30], SeaCache [7] (…
Figure 5
Figure 5. Figure 5: One BAG checkpoint across the budget range vs. naive step reduction (two of the 50 sweep prompts; the full sweep is in Figs. A2 and A3, metrics over all 50 in Tab. A8). Leftmost: the same-seed 50-step full-compute output. Columns run from NFE 24 down to 10; per case, t…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

59 extracted references · 42 canonical work pages

  1. [1]

    Princeton University Press, 2018

    Emile Aarts and Jan Karel Lenstra.Local search in combina- torial optimization. Princeton University Press, 2018. 1

    work page 2018

  2. [2]

    ReCache: Learning Budget-Aware Caching Schedules for Diffusion Models via REINFORCE

    Mishan Aliev, Eva Neudachina, Ilya Bykov, Aleksandr Oganov, Kirill Struminsky, Aibek Alanov, and Denis Rakitin. ReCache: Learning budget-aware caching schedules for diffusion models via REINFORCE.arXiv preprint arXiv:2606.06060, 2026. 3

    work page Pith review arXiv 2026

  3. [3]

    DiCache: Let dif- fusion model determine its own cache.arXiv preprint arXiv:2508.17356, 2025

    Jiazi Bu, Pengyang Ling, Yujie Zhou, Yibin Wang, Yuhang Zang, Dahua Lin, and Jiaqi Wang. DiCache: Let dif- fusion model determine its own cache.arXiv preprint arXiv:2508.17356, 2025. 3

    arXiv 2025

  4. [4]

    Z-Image: An efficient image generation foundation model with single-stream diffusion transformer

    Huanqia Cai, Sihan Cao, Ruoyi Du, Peng Gao, Aiming Hao, Steven Hoi, Zhaohui Hou, Shijie Huang, Dengyang Jiang, Yuming Jiang, et al. Z-Image: An efficient image generation foundation model with single-stream diffusion transformer. arXiv preprint arXiv:2511.22699, 2025. 1

    arXiv 2025

  5. [5]

    Q-DiT: Accurate post- training quantization for diffusion transformers

    Lei Chen, Yuan Meng, Chen Tang, Xinzhu Ma, Jingyan Jiang, Xin Wang, Zhi Wang, and Wenwu Zhu. Q-DiT: Accurate post- training quantization for diffusion transformers. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 28306–28315, 2025. 1, 3

    work page 2025

  6. [6]

    Pengtao Chen, Mingzhu Shen, Peng Ye, Jianjian Cao, Chongjun Tu, Christos-Savvas Bouganis, Yiren Zhao, and Tao Chen.δ-DiT: A training-free acceleration method tailored for diffusion transformers.arXiv preprint arXiv:2406.01125,

    arXiv

  7. [7]

    SeaCache: Spectral-evolution-aware cache for acceler- ating diffusion models

    Jiwoo Chung, Sangeek Hyun, MinKyu Lee, Byeongju Han, Geonho Cha, Dongyoon Wee, Youngjun Hong, and Jae-Pil Heo. SeaCache: Spectral-evolution-aware cache for acceler- ating diffusion models. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition (CVPR), pages 14283–14294, 2026. 1, 3, 4, 6, 12

    work page 2026

  8. [8]

    Denoising as path planning: Training-free acceleration of diffu- sion models with DPCache.arXiv preprint arXiv:2602.22654,

    Bowen Cui, Yuanbin Wang, Huajiang Xu, Biaolong Chen, Aixi Zhang, Hao Jiang, Zhengzheng Jin, Xu Liu, and Pipei Huang. Denoising as path planning: Training-free acceleration of diffu- sion models with DPCache.arXiv preprint arXiv:2602.22654,

    arXiv

Show all 59 references
  1. [9]

    LeMiCa: Lex- icographic minimax path caching for efficient diffusion-based video generation.arXiv preprint arXiv:2511.00090, 2025

    Huanlin Gao, Ping Chen, Fuyuan Shi, Chao Tan, Zhaoxiang Liu, Fang Zhao, Kai Wang, and Shiguo Lian. LeMiCa: Lex- icographic minimax path caching for efficient diffusion-based video generation.arXiv preprint arXiv:2511.00090, 2025

    2025

  2. [10]

    MeanCache: From instantaneous to average veloc- ity for accelerating flow matching inference.arXiv preprint arXiv:2601.19961, 2026

    Huanlin Gao, Ping Chen, Fuyuan Shi, Ruijia Wu, Li YanTao, Qiang Hui, Yuren You, Ting Lu, Chao Tan, Shaoan Zhao, et al. MeanCache: From instantaneous to average veloc- ity for accelerating flow matching inference.arXiv preprint arXiv:2601.19961, 2026. 3

    2026

  3. [11]

    GenEval: An object-focused framework for evaluating text-to- image alignment.Advances in Neural Information Processing Systems, 36:52132–52152, 2023

    Dhruba Ghosh, Hannaneh Hajishirzi, and Ludwig Schmidt. GenEval: An object-focused framework for evaluating text-to- image alignment.Advances in Neural Information Processing Systems, 36:52132–52152, 2023. 5

    2023

  4. [12]

    SenCache: Acceler- ating diffusion model inference via sensitivity-aware caching

    Yasaman Haghighi and Alexandre Alahi. SenCache: Acceler- ating diffusion model inference via sensitivity-aware caching. arXiv preprint arXiv:2602.24208, 2026. 3

    2026

  5. [13]

    Denoising diffusion probabilistic models.Advances in neural information process- ing systems, 33:6840–6851, 2020

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models.Advances in neural information process- ing systems, 33:6840–6851, 2020. 1

    2020

  6. [14]

    VBench: Comprehensive bench- mark suite for video generative models

    Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, et al. VBench: Comprehensive bench- mark suite for video generative models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pa...

    2024

  7. [15]

    PromptTea: Let prompts tell TeaCache the optimal threshold.arXiv preprint arXiv:2507.06739, 2025

    Zishen Huang, Chunyu Yang, and Mengyuan Ren. PromptTea: Let prompts tell TeaCache the optimal threshold.arXiv preprint arXiv:2507.06739, 2025. 3

    2025 arXiv

  8. [16]

    Adaptive caching for faster video generation with diffusion transformers

    Kumara Kahatapitiya, Haozhe Liu, Sen He, Ding Liu, Menglin Jia, Chenyang Zhang, Michael S Ryoo, and Tian Xie. Adaptive caching for faster video generation with diffusion transformers. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 15240–15252,...

    2025

  9. [17]

    Opti- mization by simulated annealing.science, 220(4598):671–680,

    Scott Kirkpatrick, C Daniel Gelatt Jr, and Mario P Vecchi. Opti- mization by simulated annealing.science, 220(4598):671–680,

  10. [18]

    HunyuanVideo: A systematic framework for large video generative models.arXiv preprint arXiv:2412.03603, 2024

    Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, et al. HunyuanVideo: A systematic framework for large video generative models.arXiv preprint arXiv:2412.03603, 2024. 1

    2024 arXiv

  11. [19]

    FLUX.https://github.com/ black-forest-labs/flux, 2024

    Black Forest Labs. FLUX.https://github.com/ black-forest-labs/flux, 2024. 1, 3, 5, 12

    2024

  12. [20]

    Budget-constrained step-level diffusion caching

    Mingkun Lei, Tong Zhao, Liangyu Yuan, and Chi Zhang. Budget-constrained step-level diffusion caching. InForty-third International Conference on Machine Learning, 2026. 1, 3, 6

    2026

  13. [21]

    Q- Diffusion: Quantizing diffusion models

    Xiuyu Li, Yijiang Liu, Long Lian, Huanrui Yang, Zhen Dong, Daniel Kang, Shanghang Zhang, and Kurt Keutzer. Q- Diffusion: Quantizing diffusion models. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 17535–17545, 2023. 1, 3

    2023

  14. [22]

    Flow matching for generative model- ing

    Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matthew Le. Flow matching for generative model- ing. InThe eleventh international conference on learning rep- resentations, 2023. 1

    2023

  15. [23]

    Timestep embedding tells: It’s time to cache for video diffu- sion model

    Feng Liu, Shiwei Zhang, Xiaofeng Wang, Yujie Wei, Haonan Qiu, Yuzhong Zhao, Yingya Zhang, Qixiang Ye, and Fang Wan. Timestep embedding tells: It’s time to cache for video diffu- sion model. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 7353–736...

    2025

  16. [24]

    From reusing to forecasting: Accelerat- ing diffusion models with TaylorSeers

    Jiacheng Liu, Chang Zou, Yuanhuiyi Lyu, Junjie Chen, and Linfeng Zhang. From reusing to forecasting: Accelerat- ing diffusion models with TaylorSeers. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 15853–15863, 2025. 3, 6

    2025

  17. [25]

    CacheQuant: Compre- hensively accelerated diffusion models

    Xuewen Liu, Zhikai Li, and Qingyi Gu. CacheQuant: Compre- hensively accelerated diffusion models. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 23269–23280, 2025. 1

    2025

  18. [26]

    DPM-Solver: A fast ODE solver for diffusion probabilistic model sampling in around 10 steps.Advances in neural information processing systems, 35:5775–5787, 2022

    Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. DPM-Solver: A fast ODE solver for diffusion probabilistic model sampling in around 10 steps.Advances in neural information processing systems, 35:5775–5787, 2022. 1, 3

    2022

  19. [27]

    FasterCache: Training-free video diffusion model acceleration with high quality

    Zhengyao Lyu, Chenyang Si, Junhao Song, Zhenyu Yang, Yu Qiao, Ziwei Liu, and Kwan-Yee K Wong. FasterCache: Training-free video diffusion model acceleration with high quality. InInternational Conference on Learning Represen- tations, pages 33132–33156, 2025. 1, 3

    2025

  20. [28]

    Learning-to-Cache: Accelerating diffusion transformer 9 via layer caching.Advances in Neural Information Processing Systems, 37:133282–133304, 2024

    Xinyin Ma, Gongfan Fang, Michael Bi Mi, and Xinchao Wang. Learning-to-Cache: Accelerating diffusion transformer 9 via layer caching.Advances in Neural Information Processing Systems, 37:133282–133304, 2024. 1, 3

    2024

  21. [29]

    DeepCache: Accelerating diffusion models for free

    Xinyin Ma, Gongfan Fang, and Xinchao Wang. DeepCache: Accelerating diffusion models for free. InProceedings of the IEEE/CVF conference on computer vision and pattern recogni- tion, pages 15762–15772, 2024. 1, 3

    2024

  22. [30]

    MagCache: Fast video generation with magnitude-aware cache.Advances in Neural Information Processing Systems, 38:34348–34380, 2025

    Zehong Ma, Longhui Wei, Feng Wang, Shiliang Zhang, and Qi Tian. MagCache: Fast video generation with magnitude-aware cache.Advances in Neural Information Processing Systems, 38:34348–34380, 2025. 3, 4, 6

    2025

  23. [31]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. InProceedings of the IEEE/CVF interna- tional conference on computer vision, pages 4195–4205, 2023. 1

    2023

  24. [32]

    ER- TACache: Error rectification and timesteps adjustment for effi- cient diffusion.arXiv preprint arXiv:2508.21091, 2025

    Xurui Peng, Chenqian Yan, Hong Liu, Rui Ma, Fangmin Chen, Xing Wang, Zhihua Wu, Songwei Liu, and Mingbao Lin. ER- TACache: Error rectification and timesteps adjustment for effi- cient diffusion.arXiv preprint arXiv:2508.21091, 2025. 3

    2025

  25. [33]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. InInternational conference on machine learning, pag...

  26. [34]

    Hyper-SD: Trajectory segmented consistency model for efficient image synthesis.Ad- vances in neural information processing systems, 37:117340– 117362, 2024

    Yuxi Ren, Xin Xia, Yanzuo Lu, Jiacheng Zhang, Jie Wu, Pan Xie, Xing Wang, and Xuefeng Xiao. Hyper-SD: Trajectory segmented consistency model for efficient image synthesis.Ad- vances in neural information processing systems, 37:117340– 117362, 2024. 3

    2024

  27. [35]

    A reduc- tion of imitation learning and structured prediction to no-regret online learning

    St ´ephane Ross, Geoffrey Gordon, and Drew Bagnell. A reduc- tion of imitation learning and structured prediction to no-regret online learning. InProceedings of the fourteenth international conference on artificial intelligence and statistics, pages 627–

  28. [36]

    Pho- torealistic text-to-image diffusion models with deep language understanding.Advances in neural information processing sys- tems, 35:36479–36494, 2022

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gon- tijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Pho- torealistic text-to-image diffusion models with deep language understanding.Advances in neural informat...

    2022

  29. [37]

    Progressive distillation for fast sampling of diffusion models.arXiv preprint arXiv:2202.00512, 2022

    Tim Salimans and Jonathan Ho. Progressive distillation for fast sampling of diffusion models.arXiv preprint arXiv:2202.00512, 2022. 1, 3

    2022 arXiv

  30. [38]

    FORA: Fast-forward caching in diffusion transformer acceleration.arXiv preprint arXiv:2407.01425,

    Pratheba Selvaraju, Tianyu Ding, Tianyi Chen, Ilya Zharkov, and Luming Liang. FORA: Fast-forward caching in diffusion transformer acceleration.arXiv preprint arXiv:2407.01425,

    arXiv

  31. [39]

    Consistency models

    Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. Consistency models. InProceedings of the 40th International Conference on Machine Learning, pages 32211–32252, 2023. 1, 3

    2023

  32. [40]

    LongCat-Video technical report

    Meituan LongCat Team, Xunliang Cai, Qilong Huang, Zhuo- liang Kang, Hongyu Li, Shijun Liang, Liya Ma, Siyu Ren, Xi- aoming Wei, Rixu Xie, et al. LongCat-Video technical report. arXiv preprint arXiv:2510.22200, 2025. 1

    2025

  33. [41]

    Wan: Open and ad- vanced large-scale video generative models.arXiv preprint arXiv:2503.20314, 2025

    Team Wan, Ang Wang, Baole Ai, Bin Wen, Chaojie Mao, Chen-Wei Xie, Di Chen, Feiwu Yu, Haiming Zhao, Jianx- iao Yang, Jianyuan Zeng, et al. Wan: Open and ad- vanced large-scale video generative models.arXiv preprint arXiv:2503.20314, 2025. 1, 3, 5, 12

    2025 arXiv

  34. [42]

    Adaptive stochastic coefficients for accelerating dif- fusion sampling.Advances in Neural Information Processing Systems, 38:21985–22016, 2025

    Ruoyu Wang, Beier Zhu, Junzhi Li, Liangyu Yuan, and Chi Zhang. Adaptive stochastic coefficients for accelerating dif- fusion sampling.Advances in Neural Information Processing Systems, 38:21985–22016, 2025. 1

    2025

  35. [43]

    Image quality assessment: from error visibility to structural similarity.IEEE transactions on image processing, 13(4):600–612, 2004

    Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Si- moncelli. Image quality assessment: from error visibility to structural similarity.IEEE transactions on image processing, 13(4):600–612, 2004. 3

    2004

  36. [44]

    Cache me if you can: Accelerating diffusion models through block caching

    Felix Wimbauer, Bichen Wu, Edgar Schoenfeld, Xiaoliang Dai, Ji Hou, Zijian He, Artsiom Sanakoyeu, Peizhao Zhang, Sam Tsai, Jonas Kohler, et al. Cache me if you can: Accelerating diffusion models through block caching. InProceedings of the IEEE/CVF Conference on Computer Vision...

    2024

  37. [45]

    Qwen-Image technical report.arXiv preprint arXiv:2508.02324, 2025

    Chenfei Wu, Jiahao Li, Jingren Zhou, Junyang Lin, Kaiyuan Gao, Kun Yan, Sheng-ming Yin, Shuai Bai, Xiao Xu, Yilei Chen, et al. Qwen-Image technical report.arXiv preprint arXiv:2508.02324, 2025. 1

    2025 arXiv

  38. [46]

    Human preference score v2: A solid benchmark for evaluating human preferences of text-to- image synthesis.arXiv preprint arXiv:2306.09341, 2023

    Xiaoshi Wu, Yiming Hao, Keqiang Sun, Yixiong Chen, Feng Zhu, Rui Zhao, and Hongsheng Li. Human preference score v2: A solid benchmark for evaluating human preferences of text-to- image synthesis.arXiv preprint arXiv:2306.09341, 2023. 14

    2023 arXiv

  39. [47]

    ImageReward: Learn- ing and evaluating human preferences for text-to-image gener- ation.Advances in Neural Information Processing Systems, 36: 15903–15935, 2023

    Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong. ImageReward: Learn- ing and evaluating human preferences for text-to-image gener- ation.Advances in Neural Information Processing Systems, 36: 15903–15935, 2023. 3, 14

    2023

  40. [48]

    Improved distribution matching distillation for fast image synthesis.Ad- vances in neural information processing systems, 37:47455– 47487, 2024

    Tianwei Yin, Micha ¨el Gharbi, Taesung Park, Richard Zhang, Eli Shechtman, Fredo Durand, and Bill Freeman. Improved distribution matching distillation for fast image synthesis.Ad- vances in neural information processing systems, 37:47455– 47487, 2024. 3

    2024

  41. [49]

    One- step diffusion with distribution matching distillation

    Tianwei Yin, Micha ¨el Gharbi, Richard Zhang, Eli Shechtman, Fredo Durand, William T Freeman, and Taesung Park. One- step diffusion with distribution matching distillation. InPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6613–6623, 2024. 3

    2024

  42. [50]

    Few-step diffusion sampling through instance-aware discretizations

    Liangyu Yuan, Ruoyu Wang, Tong Zhao, Dingwen Fu, Mingkun Lei, Beier Zhu, and Chi Zhang. Few-step diffusion sampling through instance-aware discretizations. InProceed- ings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 35882–35892, 2026. 3

    2026

  43. [51]

    Block- Dance: Reuse structurally similar spatio-temporal features to accelerate diffusion transformers

    Hui Zhang, Tingwei Gao, Jie Shao, and Zuxuan Wu. Block- Dance: Reuse structurally similar spatio-temporal features to accelerate diffusion transformers. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 12891–12900, 2025. 1

    2025

  44. [52]

    The unreasonable effectiveness of deep fea- tures as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep fea- tures as a perceptual metric. InProceedings of the IEEE con- ference on computer vision and pattern recognition, pages 586– 595, 2018. 3, 12

    2018

  45. [53]

    Dy- Weight: Dynamic gradient weighting for few-step diffusion sampling.arXiv preprint arXiv:2603.11607, 2026

    Tong Zhao, Mingkun Lei, Liangyu Yuan, Yanming Yang, Chenxi Song, Yang Wang, Beier Zhu, and Chi Zhang. Dy- Weight: Dynamic gradient weighting for few-step diffusion sampling.arXiv preprint arXiv:2603.11607, 2026. 3

    2026

  46. [54]

    UniPC: A unified predictor-corrector framework for fast sampling of diffusion models.Advances in Neural Information Processing Systems, 36:49842–49869, 2023

    Wenliang Zhao, Lujia Bai, Yongming Rao, Jie Zhou, and Jiwen Lu. UniPC: A unified predictor-corrector framework for fast sampling of diffusion models.Advances in Neural Information Processing Systems, 36:49842–49869, 2023. 1, 3, 5 10

    2023

  47. [55]

    Dynamic dif- fusion transformer

    Wangbo Zhao, Yizeng Han, Jiasheng Tang, Kai Wang, Yibing Song, Gao Huang, Fan Wang, and Yang You. Dynamic dif- fusion transformer. InInternational Conference on Learning Representations, pages 65520–65552, 2025. 1

    2025

  48. [56]

    Real- time video generation with pyramid attention broadcast

    Xuanlei Zhao, Xiaolong Jin, Kai Wang, and Yang You. Real- time video generation with pyramid attention broadcast. In International Conference on Learning Representations, pages 3296–3319, 2025. 3

    2025

  49. [57]

    Distilling parallel gradients for fast ODE solvers of diffusion models

    Beier Zhu, Ruoyu Wang, Tong Zhao, Hanwang Zhang, and Chi Zhang. Distilling parallel gradients for fast ODE solvers of diffusion models. In2025 IEEE/CVF International Conference on Computer Vision (ICCV), pages 19557–19566. IEEE, 2025. 1

    2025

  50. [58]

    a stop sign

    Chang Zou, Xuyang Liu, Ting Liu, Siteng Huang, and Linfeng Zhang. Accelerating diffusion transformers with token-wise feature caching. InThe Thirteenth International Conference on Learning Representations, 2025. 3 11 BAG: Budget-Aware Gating for Diffusion Caching Supplementary...

    2025

  51. [635]

    JMLR Workshop and Conference Proceedings, 2011. 12

    2011

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.