Pith. sign in

REVIEW 3 major objections 4 minor 1 cited by

Pixel-Space Diffusion Transformers

T0 review · 3 major / 4 minor · reviewed 2026-08-01 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This survey establishes pixel-space diffusion transformers as a distinct, scalable class of end-to-end generative models that removes the fixed VAE bottleneck by denoising directly in raw pixel space.

desk verdict A useful survey with a solid taxonomy, but the 'first systematic' claim is unaudited and needs a methodology section. read the letter →

arxiv 2607.17585 v2 pith:54UJ2QT7 submitted 2026-07-20 cs.CV

Renye Yan , Jikang Cheng , You Wu , Ling Liang , Wei Peng , Athanasios V. Vasilakos , Qingyu Zhao , Yu Zhang
show 3 more authors
Yimao Cai Kilian M. Pohl Guoying Zhao
This is my paper
classification cs.CV
keywords pixel-spacediffusiontransformerslatentmodelsgenerativemodelingunifiedmultimodalimagegenerationflowmatchingsurvey
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that pixel-space diffusion transformers (pDiTs) form a distinct, scalable class of generative models that removes the fixed VAE bottleneck of latent diffusion by defining the denoising trajectory directly on raw pixels. It positions this shift as resolving a learnability-fidelity conflict through modern training recipes, direct clean-image prediction, and structured Transformer architectures. As the first survey dedicated to pDiTs, it organizes the field into seven architectural categories across three research dimensions — architecture, continuous generative mechanisms, and unified multimodal modeling — and identifies open challenges including quadratic attention cost, granularity conflicts, and multi-task gradient interference. A sympathetic reader would care because the paper maps how image generation could move toward end-to-end, VAE-free vision foundation models.

What carries the argument

The load-bearing object is the pDiT formulation: a noisy image is patchified, each patch is mapped by a learnable embedding into tokens, a Transformer backbone models global dependencies under time and text conditions, and an end-to-end decoding head predicts the clean image in pixel space. The survey's analytic grid is a seven-category taxonomy — single-stream large-patch, hierarchical/hourglass, global-local decoupled, frequency-decoupled, implicit neural field decoding, cross-scale semantic anchoring, and shared-token unified multimodal architectures — with flow matching and DDPM as the continuous trajectory mathematics and the O(N^2 d) attention cost as the central scaling constraint.

What would settle it

A concrete check: compile an independent list of pixel-space diffusion transformer papers with stated noise schedules and loss weightings, then test whether each fits one of the seven Table I categories; any substantial class that does not fit, or a matched-compute benchmark where latent diffusion beats pixel-space models specifically on text rendering and edge fidelity, would undercut the central taxonomy and the claim that the VAE bottleneck is removed.

Watch

Extended reading notes

Core claim

The paper's central claim is that pDiTs are not merely a return to early pixel-space diffusion but an independent, scalable paradigm: 'pixel space' means the diffusion state, prediction target, and supervision are defined in the raw image domain, while patchification is only a computational tokenization strategy, not a frozen visual compressor. It asserts that this removes an irreversible information bottleneck, allows single-stage end-to-end optimization, and provides a shared token space in which text, pixels, and task conditions can be jointly modeled by one Transformer. The survey substantiates this through a seven-category architectural taxonomy, an analysis of DDPM and flow-matching fo

Load-bearing premise

The survey's usefulness rests on the assumption that its selection of representative methods and its seven-category taxonomy faithfully cover the pDiT landscape; if important methods are omitted or miscategorized, the systematic and first-survey claims lose force.

Editorial extensions

If this is right

  • Fixed VAE or vision-foundation tokenizers become an optional interface rather than a quality ceiling, since raw-pixel supervision can preserve textures, edges, and text that compression discards.
  • End-to-end training can jointly optimize representation and generation, reducing the reconstruction-generation mismatch inherent in two-stage latent diffusion.
  • Unified multimodal models can be built on a shared token space where pixels, text, and task conditions are processed by a single Transformer.
  • Structured computation — large patches, hierarchy, global-local decoupling, frequency separation, and implicit decoding — makes high-resolution pixel-space generation tractable.
  • Evaluation must move beyond a single FID score or latency figure to include text fidelity, structural preservation, edit locality, and compute-fidelity Pareto comparisons.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the pDiT advantages hold, the most promising architectures will likely combine several taxonomy mechanisms — for example, global-local decoupling with frequency-aware scheduling and dynamic token granularity — rather than rely on a single design.
  • The learnability-fidelity conflict suggests a testable scaling prediction: at sufficient compute and with clean-image prediction or structured supervision, pixel-space models should match or surpass latent models on fine-detail metrics under matched training FLOPs.
  • The observed risk that token-wise representation alignment degrades diversity in pixel space implies that future guidance will shift toward relation-level or stage-adaptive constraints; a direct comparison of Gram-matrix alignment versus token-wise alignment on diversity and fidelity would test this.
  • If the shared-token unified paradigm is realized, multi-task gradient interference would need active management; monitoring gradient cosine-similarity conflicts during training of such a unified model could predict when understanding and generation objectives fight each other.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. The paper presents a survey of Pixel-Space Diffusion Transformers (pDiTs), arguing that this emerging class of generative models—defined by diffusion and supervision in the raw image space, with Transformer backbones and no fixed VAE/VQ tokenizer—offers a distinct and scalable alternative to latent diffusion. The survey covers theoretical foundations (DDPM, flow matching, complexity analysis), a seven-category architectural taxonomy (Table I), unified multimodal modeling, applications (image, video, 3D, medical), discussion, and future challenges. The central claim is that this is 'the first survey dedicated to the systematic review and comprehensive analysis of pixel-space diffusion models' (Sec. I).

Significance. If the taxonomy and coverage are reliable, the paper would serve as a useful roadmap for a rapidly evolving area. The background mathematics (Eqs. 1–11) is standard and correctly reproduced, and the paper clearly organizes the field along three dimensions: architecture, continuous generative mechanisms, and unified multimodal modeling. It also identifies substantive open problems, such as the computation–fidelity trade-off, non-invasive semantic guidance, forgetting in unified models, and native pixel-space trajectory design. The survey is balanced in acknowledging the continued strengths of latent diffusion. However, the value of the survey as a 'systematic review' depends on the completeness and fidelity of its method selection and categorization, which are not auditable in the current manuscript.

major comments (3)
  1. [Sec. I and Sec. III-B (Table I)] The paper's central claim of being 'the first survey dedicated to the systematic review and comprehensive analysis of pixel-space diffusion models' is not supported by any stated methodology. The manuscript does not provide a search protocol, inclusion/exclusion criteria, database sources, or a time window, so the 'systematic' claim is unverifiable. Table I lists only one or two representative methods per category, but there is no justification for why these methods were chosen or why the seven categories are mutually exclusive and collectively exhaustive. Please add a methodology subsection describing the literature search and selection process, or soften the 'systematic/first' claim accordingly.
  2. [Sec. III and Sec. V-A] There is an internal inconsistency in the definition of pDiT. Section III defines pDiT as a Transformer-based architecture: 'the Transformer uses tokenized representations and attention mechanisms as its primary computational backbone.' However, Section V-A states that 'The earliest applications of pDiT' include Simple Diffusion [67] and SiD2 [57], both of which are U-Net-based pixel-space diffusion models, not Transformers. The same issue appears in Fig. 2 and the timeline. This conflates 'pixel-space diffusion' with 'pixel-space diffusion Transformers.' Please either restrict the application discussion to Transformer-based models or explicitly distinguish between pixel-space diffusion in general and the pDiT subset, and adjust the taxonomy and title accordingly.
  3. [Sec. V-A, Sec. V-B] The application sections mix pDiT-specific claims with general pixel-space diffusion results without sufficient discrimination. For example, BlazeEdit [123] is described as 'still following the latent diffusion paradigm rather than pDiT,' which is appropriately flagged, but other methods are listed as pDiT without checking whether they use a Transformer backbone. The survey would be strengthened by a consistent criterion for which methods enter the pDiT taxonomy and which are included only as adjacent pixel-space approaches. This is necessary to make the seven-category taxonomy in Table I a faithful representation of the pDiT landscape.
minor comments (4)
  1. [Fig. 2] Typo: 'PixWAorld' should be 'PixWorld'.
  2. [References] Reference [5] has an incomplete title: 'in computer vision' appears where a topic phrase is expected.
  3. [Eq. (33)] The equation formatting has stray line-break characters (\r\r) inside the alignment loss expression; please clean up the LaTeX.
  4. [Sec. II-B] The figure overview (Fig. 1) mentions 'Time Parameterization' as a background topic, but the background section does not discuss time parameterizations explicitly beyond DDPM/flow matching. Consider adding a short paragraph to align the overview with the content.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the survey's taxonomy and claims are literature-based and do not reduce to the paper's own inputs.

full rationale

This paper is a survey, not a derivation. The central claims are (i) that pixel-space diffusion transformers are a distinct scalable class of generative models and (ii) that this is the first systematic survey of that area. Neither claim is derived from an equation or fitted parameter within the paper. The theoretical background (DDPM, flow matching, attention complexity) consists of standard, externally established results presented for context, not used to predict a quantity that was already assumed. The Table I taxonomy and the three organizing dimensions are interpretative classifications of external methods; they are not presented as predictions and no method is scored or fitted against the taxonomy to produce a result. The self-citations (refs. [1], [10], [26], [37], [122]) appear only as general contextual references in the introduction and the privacy discussion; none of them is invoked to justify the taxonomy, the 'first survey' novelty claim, or any technical conclusion. The absence of stated inclusion/exclusion criteria for the surveyed methods is a legitimate audit concern about completeness and representativeness, but it is not a circularity: the survey's organizational structure is not equivalent to its own literature sample by construction. No step in the paper reduces, by definition or by self-citation, to its own inputs. Accordingly, the honest finding is no significant circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The survey introduces no fitted parameters or new entities; its claim burden is carried by the accuracy and representativeness of its cited literature, and by standard diffusion/flow-matching math.

assumptions (3)
  • domain assumption Cited primary works (Simple Diffusion, JiT, PixelDiT, HDiT, HiDream-O1-Image, etc.) are correctly described and their results are real.
    The survey's taxonomy and comparisons stand or fall on accurate representation of external papers; no independent verification is provided.
  • standard math The standard DDPM and flow-matching formulations (Eqs. 1-11) are standard mathematics as used in the literature.
    Background equations are standard; no new derivation is offered.
  • domain assumption The absence of an earlier dedicated survey of pixel-space diffusion models (the 'first survey' claim) is true.
    Not verifiable from the paper; depends on completeness of the authors' literature search.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Pixel-Space Diffusion Transformers." pith.science (2026). https://pith.science/paper/54UJ2QT7

@misc{pith2026260717585,
  author       = {Pith},
  title        = {Pith review of: Pixel-Space Diffusion Transformers},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/54UJ2QT7}},
  note         = {Machine review of arXiv:2607.17585}
}
read the original abstract

Latent diffusion models (LDMs) enable efficient high-resolution image synthesis by denoising in a VAE-compressed latent space. However, fixed visual tokenizers can discard fine textures and structural details, while separate representation and diffusion training creates a mismatch between reconstruction and generation objectives. These limitations have renewed interest in pixel-space diffusion, which models raw pixels directly, removes the VAE bottleneck, and supports end-to-end optimization. This formulation better matches the demands of high-fidelity generation but introduces challenges in high-dimensional modeling, including noise scheduling, loss weighting, token efficiency, and scalable architecture design. Pixel-space modeling also offers a promising basis for unified multimodal systems: raw pixels, text, and task conditions can be represented in a shared token space and jointly processed by a single Transformer, narrowing the gap between visual understanding and generation. This paper reviews Pixel-Space Diffusion Transformers (pDiTs) from the perspectives of model architecture, continuous generative mechanisms, and unified multimodal modeling. We summarize representative methods, identify key technical challenges, and discuss future directions toward high-fidelity, end-to-end vision foundation models that integrate generation and understanding.

Figures

Figures reproduced from arXiv: 2607.17585 by the authors.

Figure 1
Figure 1. Overview of the Survey Structure and Research Roadmap. [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Timeline of the development of pixel diffusion models. [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Taxonomy and Representative Methods of Latent Diffu [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (1 more)
Figure 5
Figure 5. Figure 5: Comparison of the Overall Pipelines and Key Differences between Latent-Space and Pixel-Space Diffusion Models. [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. RAGOCR: Optical Compression of Retrieval-Augmented Text via Visual Representation

    cs.CL 2026-08 reject novelty 5.0 of 10

    RAGOCR renders retrieved documents as images and uses a GRPO-trained compressor to allocate query-dependent resolution, reporting accuracy gains over RAG at reduced token counts, though the evidence in the preprint is...

Reference graph

Works this paper leans on

131 extracted references · 36 linked inside Pith · cited by 1 Pith paper

  1. [67]

    simple diffusion: End-to-end diffusion for high resolution images,

    E. Hoogeboom, J. Heek, and T. Salimans, “simple diffusion: End-to-end diffusion for high resolution images,” inInterna- tional Conference on Machine Learning. PMLR, 2023, pp. 13 213–13 232

    2023

  2. [57]

    Simpler diffusion: 1.5 fid on imagenet512 with pixel-space diffusion,

    E. Hoogeboom, T. Mensink, J. Heek, K. Lamerigts, R. Gao, and T. Salimans, “Simpler diffusion: 1.5 fid on imagenet512 with pixel-space diffusion,” inProceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 18 062– 18 071

    2025

  3. [123]

    Blazeedit: Generalist image editing on mobile devices with image-to-image diffusion models,

    F. Deng, Y . Xu, Z. Bao, Z. Zhang, H. Jia, K. Raveendran, and J. Wei, “Blazeedit: Generalist image editing on mobile devices with image-to-image diffusion models,”arXiv preprint arXiv:2605.28067, 2026

    arXiv 2026

  4. [1]

    A sanity check for multi-in-domain face forgery detection in the real world,

    J. Cheng, R. Yan, Z. Yan, Y . Gan, X. Zhang, Z. Wang, W. Peng, and L. Liang, “A sanity check for multi-in-domain face forgery detection in the real world,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 21 306–21 315

    2026

  5. [2]

    Edge deep learning in computer vision and medical diagnostics: a com- prehensive survey,

    Y . Xu, T. M. Khan, Y . Song, and E. Meijering, “Edge deep learning in computer vision and medical diagnostics: a com- prehensive survey,”arXiv preprint arXiv:2605.06714, 2026

    arXiv 2026

  6. [3]

    A review of pseudo-labeling for computer vision,

    P. Kage, J. Rothenberger, P. Andreadis, and D. Diochnos, “A review of pseudo-labeling for computer vision,”Journal of Artificial Intelligence Research, vol. 85, 2026

    2026

  7. [4]

    Intelligent recognition of emergency vehicles in congested traffic using computer vision,

    K. P. M. Ballesteros, C. M. L. D. Cruz, J. D. R. Magbanua, M. J. M. Mancenido, and L. V . Comia, “Intelligent recognition of emergency vehicles in congested traffic using computer vision,” in2026 6th International Conference on Image Pro- cessing and Capsule Networks (ICIPCN). IEEE, 2026, pp. 34–40

    2026

  8. [5]

    in computer vision,

    Y . Ji, W. Wu, H. Chen, and Z. Liu, “in computer vision,” Artificial Intelligence in Digital Image Processing: Theories, Methods, and Applications, p. 79, 2026

    2026

Show all 131 references
  1. [6]

    Attention mechanisms in computer vision: A survey,

    M.-H. Guo, T.-X. Xu, J.-J. Liu, Z.-N. Liu, P.-T. Jiang, T.- J. Mu, S.-H. Zhang, R. R. Martin, M.-M. Cheng, and S.-M. Hu, “Attention mechanisms in computer vision: A survey,” Computational visual media, vol. 8, no. 3, pp. 331–368, 2022

    2022

  2. [7]

    Generative adversarial networks in computer vision: A survey and taxonomy,

    Z. Wang, Q. She, and T. E. Ward, “Generative adversarial networks in computer vision: A survey and taxonomy,”ACM Computing Surveys (CSUR), vol. 54, no. 2, pp. 1–38, 2021

    2021

  3. [8]

    Picture perfect: Engaging customers with visual generative ai,

    M. Heitmann, T. P. Jansen, M. Reisenbichler, and D. A. Schweidel, “Picture perfect: Engaging customers with visual generative ai,”Journal of Marketing, vol. 90, no. 4, pp. 74–96, 2026

    2026

  4. [9]

    Around the world in 80 timesteps: A generative approach to global visual geolocation,

    N. Dufour, V . Kalogeiton, D. Picard, and L. Landrieu, “Around the world in 80 timesteps: A generative approach to global visual geolocation,” inProceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 23 016–23 026

    2025

  5. [10]

    Entropy-adaptive diffusion policy optimization with dynamic step alignment,

    R. Yan, J. Cheng, Y . Gan, S. Sun, Y . Wu, Y . Yang, L. Ling, J. Lin, Y . Zhu, J. Zhouet al., “Entropy-adaptive diffusion policy optimization with dynamic step alignment,” inProceed- ings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 1924–1934

    2025

  6. [11]

    Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive mod- els,

    S. Bond-Taylor, A. Leach, Y . Long, and C. G. Willcocks, “Deep generative modelling: A comparative review of vaes, gans, normalizing flows, energy-based and autoregressive mod- els,”IEEE transactions on pattern analysis and machine intelligence, vol. 44, no. 11, pp. 7327–7347, 2021

    2021

  7. [12]

    Energy-based generative adversarial network,

    J. Zhao, M. Mathieu, and Y . LeCun, “Energy-based generative adversarial network,”arXiv preprint arXiv:1609.03126, 2016

    2016 arXiv

  8. [13]

    Nice: Non- linear independent components estimation,

    L. Dinh, D. Krueger, and Y . Bengio, “Nice: Non- linear independent components estimation,”arXiv preprint arXiv:1410.8516, 2014

    2014 arXiv

  9. [14]

    Wavenet: A generative model for raw audio,

    A. Van Den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuogluet al., “Wavenet: A generative model for raw audio,”arXiv preprint arXiv:1609.03499, vol. 12, no. 1, 2016

    2016 arXiv

  10. [15]

    Unpaired image-to-image translation using cycle-consistent adversarial networks,

    J.-Y . Zhu, T. Park, P. Isola, and A. A. Efros, “Unpaired image-to-image translation using cycle-consistent adversarial networks,” inProceedings of the IEEE international confer- ence on computer vision, 2017, pp. 2223–2232

    2017

  11. [16]

    Diffusion models in vision: A survey,

    F.-A. Croitoru, V . Hondru, R. T. Ionescu, and M. Shah, “Diffusion models in vision: A survey,”IEEE transactions on pattern analysis and machine intelligence, vol. 45, no. 9, pp. 10 850–10 869, 2023

    2023

  12. [17]

    Mixture of global and local experts with diffusion transformer for controllable face generation,

    X. Zou, S. Zhang, X. Fu, Y . Li, K. Li, Y . Cao, C. Lang, P. Tao, and J. Xing, “Mixture of global and local experts with diffusion transformer for controllable face generation,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026

    2026

  13. [18]

    Remasking 25 discrete diffusion models with inference-time scaling,

    G. Wang, Y . Schiff, S. Sahoo, and V . Kuleshov, “Remasking 25 discrete diffusion models with inference-time scaling,”Ad- vances in Neural Information Processing Systems, vol. 38, pp. 147 282–147 339, 2026

    2026

  14. [19]

    Why diffu- sion models don’t memorize: The role of implicit dynamical regularization in training,

    T. Bonnaire, R. Urfin, G. Biroli, and M. M ´ezard, “Why diffu- sion models don’t memorize: The role of implicit dynamical regularization in training,”Advances in Neural Information Processing Systems, vol. 38, pp. 141 266–141 286, 2026

    2026

  15. [20]

    Guiding a diffusion model with a bad version of itself,

    T. Karras, M. Aittala, T. Kynk ¨a¨anniemi, J. Lehtinen, T. Aila, and S. Laine, “Guiding a diffusion model with a bad version of itself,”Advances in Neural Information Processing Systems, vol. 37, pp. 52 996–53 021, 2024

    2024

  16. [21]

    Human motion diffusion model,

    G. Tevet, S. Raab, B. Gordon, Y . Shafir, D. Cohen-Or, and A. H. Bermano, “Human motion diffusion model,”arXiv preprint arXiv:2209.14916, 2022

    2022 arXiv

  17. [22]

    Diffusion models and representation learning: A survey,

    M. Fuest, P. Ma, M. Gui, J. Schusterbauer, V . T. Hu, and B. Ommer, “Diffusion models and representation learning: A survey,”IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026

    2026

  18. [23]

    Holod- iffusion: Training a 3d diffusion model using 2d images,

    A. Karnewar, A. Vedaldi, D. Novotny, and N. J. Mitra, “Holod- iffusion: Training a 3d diffusion model using 2d images,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 18 423–18 433

    2023

  19. [24]

    Klass: Kl-guided fast inference in masked diffusion models,

    S. H. Kim, S. Hong, H. Jung, Y . Park, and S.-Y . Yun, “Klass: Kl-guided fast inference in masked diffusion models,” Advances in Neural Information Processing Systems, vol. 38, pp. 92 267–92 301, 2026

    2026

  20. [25]

    Training-free constrained generation with stable diffusion models,

    S. Zampini, J. K. Christopher, L. Oneto, D. Anguita, and F. Fioretto, “Training-free constrained generation with stable diffusion models,”Advances in Neural Information Processing Systems, vol. 38, pp. 27 285–27 316, 2026

    2026

  21. [26]

    Do less, achieve more: Do we need every-step optimization for rl fine-tuning of diffusion models?

    R. Yan, J. Cheng, S. Sun, Y . Sun, Y . Wu, W. Peng, Z. Wang, L. Liang, J. Xing, and Y . Cai, “Do less, achieve more: Do we need every-step optimization for rl fine-tuning of diffusion models?” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,...

    2026

  22. [27]

    High-resolution image synthesis with latent diffusion models,

    R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Om- mer, “High-resolution image synthesis with latent diffusion models,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 10 684– 10 695

    2022

  23. [28]

    Sdxl: Improving latent diffusion models for high-resolution image synthesis,

    D. Podell, Z. English, K. Lacey, A. Blattmann, T. Dockhorn, J. M ¨uller, J. Penna, and R. Rombach, “Sdxl: Improving latent diffusion models for high-resolution image synthesis,” inInter- national Conference on Learning Representations, vol. 2024, 2024, pp. 1862–1874

    2024

  24. [29]

    Align your latents: High-resolution video synthesis with latent diffusion models,

    A. Blattmann, R. Rombach, H. Ling, T. Dockhorn, S. W. Kim, S. Fidler, and K. Kreis, “Align your latents: High-resolution video synthesis with latent diffusion models,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 22 563–22 575

    2023

  25. [30]

    Stable video diffusion: Scaling latent video diffusion models to large datasets,

    A. Blattmann, T. Dockhorn, S. Kulal, D. Mendelevitch, M. Kil- ian, D. Lorenz, Y . Levi, Z. English, V . V oleti, A. Lettset al., “Stable video diffusion: Scaling latent video diffusion models to large datasets,”arXiv preprint arXiv:2311.15127, 2023

    2023 arXiv

  26. [31]

    Diffusion models already have a semantic latent space,

    M. Kwon, J. Jeong, and Y . Uh, “Diffusion models already have a semantic latent space,”arXiv preprint arXiv:2210.10960, 2022

    2022 arXiv

  27. [32]

    Latentpaint: Image inpainting in latent space with diffusion models,

    C. Corneanu, R. Gadde, and A. M. Martinez, “Latentpaint: Image inpainting in latent space with diffusion models,” in Proceedings of the IEEE/CVF winter conference on applica- tions of computer vision, 2024, pp. 4334–4343

    2024

  28. [33]

    Unconditional latent diffusion models memorize patient imaging data,

    S. U. H. Dar, M. Seyfarth, I. Ayx, T. Papavassiliu, S. O. Schoenberg, R. M. Siepmann, F. C. Laqua, J. Kahmann, N. Frey, B. Baeßleret al., “Unconditional latent diffusion models memorize patient imaging data,”Nature biomedical engineering, vol. 10, no. 3, pp. 458–472, 2026

    2026

  29. [34]

    Ladder variational autoencoders,

    C. K. Sønderby, T. Raiko, L. Maaløe, S. K. Sønderby, and O. Winther, “Ladder variational autoencoders,”Advances in neural information processing systems, vol. 29, 2016

    2016

  30. [35]

    Longitudinal variational autoencoder,

    S. Ramchandran, G. Tikhonov, K. Kujanp ¨a¨a, M. Koskinen, and H. L¨ahdesm¨aki, “Longitudinal variational autoencoder,” inIn- ternational Conference on Artificial Intelligence and Statistics. PMLR, 2021, pp. 3898–3906

    2021

  31. [36]

    Gram- mar variational autoencoder,

    M. J. Kusner, B. Paige, and J. M. Hern ´andez-Lobato, “Gram- mar variational autoencoder,” inInternational conference on machine learning. PMLR, 2017, pp. 1945–1954

    2017

  32. [37]

    The exploration-exploitation dilemma revisited: An entropy perspective,

    R. Yan, Y . Gan, Y . Wu, L. Liang, J. Xing, Y . Cai, and R. Huang, “The exploration-exploitation dilemma revisited: An entropy perspective,”arXiv preprint arXiv:2408.09974, 2024

    2024 arXiv

  33. [38]

    Mvae: Multimodal variational autoencoder for fake news detection,

    D. Khattar, J. S. Goud, M. Gupta, and V . Varma, “Mvae: Multimodal variational autoencoder for fake news detection,” inThe world wide web conference, 2019, pp. 2915–2921

    2019

  34. [39]

    Poisson variational autoencoder,

    H. Vafaii, D. Galor, and J. L. Yates, “Poisson variational autoencoder,”Advances in Neural Information Processing Sys- tems, vol. 37, pp. 44 871–44 906, 2024

    2024

  35. [40]

    Xidintfl-vae: Xgboost-based intrusion detection of imbalance network traffic via class-wise focal loss variational autoencoder,

    O. H. Abdulganiyu, T. A. Tchakoucht, Y . K. Saheed, and H. A. Ahmed, “Xidintfl-vae: Xgboost-based intrusion detection of imbalance network traffic via class-wise focal loss variational autoencoder,”The Journal of Supercomputing, vol. 81, no. 1, p. 16, 2025

    2025

  36. [41]

    Remaining useful life prediction based on interpretable serialized variational autoencoder: A drift- diffusion stochastic equation perspective,

    J. Zhang, K. Chen, R. He, T. Huang, J. Tian, S. Wu, P. Yan, and Y . Cheng, “Remaining useful life prediction based on interpretable serialized variational autoencoder: A drift- diffusion stochastic equation perspective,”IEEE Transactions on Industrial Informatics, 2026

    2026

  37. [42]

    Scalable diffusion models with transformers,

    W. Peebles and S. Xie, “Scalable diffusion models with transformers,” inProceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 4195–4205

    2023

  38. [43]

    All are worth words: A vit backbone for diffusion models,

    F. Bao, S. Nie, K. Xue, Y . Cao, C. Li, H. Su, and J. Zhu, “All are worth words: A vit backbone for diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 22 669–22 679

    2023

  39. [44]

    Sit: Exploring flow and diffusion-based generative models with scalable interpolant transformers,

    N. Ma, M. Goldstein, M. S. Albergo, N. M. Boffi, E. Vanden- Eijnden, and S. Xie, “Sit: Exploring flow and diffusion-based generative models with scalable interpolant transformers,” in European Conference on Computer Vision. Springer, 2024, pp. 23–40

    2024

  40. [45]

    Scaling rectified flow transformers for high-resolution image synthesis,

    P. Esser, S. Kulal, A. Blattmann, R. Entezari, J. M ¨uller, H. Saini, Y . Levi, D. Lorenz, A. Sauer, F. Boeselet al., “Scaling rectified flow transformers for high-resolution image synthesis,” inForty-first international conference on machine learning, 2024

    2024

  41. [46]

    Exploring diffusion transformer designs via grafting,

    K. Chandrasegaran, M. Poli, D. Fu, D. Kim, L. M. Hadzic, M. Li, A. Gupta, S. Massaroli, A. Mirhoseini, J. C. Niebles et al., “Exploring diffusion transformer designs via grafting,” Advances in Neural Information Processing Systems, vol. 38, pp. 17 816–17 847, 2026

    2026

  42. [47]

    Scalable high-resolution pixel- space image synthesis with hourglass diffusion transformers,

    K. Crowson, S. A. Baumann, A. Birch, T. M. Abraham, D. Z. Kaplan, and E. Shippole, “Scalable high-resolution pixel- space image synthesis with hourglass diffusion transformers,” inForty-first International Conference on Machine Learning, 2024

    2024

  43. [48]

    Edify image: High- quality image generation with pixel space laplacian diffusion models,

    Y . Atzmon, M. Bala, Y . Balaji, T. Cai, Y . Cui, J. Fan, Y . Ge, S. Gururani, J. Huffman, R. Isaacet al., “Edify image: High- quality image generation with pixel space laplacian diffusion models,”arXiv preprint arXiv:2411.07126, 2024

    2024 arXiv

  44. [49]

    Pixelgen: Pixel diffusion beats latent diffusion with perceptual loss,

    Z. Ma, R. Xu, and S. Zhang, “Pixelgen: Pixel diffusion beats latent diffusion with perceptual loss,”arXiv preprint arXiv:2602.02493, 2026

    2026 arXiv

  45. [50]

    Pixnerd: Pixel neural field diffusion,

    S. Wang, Z. Gao, C. Zhu, W. Huang, and L. Wang, “Pixnerd: Pixel neural field diffusion,”arXiv preprint arXiv:2507.23268, 2025

    2025 arXiv

  46. [51]

    Pixeldit: Pixel diffusion transformers for image generation,

    Y . Yu, W. Xiong, W. Nie, Y . Sheng, S. Liu, and J. Luo, “Pixeldit: Pixel diffusion transformers for image generation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 14 273–14 282

    2026

  47. [52]

    Deco: 26 Frequency-decoupled pixel diffusion for end-to-end image generation,

    Z. Ma, L. Wei, S. Wang, S. Zhang, and Q. Tian, “Deco: 26 Frequency-decoupled pixel diffusion for end-to-end image generation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 43 600– 43 610

    2026

  48. [53]

    Latent forcing: Reordering the diffusion trajectory for pixel-space image generation,

    A. Baade, E. R. Chan, K. Sargent, C. Chen, J. Johnson, E. Adeli, and L. Fei-Fei, “Latent forcing: Reordering the diffusion trajectory for pixel-space image generation,”arXiv preprint arXiv:2602.11401, 2026

    2026

  49. [54]

    Your latent mask is wrong: Pixel-equivalent latent compositing for diffusion models,

    R. Bradbury and D. Zhong, “Your latent mask is wrong: Pixel-equivalent latent compositing for diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 18 630–18 639

    2026

  50. [55]

    Scale space diffusion,

    S. Mukhopadhyay, P. Udhayanan, and A. Shrivastava, “Scale space diffusion,” inProceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, 2026, pp. 35 851–35 860

    2026

  51. [56]

    Pixel motion diffusion is what we need for robot control,

    E.-R. Nguyen, Y . Zhang, K. Ranasinghe, X. Li, and M. S. Ryoo, “Pixel motion diffusion is what we need for robot control,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 23 663– 23 672

    2026

  52. [58]

    Pixel-perfect depth with semantics-prompted diffusion transformers,

    G. Xu, H. Lin, H. Luo, X. Wang, J. Yao, L. Zhu, Y . Pu, C. Chi , H. Sun, B. Wanget al., “Pixel-perfect depth with semantics-prompted diffusion transformers,”Advances in Neu- ral Information Processing Systems, vol. 38, pp. 174 731– 174 755, 2026

    2026

  53. [59]

    Novel view synthesis with pixel-space diffu- sion models,

    N. Elata, B. Kawar, Y . Ostrovsky-Berman, M. Farber, and R. Sokolovsky, “Novel view synthesis with pixel-space diffu- sion models,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025, pp. 26 756– 26 766

    2025

  54. [60]

    Pixel-space post-training of latent diffusion models,

    C. Zhang, S. Motwani, M. Yu, J. Hou, F. Juefei-Xu, S. Tsai, P. Vajda, Z. He, and J. Wang, “Pixel-space post-training of latent diffusion models,”arXiv preprint arXiv:2409.17565, 2024

    2024 arXiv

  55. [61]

    Back to basics: Let denoising generative models denoise,

    T. Li and K. He, “Back to basics: Let denoising generative models denoise,” inProceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, 2026, pp. 36 115–36 125

    2026

  56. [62]

    Hidream-o1-image: A natively unified image generative foundation model with pixel-level unified transformer,

    Q. Cai, J. Chen, C. Gao, Z. Gong, Y . Li, Y . Pan, Y . Peng, Z. Qiu, K. Yu, Y . Zhanget al., “Hidream-o1-image: A natively unified image generative foundation model with pixel-level unified transformer,”arXiv preprint arXiv:2605.11061, 2026

    2026 arXiv

  57. [63]

    Show- o: One single transformer to unify multimodal understanding and generation,

    J. Xie, W. Mao, Z. Bai, D. J. Zhang, W. Wang, K. Q. Lin, Y . Gu, Z. Chen, Z. Yang, and M. Z. Shou, “Show- o: One single transformer to unify multimodal understanding and generation,” inInternational Conference on Learning Representations, vol. 2025, 2025, pp. 28 240–28 264

    2025

  58. [64]

    Transfusion: Predict the next token and diffuse images with one multi-modal model,

    C. Zhou, L. Yu, A. Babu, K. Tirumala, M. Yasunaga, L. Shamis, J. Kahn, X. Ma, L. Zettlemoyer, and O. Levy, “Transfusion: Predict the next token and diffuse images with one multi-modal model,” inInternational Conference on Learning Representations, vol. 2025, 2025, pp. 6446–6469

    2025

  59. [65]

    Learning transferable visual models from natural language supervision,

    A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agarwal, G. Sastry, A. Askell, P. Mishkin, J. Clarket al., “Learning transferable visual models from natural language supervision,” inInternational conference on machine learning. PmLR, 2021, pp. 8748–8763

    2021

  60. [66]

    Dinov2: Learning robust visual features without supervision,

    M. Oquab, T. Darcet, T. Moutakanni, H. V o, M. Szafraniec, V . Khalidov, P. Fernandez, D. Haziza, F. Massa, A. El- Noubyet al., “Dinov2: Learning robust visual features without supervision,”arXiv preprint arXiv:2304.07193, 2023

    2023 arXiv

  61. [68]

    Low light image enhancement challenge at ntire 2026,

    G. Ciubotariu, A. Rehman, F. A. Dharejo, R. A. Naqvi, M. V . Conde, R. Timofte, Z. Jin, H. Wu, W. Zhang, C. Yeet al., “Low light image enhancement challenge at ntire 2026,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 1741–1753

    2026

  62. [69]

    Hyperspec- tral imaging,

    D. Hong, C. Li, N. Yokoya, B. Zhang, X. Jia, A. Plaza, P. Gamba, J. A. Benediktsson, and J. Chanussot, “Hyperspec- tral imaging,”Nature Reviews Methods Primers, vol. 6, no. 1, p. 19, 2026

    2026

  63. [70]

    Perception encoder: The best visual embeddings are not at the output of the network,

    D. Bolya, P.-Y . Huang, P. Sun, J. H. Cho, A. Madotto, C. Wei, T. Ma, J. Zhi, J. Rajasegaran, H. Bangalathet al., “Perception encoder: The best visual embeddings are not at the output of the network,”Advances in Neural Information Processing Systems, vol. 38, pp. 60 884–60 937, 2026

    2026

  64. [71]

    Ntire 2026 challenge on video saliency prediction: Methods and results,

    A. Moskalenko, A. Bryncev, I. Kosmynin, K. Shilovskaya, M. Erofeev, D. Vatolin, R. Timofte, K. Wang, Y . Hu, Z. Li et al., “Ntire 2026 challenge on video saliency prediction: Methods and results,” inProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recogn...

    2026

  65. [72]

    Ntire 2026 challenge on robust ai-generated image detection in the wild,

    A. Gushchin, K. Abud, E. Shumitskaya, A. Filippov, G. By- chkov, S. Lavrushkin, M. Erofeev, A. Antsiferova, C. Chen, S. Tanet al., “Ntire 2026 challenge on robust ai-generated image detection in the wild,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern...

    2026

  66. [73]

    One step diffusion via shortcut models,

    K. Frans, D. Hafner, S. Levine, and P. Abbeel, “One step diffusion via shortcut models,” inInternational Conference on Learning Representations, vol. 2025, 2025, pp. 34 668–34 684

    2025

  67. [74]

    Latent diffusion for language generation,

    J. Lovelace, V . Kishore, C. Wan, E. Shekhtman, and K. Q. Weinberger, “Latent diffusion for language generation,”Ad- vances in Neural Information Processing Systems, vol. 36, pp. 56 998–57 025, 2023

    2023

  68. [75]

    Auto-encoding variational bayes,

    D. P. Kingma and M. Welling, “Auto-encoding variational bayes,”arXiv preprint arXiv:1312.6114, 2013

    2013 arXiv

  69. [76]

    Turbo-vaed: Fast and stable transfer of video-vaes to mobile devices,

    Y . Zou, J. Yao, S. Yu, S. Zhang, W. Liu, and X. Wang, “Turbo-vaed: Fast and stable transfer of video-vaes to mobile devices,” inProceedings of the AAAI Conference on Artificial Intelligence, vol. 40, no. 16, 2026, pp. 14 086–14 094

    2026

  70. [77]

    Sparc3d: Sparse representation and construction for high-resolution 3d shapes modeling,

    Z. Li, Y . Wang, H. Zheng, Y . Luo, and B. Wen, “Sparc3d: Sparse representation and construction for high-resolution 3d shapes modeling,”Advances in Neural Information Processing Systems, vol. 38, pp. 118 582–118 600, 2026

    2026

  71. [78]

    Vision foundation models can be good tokenizers for latent diffusion models,

    T. Bi, X. Zhang, Y . Lu, and N. Zheng, “Vision foundation models can be good tokenizers for latent diffusion models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 43 310–43 319

    2026

  72. [79]

    Softvq-vae: Efficient 1- dimensional continuous tokenizer,

    H. Chen, Z. Wang, X. Li, X. Sun, F. Chen, J. Liu, J. Wang, B. Raj, Z. Liu, and E. Barsoum, “Softvq-vae: Efficient 1- dimensional continuous tokenizer,” inProceedings of the Com- puter Vision and Pattern Recognition Conference, 2025, pp. 28 358–28 370

    2025

  73. [80]

    Mgvq: Could vq-vae beat vae? a generalizable tokenizer with multi-group quantization,

    M. Jia, W. Yin, X. Hu, J. Guo, X. Guo, Q. Zhang, X.- X. Long, and P. Tan, “Mgvq: Could vq-vae beat vae? a generalizable tokenizer with multi-group quantization,”arXiv preprint arXiv:2507.07997, 2025

    2025 arXiv

  74. [81]

    Improving autoregressive image generation through coarse-to-fine token prediction,

    Z. Guo, K. Zhang, and M. Q. Shieh, “Improving autoregressive image generation through coarse-to-fine token prediction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 1230–1239

    2026

  75. [82]

    Tar3d: Creating high-quality 3d assets via next-part prediction,

    X. Zhang, Y . Liu, Y . Li, R. Zhang, Y . Liu, K. Wang, W. Ouyang, Z. Xiong, P. Gao, Q. Houet al., “Tar3d: Creating high-quality 3d assets via next-part prediction,” inProceed- ings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 5134–5145

    2025

  76. [83]

    Hyperdit: Hyper-connected transform- 27 ers for high-fidelity pixel-space diffusion,

    Y . He, L. Ma, Z. Guo, X. Shan, J. Fu, D. Chen, J. Huang, and Y . Li, “Hyperdit: Hyper-connected transform- 27 ers for high-fidelity pixel-space diffusion,”arXiv preprint arXiv:2605.15741, 2026

    2026 arXiv

  77. [84]

    Dip: Taming diffusion models in pixel space,

    Z. Chen, J. Zhu, X. Chen, J. Zhang, X. Hu, H. Zhao, C. Wang, J. Yang, and Y . Tai, “Dip: Taming diffusion models in pixel space,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2026, pp. 36 136– 36 146

    2026

  78. [85]

    Pixelflow: Pixel-space generative models with flow,

    S. Chen, C. Ge, S. Zhang, P. Sun, and P. Luo, “Pixelflow: Pixel-space generative models with flow,”arXiv preprint arXiv:2504.07963, 2025

    2025 arXiv

  79. [86]

    Vectorfusion: Text-to-svg by abstracting pixel-based diffusion models,

    A. Jain, A. Xie, and P. Abbeel, “Vectorfusion: Text-to-svg by abstracting pixel-based diffusion models,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 1911–1920

    2023

  80. [87]

    Lost in latent space: An empirical study of latent diffusion models for physics emulation,

    F. Rozet, R. Ohana, M. McCabe, G. Louppe, F. Lanusse, and S. Ho, “Lost in latent space: An empirical study of latent diffusion models for physics emulation,”Advances in Neural Information Processing Systems, vol. 38, pp. 134 612–134 657, 2026

    2026

  81. [88]

    Leanvae: An ultra-efficient recon- struction vae for video diffusion models,

    Y . Cheng and F. Yuan, “Leanvae: An ultra-efficient recon- struction vae for video diffusion models,” inProceedings of the IEEE/CVF International Conference on Computer Vision, 2025, pp. 15 692–15 702

    2025

  82. [89]

    Denoising diffusion proba- bilistic models,

    J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion proba- bilistic models,”Advances in neural information processing systems, vol. 33, pp. 6840–6851, 2020

    2020

  83. [90]

    Flow matching for generative modeling,

    Y . Lipman, R. T. Chen, H. Ben-Hamu, M. Nickel, and M. Le, “Flow matching for generative modeling,”arXiv preprint arXiv:2210.02747, 2022

    2022 arXiv

  84. [91]

    Flow straight and fast: Learning to generate and transfer data with rectified flow,

    X. Liu, C. Gong, and Q. Liu, “Flow straight and fast: Learning to generate and transfer data with rectified flow,”arXiv preprint arXiv:2209.03003, 2022

    2022 arXiv

  85. [92]

    Attention is all you need,

    A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,”Advances in neural information processing systems, vol. 30, 2017

    2017

  86. [93]

    Generative modeling by estimating gradients of the data distribution,

    Y . Song and S. Ermon, “Generative modeling by estimating gradients of the data distribution,”Advances in neural infor- mation processing systems, vol. 32, 2019

    2019

  87. [94]

    Score-based generative model- ing through stochastic differential equations,

    Y . Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, and B. Poole, “Score-based generative model- ing through stochastic differential equations,”arXiv preprint arXiv:2011.13456, 2020

    2011 arXiv

  88. [95]

    Freeu: Free lunch in diffusion u-net,

    C. Si, Z. Huang, Y . Jiang, and Z. Liu, “Freeu: Free lunch in diffusion u-net,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024, pp. 4733– 4743

    2024

  89. [96]

    U-repa: Aligning diffusion u-nets to vits,

    Y . Tian, H. Chen, M. Zheng, Y . Liang, C. Xu, and Y . Wang, “U-repa: Aligning diffusion u-nets to vits,”Advances in Neural Information Processing Systems, vol. 38, pp. 11 003–11 024, 2026

    2026

  90. [97]

    U-net: Convolutional networks for biomedical image segmentation,

    O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” inInterna- tional Conference on Medical image computing and computer- assisted intervention. Springer, 2015, pp. 234–241

    2015

  91. [98]

    Smaat-unet: Precipitation nowcasting using a small attention-unet archi- tecture,

    K. Trebing, T. Staczyk, and S. Mehrkanoon, “Smaat-unet: Precipitation nowcasting using a small attention-unet archi- tecture,”Pattern Recognition Letters, vol. 145, pp. 178–186, 2021

    2021

  92. [99]

    Swin transformer embedding unet for remote sensing image semantic segmentation,

    X. He, Y . Zhou, J. Zhao, D. Zhang, R. Yao, and Y . Xue, “Swin transformer embedding unet for remote sensing image semantic segmentation,”IEEE transactions on geoscience and remote sensing, vol. 60, pp. 1–15, 2022

    2022

  93. [100]

    Diffusion models beat gans on image synthesis,

    P. Dhariwal and A. Nichol, “Diffusion models beat gans on image synthesis,”Advances in neural information processing systems, vol. 34, pp. 8780–8794, 2021

    2021

  94. [101]

    Sim ´eoni, H

    O. Sim ´eoni, H. V . V o, M. Seitzer, F. Baldassarre, M. Oquab, C. Jose, V . Khalidov, M. Szafraniec, S. Yi, M. Ramamonjisoa et al., “Dinov3,”arXiv preprint arXiv:2508.10104, 2025

    2025 arXiv

  95. [102]

    Representation alignment for generation: Training diffusion transformers is easier than you think,

    S. Yu, S. Kwak, H. Jang, J. Jeong, J. Huang, J. Shin, and S. Xie, “Representation alignment for generation: Training diffusion transformers is easier than you think,”arXiv preprint arXiv:2410.06940, 2024

    2024 arXiv

  96. [103]

    Representation alignment for just image transformers is not easier than you think,

    J. Shin, J. Kim, and H. Shim, “Representation alignment for just image transformers is not easier than you think,”arXiv preprint arXiv:2603.14366, 2026

    2026

  97. [104]

    Gans trained by a two time-scale update rule converge to a local nash equilibrium,

    M. Heusel, H. Ramsauer, T. Unterthiner, B. Nessler, and S. Hochreiter, “Gans trained by a two time-scale update rule converge to a local nash equilibrium,”Advances in neural information processing systems, vol. 30, 2017

    2017

  98. [105]

    Diffusion trans- formers with representation autoencoders,

    B. Zheng, N. Ma, S. Tong, and S. Xie, “Diffusion trans- formers with representation autoencoders,”arXiv preprint arXiv:2510.11690, 2025

    2025 arXiv

  99. [106]

    Reconstruction vs. generation: Taming optimization dilemma in latent diffusion models,

    J. Yao, B. Yang, and X. Wang, “Reconstruction vs. generation: Taming optimization dilemma in latent diffusion models,” in Proceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 15 703–15 712

    2025

  100. [107]

    Repa-e: Unlocking vae for end-to-end tuning of latent dif- fusion transformers,

    X. Leng, J. Singh, Y . Hou, Z. Xing, S. Xie, and L. Zheng, “Repa-e: Unlocking vae for end-to-end tuning of latent dif- fusion transformers,” inProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, 2025, pp. 18 262– 18 272

    2025

  101. [108]

    Sigmoid loss for language image pre-training,

    X. Zhai, B. Mustafa, A. Kolesnikov, and L. Beyer, “Sigmoid loss for language image pre-training,” inProceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 11 975–11 986

    2023

  102. [109]

    Masked autoencoders are scalable vision learners,

    K. He, X. Chen, S. Xie, Y . Li, P. Doll ´ar, and R. Girshick, “Masked autoencoders are scalable vision learners,” inPro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 16 000–16 009

    2022

  103. [110]

    Multi-task learning as multi-objective optimization,

    O. Sener and V . Koltun, “Multi-task learning as multi-objective optimization,”Advances in neural information processing sys- tems, vol. 31, 2018

    2018

  104. [111]

    Pareto multi-task learning,

    X. Lin, H.-L. Zhen, Z. Li, Q.-F. Zhang, and S. Kwong, “Pareto multi-task learning,”Advances in neural information processing systems, vol. 32, 2019

    2019

  105. [112]

    Scaling laws for neural language models,

    J. Kaplan, S. McCandlish, T. Henighan, T. B. Brown, B. Chess, R. Child, S. Gray, A. Radford, J. Wu, and D. Amodei, “Scaling laws for neural language models,”arXiv preprint arXiv:2001.08361, 2020

    2001 arXiv

  106. [113]

    Training compute-optimal large language models,

    J. Hoffmann, S. Borgeaud, A. Mensch, E. Buchatskaya, T. Cai, E. Rutherford, D. Casas, L. A. Hendricks, J. Welbl, A. Clark et al., “Training compute-optimal large language models,” arXiv preprint arXiv:2203.15556, vol. 10, 2022

    2022 arXiv

  107. [114]

    Efficientnet: Rethinking model scaling for convolutional neural networks,

    M. Tan and Q. Le, “Efficientnet: Rethinking model scaling for convolutional neural networks,” inInternational conference on machine learning. PMLR, 2019, pp. 6105–6114

    2019

  108. [115]

    Spatial gram align- ment for ultra-high-resolution image synthesis,

    J. Zhang, X. Guo, and D. Huang, “Spatial gram align- ment for ultra-high-resolution image synthesis,”arXiv preprint arXiv:2605.20808, 2026

    2026 arXiv

  109. [116]

    Flashattention: Fast and memory-efficient exact attention with io-awareness,

    T. Dao, D. Fu, S. Ermon, A. Rudra, and C. R ´e, “Flashattention: Fast and memory-efficient exact attention with io-awareness,” Advances in neural information processing systems, vol. 35, pp. 16 344–16 359, 2022

    2022

  110. [117]

    General ocr theory: To- wards ocr-2.0 via a unified end-to-end model,

    H. Wei, C. Liu, J. Chen, J. Wang, L. Kong, Y . Xu, Z. Ge, L. Zhao, J. Sun, Y . Penget al., “General ocr theory: To- wards ocr-2.0 via a unified end-to-end model,”arXiv preprint arXiv:2409.01704, 2024

    2024 arXiv

  111. [118]

    Omnigen: Unified image generation,

    S. Xiao, Y . Wang, J. Zhou, H. Yuan, X. Xing, R. Yan, C. Li, S. Wang, T. Huang, and Z. Liu, “Omnigen: Unified image generation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2025, pp. 13 294– 13 304

    2025

  112. [119]

    Instantid: Zero-shot identity-preserving generation in seconds,

    Q. Wang, X. Bai, H. Wang, Z. Qin, A. Chen, H. Li, X. Tang, and Y . Hu, “Instantid: Zero-shot identity-preserving generation in seconds,”arXiv preprint arXiv:2401.07519, 2024

    2024 arXiv

  113. [120]

    Mantis: Interleaved multi-image instruction tuning,

    D. Jiang, X. He, H. Zeng, C. Wei, M. Ku, Q. Liu, and W. Chen, “Mantis: Interleaved multi-image instruction tuning,”arXiv 28 preprint arXiv:2405.01483, 2024

    2024 arXiv

  114. [121]

    Palette: Image-to-image diffusion models,

    C. Saharia, W. Chan, H. Chang, C. Lee, J. Ho, T. Salimans, D. Fleet, and M. Norouzi, “Palette: Image-to-image diffusion models,” inACM SIGGRAPH 2022 conference proceedings, 2022, pp. 1–10

    2022

  115. [122]

    When generative replay meets evolving deepfakes: Domain- aware relative weighting for incremental face forgery detec- tion,

    H. Shen, J. Cheng, R. Yan, Z. Wang, W. Peng, and B. Huang, “When generative replay meets evolving deepfakes: Domain- aware relative weighting for incremental face forgery detec- tion,”arXiv preprint arXiv:2511.18436, 2025

    2025 arXiv

  116. [124]

    Pixgs: Pixel-space diffusion for direct 3d gaussian splat generation,

    D. Cao and P. Nguyen-Ha, “Pixgs: Pixel-space diffusion for direct 3d gaussian splat generation,”arXiv preprint arXiv:2607.01803, 2026

    2026 arXiv

  117. [125]

    Pixworld: Unifying 3d scene generation and reconstruction in pixel space,

    S. Gao, Z. Wang, Q. Cao, D. Yu, C. Wang, and J.-W. Bian, “Pixworld: Unifying 3d scene generation and reconstruction in pixel space,”arXiv preprint arXiv:2607.05373, 2026

    2026 arXiv

  118. [126]

    Pointdit: Pixel-space diffusion for monocular geometry esti- mation,

    H. Xu, R. Wu, P. Henzler, N. Kalischek, M. Oechsle, F. Man- hardt, M. Pollefeys, A. Geiger, F. Tombari, and M. Niemeyer, “Pointdit: Pixel-space diffusion for monocular geometry esti- mation,”arXiv preprint arXiv:2607.02515, 2026

    2026 arXiv

  119. [127]

    Medsyn: text-guided anatomy-aware synthesis of high- fidelity 3-d ct images,

    Y . Xu, L. Sun, W. Peng, S. Jia, K. Morrison, A. Perer, A. Zandifar, S. Visweswaran, M. Eslami, and K. Batmanghe- lich, “Medsyn: text-guided anatomy-aware synthesis of high- fidelity 3-d ct images,”IEEE Transactions on Medical Imag- ing, vol. 43, no. 10, pp. 3648–3660, 2024

    2024

  120. [128]

    Pixel- level residual diffusion transformer: Scalable 3d ct volume generation,

    Z. Zhang, M. Hiller, K. A. Ehinger, and T. Drummond, “Pixel- level residual diffusion transformer: Scalable 3d ct volume generation,”arXiv preprint arXiv:2606.20112, 2026

    2026 arXiv

  121. [129]

    Ppdm: Pixel puzzling diffusion model for speed and memory efficient volumetric medical image translation,

    T. Chen, J. Hou, Y . Zhou, J. S. Duncan, C. Liu, and B. Zhou, “Ppdm: Pixel puzzling diffusion model for speed and memory efficient volumetric medical image translation,”arXiv preprint arXiv:2606.15323, 2026

    2026

  122. [130]

    Training diffusion models with reinforcement learning,

    K. Black, M. Janner, Y . Du, I. Kostrikov, and S. Levine, “Training diffusion models with reinforcement learning,” in International Conference on Learning Representations, vol. 2024, 2024, pp. 4965–4987

    2024

  123. [131]

    Diffusion model alignment using direct preference optimization,

    B. Wallace, M. Dang, R. Rafailov, L. Zhou, A. Lou, S. Purush- walkam, S. Ermon, C. Xiong, S. Joty, and N. Naik, “Diffusion model alignment using direct preference optimization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 8228–8238

    2024

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.