Pith. sign in

REVIEW 16 cited by

MDTv2: Masked Diffusion Transformer is a Strong Image Synthesizer

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2303.14389 v2 pith:3VRCM3WR submitted 2023-03-25 cs.CV

Shanghua Gao , Pan Zhou , Ming-Ming Cheng , Shuicheng Yan This is my paper · ORCID
classification cs.CV
keywords imagediffusioncontextuallearningmaskedmdtv2tokenstransformer
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this issue, we propose a Masked Diffusion Transformer (MDT) that introduces a mask latent modeling scheme to explicitly enhance the DPMs' ability to contextual relation learning among object semantic parts in an image. During training, MDT operates in the latent space to mask certain tokens. Then, an asymmetric diffusion transformer is designed to predict masked tokens from unmasked ones while maintaining the diffusion generation process. Our MDT can reconstruct the full information of an image from its incomplete contextual input, thus enabling it to learn the associated relations among image tokens. We further improve MDT with a more efficient macro network structure and training strategy, named MDTv2. Experimental results show that MDTv2 achieves superior image synthesis performance, e.g., a new SOTA FID score of 1.58 on the ImageNet dataset, and has more than 10x faster learning speed than the previous SOTA DiT. The source code is released at https://github.com/sail-sg/MDT.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 16 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Text Template Tokens Are Implicit Semantic Registers in Diffusion Transformers

    cs.CV 2026-07 conditional novelty 7.0 of 10

    Chat-template tokens in LLM-conditioned DiTs act as implicit semantic registers: they absorb object identity from image latents and maintain it, while direct prompt-reading heads are causally inert.

  2. Coupled Continuous-Discrete Generation for Scene Text Image Super-Resolution

    cs.CV 2026-08 conditional novelty 6.0 of 10

    A shared transformer trained with continuous flow matching for images and discrete diffusion for text jointly restores scene text images and reads out their characters, removing the external OCR prior.

  3. Twins: Learn to Predict Unified Representations with Focal Loss

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Channel-wise concatenation of SigLIP2 and Flux VAE features into one token, trained with a focal-style flow-matching loss, yields a unified representation with 1.59 gFID on ImageNet 256 and VAE-level reconstruction.

  4. SRC-Flow: Compact Semantic Representations Enable Normalizing Flows for Image Generation

    cs.CV 2026-05 unverdicted novelty 6.0 of 10

    SRC-Flow compresses RAE features via a Semantic Representation Compressor into a low-dimensional space, enabling normalizing flows to reach gFID 1.65 on ImageNet 256x256 and 2.07 on 512x512 while retaining exact likelihoods.

  5. Self-transcendence: Is External Feature Guidance Indispensable for Accelerating Diffusion Transformer Training?

    cs.CV 2026-01 conditional novelty 6.0 of 10

    A self-supervised two-stage training method—VAE-latent feature alignment then feature-level classifier-free guidance—lets DiT models match or beat DINO-guided REPA training without any external feature extractor.

  6. MixFlow Training: Alleviating Exposure Bias with Slowed Interpolation Mixture

    cs.CV 2025-12 conditional novelty 6.0 of 10

    Training diffusion models on a mixture of higher-noise interpolations (MixFlow) improves generation FID across SiT, REPA, RAE and SD3.5, reaching ImageNet 256 gFID 1.43 after post-training.

  7. REGLUE Your Latents with Global and Local Semantics for Entangled Diffusion

    cs.CV 2025-12 conditional novelty 6.0 of 10

    Nonlinear multi-layer compression of frozen VFM patch semantics, jointly denoised with VAE latents, improves ImageNet 256x256 FID (12.9 vs 15.2 for REG at SiT-B/2, 400K) and accelerates convergence over REPA/ReDi/REG.

  8. Transition Models: Rethinking the Generative Learning Objective

    cs.LG 2025-09 conditional novelty 6.0 of 10

    TiM trains a single diffusion-type model on arbitrary time-interval transitions, achieving strong one-step and multi-step text-to-image generation with 865M parameters.

  9. Rethinking Discrete Tokens: Treating Them as Conditions for Continuous Autoregressive Image Synthesis

    cs.CV 2025-07 conditional novelty 6.0 of 10

    DisCon treats discrete image tokens as conditioning signals rather than targets, letting a continuous autoregressive model refine details and reach gFID 1.38 on ImageNet-256.

  10. Native-Resolution Image Synthesis

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A single diffusion transformer trained on native-resolution ImageNet achieves state-of-the-art FID at 256 and 512, and extrapolates to 1024 and 1536 with moderate degradation.

  11. Plug-and-Play Context Feature Reuse for Efficient Masked Generation

    cs.CV 2025-05 conditional novelty 6.0 of 10

    ReCAP interleaves full model evaluations with lightweight steps that reuse cached context features, delivering up to 2.4x faster masked generation with minimal FID loss.

  12. REPA Works Until It Doesn't: Early-Stopped, Holistic Alignment Supercharges Diffusion Training

    cs.CV 2025-05 conditional novelty 6.0 of 10

    HASTE trains diffusion transformers faster by aligning student features and attention maps with a DINOv2 teacher early in training and then switching the alignment off, matching vanilla SiT quality on ImageNet 256x256...

  13. Learning on the Manifold: Unlocking Standard Diffusion Transformers with Representation Encoders

    cs.LG 2026-02 conditional novelty 5.0 of 10

    Training flow matching along sphere geodesics with a curvature-aware loss weight lets standard DiT-B converge on DINOv2 features (FID 3.37 with guidance), contradicting the need for width scaling.

  14. EscherNet++: Simultaneous Amodal Completion and Scalable View Synthesis through Masked Fine-Tuning and Enhanced Feed-Forward 3D Reconstruction

    cs.CV 2025-07 conditional novelty 5.0 of 10

    A masked fine-tuned diffusion model simultaneously completes occluded views and synthesizes novel viewpoints, enabling fast feed-forward 3D reconstruction.

  15. Improving Joint Embedding Predictive Architecture with Diffusion Noise

    cs.CV 2025-07 conditional novelty 4.0 of 10

    Injecting EDM-style noise into masked-token position embeddings and adding two auxiliary losses improves I-JEPA's linear-probing accuracy by about 1.5 points on ImageNet-1K.

  16. DiverseDiT++: Quantifying, Analyzing, and Promoting Representation Diversity in Diffusion Transformers

    cs.CV 2026-08

Pith tools