Pith. sign in

REVIEW 7 cited by

SparseDM: Toward Sparse Efficient Diffusion Models

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2404.10445 v4 pith:5TMCAJXC submitted 2024-04-16 cs.LG cs.AI

Kafeng Wang , Jianfei Chen , He Li , Zhenpeng Mi , Jun Zhu This is my paper · ORCID
classification cs.LGcs.AI
keywords modelsdiffusionsparsedeploymentduringinferencemacsmasks
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Diffusion models represent a powerful family of generative models widely used for image and video generation. However, the time-consuming deployment, long inference time, and requirements on large memory hinder their applications on resource constrained devices. In this paper, we propose a method based on the improved Straight-Through Estimator to improve the deployment efficiency of diffusion models. Specifically, we add sparse masks to the Convolution and Linear layers in a pre-trained diffusion model, then transfer learn the sparse model during the fine-tuning stage and turn on the sparse masks during inference. Experimental results on a Transformer and UNet-based diffusion models demonstrate that our method reduces MACs by 50% while maintaining FID. Sparse models are accelerated by approximately 1.2x on the GPU. Under other MACs conditions, the FID is also lower than 1 compared to other methods.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. TinyFusion: Diffusion Transformers Learned Shallow

    cs.CV 2024-12 conditional novelty 7.0 of 10

    A learnable depth-pruning method that optimizes post-fine-tuning recoverability produces a 14-layer DiT-XL with FID 2.86 and a 2x speedup at 7% of the original training cost.

  2. Importance-Aware OBS Pruning for Diffusion Models

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Injecting spatial importance maps (e.g., CFG delta) into the OBS Hessian improves subject preservation in pruned diffusion models at high sparsity, but gains over the baseline are small and without error bars.

  3. Playing with Transformer at 30+ FPS via Next-Frame Diffusion

    cs.CV 2025-06 conditional novelty 6.0 of 10

    Next-Frame Diffusion combines block-wise causal attention, consistency distillation, and action-based speculative sampling to generate action-conditioned Minecraft video at over 30 FPS on an A100 with a 310M parameter model.

  4. CAT Pruning: Cluster-Aware Token Pruning For Text-to-Image Diffusion Models

    cs.CV 2025-02 conditional novelty 6.0 of 10

    A token-pruning cache method cuts diffusion model computation by roughly half while keeping image quality, using noise magnitude, spatial clustering, and selection balance.

  5. Importance-Based Token Merging for Efficient Image and Video Generation

    cs.CV 2024-11 conditional novelty 6.0 of 10

    A token-merging method that anchors computation on high-CFG-importance tokens improves generation quality at fixed inference speedups.

  6. LazyDiT: Lazy Learning for the Acceleration of Diffusion Transformers

    cs.LG 2024-12 conditional novelty 5.0 of 10

    LazyDiT learns small gates that decide when to reuse cached layer outputs, cutting diffusion transformer compute by up to half while matching or beating DDIM quality.

  7. Pruning for Sparse Diffusion Models based on Gradient Flow

    cs.LG 2025-01 conditional novelty 3.0 of 10

    Progressive soft pruning with the GraSP gradient-flow criterion gives small FID improvements over one-shot pruning on DDPMs at 50% sparsity.

Pith tools