The reviewed record of science sign in
Pith

arxiv: 2202.05492 · v2 · pith:KBL5H57N · submitted 2022-02-11 · eess.IV · cs.CV

Entroformer: A Transformer-based Entropy Model for Learned Image Compression

Yichen Qian , Ming Lin , Xiuyu Sun , Zhiyu Tan , Rong Jin This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:KBL5H57Nrecord.jsonopen to challenge →

classification eess.IV cs.CV
keywords imagecompressionentroformerentropymodeldecodingdependenciesdistribution
0
0 comments X
read the original abstract

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules. Previous works build entropy models upon convolutional neural networks which are inefficient in capturing global dependencies. In this work, we propose a novel transformer-based entropy model, termed Entroformer, to capture long-range dependencies in probability distribution estimation effectively and efficiently. Different from vision transformers in image classification, the Entroformer is highly optimized for image compression, including a top-k self-attention and a diamond relative position encoding. Meanwhile, we further expand this architecture with a parallel bidirectional context model to speed up the decoding process. The experiments show that the Entroformer achieves state-of-the-art performance on image compression while being time-efficient.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Dual-Constrained Diffusion Image Compression for Operational Rate-Distortion-Perception Optimization

    cs.CV 2026-06 unverdicted novelty 7.0

    DCIC uses dual constraints on a diffusion decoder to realize adjustable RDP operating points in neural image compression without extra rate cost.

  2. Benchmarking Neural Speech Compression from a Rate-Distortion Perspective

    eess.AS 2026-06 unverdicted novelty 6.0

    ECC integrates hyperprior side information, channel-wise context, latent residual prediction, temporal modeling, and entropy skip into a learned entropy model, yielding 39.9% and 76.3% average BD-rate reductions on Vi...

  3. LANCE: Locally Adaptive Neural Context Estimation for Overfitted Image Compression

    eess.IV 2026-05 unverdicted novelty 6.0

    LANCE extends OIC frameworks with a spatial hyperprior and predictive coding scheme, reporting BD-rate gains of 1.4-3% over Cool-Chic 4.0 on Kodak and CLIC.

  4. SAMIC: A Lightweight Semantic-Aware Mamba for Efficient Perceptual Image Compression

    cs.CV 2026-05 unverdicted novelty 5.0

    SAMIC introduces semantic-aware Mamba blocks and SVD-based redundancy reduction to achieve efficient perceptual image compression with improved rate-distortion-perception tradeoffs.