REVIEW 4 major objections 6 minor 31 references
HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression
T0 review · 4 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read A Hessian-aware mixed-precision post-training quantization converts pretrained learned image compression models into roughly 4.85x smaller integer models with under 1% rate-distortion loss and zero cross-platform decode errors.
desk verdict Abstract overclaims 'consistently outperforms' against the paper's own Table I; underneath that, a coherent and potentially useful PTQ framework for LIC. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the task-aware block sensitivity $\Omega_l(b_l) = \operatorname{Tr}(H_l) \cdot |L_{qp}(b_l)-L_{int8}|/|L_{int8}|$, where $\operatorname{Tr}(H_l)$ is the Hessian trace of the rate–distortion loss with respect to block $l$'s weights (estimated by randomized Hessian-vector products) and the ratio measures the task-loss degradation of quantizing that block alone to $b_l$ bits relative to an 8-bit reference. This score feeds a constrained integer optimization: minimize $\sum_l \Omega_l(b_l)$ subject to the average bit-width budget $\frac{1}{8L}\sum_l b_l \le \epsilon$. The search over the sensitivity-sorted block list is restricted to monotone contiguous partitions, which cuts the space from $k^L$ to $\sum_j \binom{k}{j}\binom{L-1}{j-1}$ (1326 candidates for $L=50$, $k=3$). A final block-wise reconstruction step optimizes quantization scales and adaptive rounding variables against a combined task and quantization loss.
What would settle it
Run HAMP-LIC on a small model with, say, $L=10$ quantizable blocks and candidate bit widths $\{2,4,8\}$, then exhaustively evaluate all $3^{10}=59049$ assignments under the same budget; if any non-monotone assignment achieves lower total sensitivity or better BD-rate than the monotone-contiguous one, the core search restriction is lossy. A second check: vary the 12-image calibration set (e.g., different content) and observe whether the claimed 0.59% BD-rate loss and the zero-error cross-platform result persist.
Extended reading notes
Core claim
The central claim is that a four-stage post-training pipeline can compress a pretrained learned image compression network by up to 4.85x (weights from 32-bit float to an average of 6.6 bits) while losing at most 0.59% BD-rate on Kodak for the Cheng2020 model, and can do so without retraining on a small 12-image calibration set. The same framework reduces cross-platform encoding–decoding failures from nearly total (24 out of 24 Kodak images for the full-precision model) to zero by producing integer-only arithmetic. Uniform fixed-precision quantization and existing mixed-precision methods for LIC are reported to lose more quality at the same compression (for example, the strongest baseline shows 0.89% BD-rate on Kodak at a 3.99x ratio), so the paper concludes that sensitivity-guided assignment is the correct route to low-bit deployment.
Load-bearing premise
The search for the best bit assignment only considers patterns where every more-sensitive block receives at least as many bits as every less-sensitive block, arranged in contiguous groups; the paper does not test whether a non-monotone assignment could be better.
Editorial extensions
If this is right
- Pretrained LIC models can be shrunk to about a fifth of their weight memory without retraining, opening the door to on-device image compression at near full-precision quality.
- Integer-only inference removes the CPU/GPU arithmetic discrepancies that make full-precision LIC models fail to decode, so mixed-platform encoding and decoding become reliable.
- Bit-operations drop by roughly 94% versus FP32 and 5–9% versus uniform 8-bit weights, because hyperprior path layers are assigned 4 bits while the main path keeps 6–8 bits.
- The method is demonstrated on two hyperprior-based backbones (Minnen2018 and Cheng2020) across several benchmark datasets, showing consistent gains over fixed- and mixed-precision baselines.
Reading between the lines
- If the monotone-contiguous partition assumption holds, the same Pareto-frontier search reduces exponential bit-allocation to polynomial for any block-structured network, not just learned image codecs; that is a testable transfer to other tasks.
- The sensitivity list is built by quantizing each block in isolation, so it ignores interactions among blocks; Step 4's sequential reconstruction compensates only partially, and a joint sensitivity estimator might find allocations the current search cannot.
- The zero cross-platform error result should be read as applying to the fully integer configuration (weights 6.6-bit, activations 8-bit); with floating-point activations, non-determinism could resurface, so deployment should scope the claim accordingly.
- Because calibration uses only 12 images from one dataset, the reported BD-rate figures may depend on calibration-content similarity; testing with a broader or content-matched calibration set would gauge that sensitivity.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes HAMP-LIC, a four-stage post-training quantization framework for learned image compression. Stage 1 computes per-block Hessian-trace sensitivity using Hutchinson's method; Stage 2 combines this with the relative rate-distortion loss degradation of quantizing each block to form a task-aware sensitivity; Stage 3 allocates bit-widths from {2,4,8} under an average-bit-width budget by enumerating monotone contiguous partitions of the sensitivity-sorted block list; Stage 4 performs block-wise scale and rounding optimization. The method is evaluated on Minnen2018 and Cheng2020 using the Kodak, Tecnick, and CLIC datasets, reporting up to 4.85x weight compression with 0.59% BD-rate loss on Cheng2020 (Kodak) and zero decoding errors in cross-platform CPU/GPU experiments.
Significance. If the reported results are reliable, HAMP-LIC would be a practical contribution: it offers a sensitivity-based allocation with a tractable search, and it addresses the real problem of numerical mismatch across hardware platforms. The paper includes a clear algorithm, an ablation of the sensitivity metric (Hessian vs Fisher), a bit-allocation comparison, and a BOPS analysis. However, the empirical support is weakened by single-run results without variance, the lack of code/data, the unvalidated monotone-contiguous search assumption, and the mismatch between the abstract's 'consistently outperforms' claim and Table I on Minnen2018. The cross-platform robustness result is interesting but only demonstrated for Cheng2020.
major comments (4)
- [IV-B2, Table I] Table I shows that on Minnen2018, HAMP-LIC (w=6.6, a=32) has BD-rate loss of 1.23% on Kodak and 3.75% on Tecnick, whereas FMPQ achieves 1.20% and 2.64% at 3.97x weight compression; the abstract's claim that HAMP-LIC 'consistently outperforms existing fixed- and mixed-precision PTQ methods across multiple datasets' is therefore not established by the paper's own results. Because the two methods are compared at different average bit-widths, a matched-size comparison or a BD-rate-vs-compression-ratio Pareto plot is needed to support the claimed dominance.
- [III-D, Eq. (7)] The reduction to 1326 candidates rests on the assumption that the optimal allocation lies among monotone contiguous partitions of the sensitivity-sorted block list. This assumption is unvalidated and load-bearing, since Step 3 determines every downstream result. Please compare against exhaustive search on a smaller network (e.g., L=10) or provide a bound on the suboptimality introduced by the monotone-contiguous restriction.
- [III-D] The text states that only the j=3 terms of Eq. (7) are enumerated, despite the reduced space containing 3 + 147 + 1176 = 1326 candidates covering j=1,2,3. Allocations with one or two distinct bit-widths (e.g., 8-bit and 4-bit blocks with an average of 6.6 bits) are feasible under the budget and could be optimal, so the search is incomplete as described. The paper should either enumerate the full reduced space or justify the restriction.
- [IV-A2, Table I] The results are single-run and no code or data are released; the calibration set is selected randomly without a reported seed, and the Hessian-trace estimation uses randomized Hutchinson probes. Without variance estimates or repeated trials, it is impossible to judge whether the reported margins (e.g., 0.59% vs 0.89% BD-rate loss for Cheng2020) are significant. Report error bars over at least three calibration-set draws or release the code to allow reproduction.
minor comments (6)
- [IV-C4] The text in Section IV-C4 refers to 'our FMPQ method' in the first sentence; this appears to be a typo for HAMP-LIC and should be corrected.
- [III-C, Eq. (4)] The symbol L is used both for the number of quantizable blocks and for the loss function in Eq. (3), which is confusing; please use separate notation (e.g., N_blocks).
- [III-D] The notation |B| is used for both the cardinality of the bit-width set and the size of the search space; clarify by using e.g., N_alloc for the latter.
- [Table II] Table II states 'Proposed HAMP-LIC' without specifying the weight/activation configuration; from Section IV-B2 this is presumably (w=6.6, a=8), and the caption should state this explicitly.
- [Fig. 2] The curves in Fig. 2 for 'Cheng2020 (MPP-LIC)' and 'Minnen2018 (MPP-LIC)' appear to be from the previous DCC paper, while the new method is called HAMP-LIC; the legend should be updated to reflect the proposed method's name.
- [Fig. 1] The caption of Fig. 1 contains stray symbols ('⋯Step1: acquire sensitivity list') that appear to be a rendering artifact; please check the final version.
Circularity Check
No significant circularity: the method is a calibration-set model-selection pipeline evaluated on held-out datasets, with no prediction that reduces by construction to its inputs.
full rationale
HAMP-LIC's derivation chain is self-contained. Step 2 builds task-aware sensitivities from Hessian traces and R-D losses measured on a 12-image calibration set, Step 3 solves a constrained integer allocation over those calibration-defined sensitivities, and Step 4 refines scales and rounding on the same calibration set. The reported BD-rate numbers are measured on held-out Kodak, Tecnick, and CLIC sets, so the headline compression-quality result is not constructed from the evaluation data. The appearance of the R-D loss both inside the sensitivity objective and as the final evaluation metric is standard model selection rather than circularity: no parameter is fitted to the test data, and no claimed result is algebraically identical to an input by construction (no Eq. X reduces to Eq. Y). The self-citation to the authors' DCC paper (MPP-LIC [8]) is a provenance statement and is not load-bearing; the method is fully described and evaluated in the present paper. The monotone-partition restriction in Eq. (7) and the Table I comparison against FMPQ on Minnen2018 are correctness/robustness concerns, not circularity, because they concern whether the solution is globally optimal and whether the headline claim is fully supported, not whether the output is equivalent to the input.
Assumptions & free parameters
free parameters (4)
- epsilon size budget =
0.75 (with 10% tolerance, effective average bit-width 6.6)
- lambda_t task/reconstruction balance =
1.0
- bit-width candidate set B =
{2, 4, 8}
- calibration set size =
12 images from CLIC
assumptions (5)
- domain assumption The optimal bit allocation lies among monotone non-increasing bit-widths over the sensitivity ranking.
- domain assumption Summing per-block task-aware sensitivities is an adequate proxy for total R-D loss under simultaneous multi-block quantization.
- domain assumption A 12-image calibration set from CLIC is representative of Kodak, Tecnick, and CLIC test distributions.
- domain assumption Integer quantization eliminates cross-platform encoding-decoding mismatches caused by floating-point non-determinism.
- standard math Hutchinson's method gives a sufficiently accurate estimate of the Hessian trace.
Cite this review
Pith. "Pith review of HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression." pith.science (2026). https://pith.science/paper/YMPHRRUQ
@misc{pith2026260812239,
author = {Pith},
title = {Pith review of: HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression},
year = {2026},
howpublished = {\url{https://pith.science/paper/YMPHRRUQ}},
note = {Machine review of arXiv:2608.12239}
}
read the original abstract
Use this plain-text version for the arXiv abstract field: Learned image compression (LIC) models achieve strong rate-distortion performance but are hindered by high computational complexity and encoding-decoding mismatches across heterogeneous hardware platforms. Uniform fixed-precision quantization alleviates these issues but suffers severe quality degradation at low bit widths because it ignores differences in the quantization sensitivities of individual layers. To enable efficient and accurate low-bit deployment of pretrained LIC models, we propose HAMP-LIC, a Hessian-aware mixed-precision post-training quantization (PTQ) framework with a four-stage optimization strategy. First, block-wise sensitivity is estimated from the Hessian trace to capture second-order importance. Second, a task-aware refinement module adjusts these sensitivities by jointly considering quantization distortion and rate-distortion performance. Third, guided by the refined sensitivity profile, bit widths are allocated under a global model-size constraint to balance efficiency and reconstruction quality. Finally, block-wise reconstruction using a small calibration set further suppresses quantization error. Experiments on representative LIC models, including Minnen2018 and Cheng2020, demonstrate that HAMP-LIC achieves up to 4.85x model compression with as little as 0.59% BD-rate loss. It consistently outperforms existing fixed- and mixed-precision PTQ methods across multiple datasets while completely eliminating cross-platform encoding-decoding errors.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[2]
Integer networks for data compression with latent-variable models,
J. Ball ´e, N. Johnston, and D. Minnen, “Integer networks for data compression with latent-variable models,” inInternational Conference on Learning Representations (ICLR). OpenReview.net, 2019. [Online]. Available: https://openreview.net/forum?id=S1zz2i0cY7
work page 2019
-
[3]
Efficient neural image decoding via fixed-point inference,
W. Hong, T. Chen, M. Lu, S. Pu, and Z. Ma, “Efficient neural image decoding via fixed-point inference,”IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 31, no. 9, pp. 3618–3630, 2021
work page 2021
-
[4]
Post-training quantization for cross-platform learned image compression,
D. He, Z. Yang, Y . Chen, Q. Zhang, H. Qin, and Y . Wang, “Post-training quantization for cross-platform learned image compression,”CoRR, vol. abs/2202.07513, 2022
arXiv 2022
-
[5]
Rate-distortion optimized post-training quantization for learned image compression,
J. Shi, M. Lu, and Z. Ma, “Rate-distortion optimized post-training quantization for learned image compression,”IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 34, no. 5, pp. 3082–3095, 2024
work page 2024
-
[6]
Flexible mixed precision quantization for learned image compression,
M. A. F. Hossain, Z. Duan, and F. M. Zhu, “Flexible mixed precision quantization for learned image compression,”IEEE International Conference on Multimedia and Expo (ICME), pp. 1–8, 2024. [Online]. Available: https://api.semanticscholar.org/CorpusID:272999263
work page 2024
-
[7]
HAWQ: hessian aware quantization of neural networks with mixed-precision,
Z. Dong, Z. Yao, A. Gholami, M. W. Mahoney, and K. Keutzer, “HAWQ: hessian aware quantization of neural networks with mixed-precision,” in International Conference on Computer Vision (ICCV). IEEE, 2019, pp. 293–302
work page 2019
-
[8]
Mpp-lic: Mixed precision post-training quantization for learned image compression,
Y . Zhang, W. Shen, T. Gao, N. Zhang, and P. Wang, “Mpp-lic: Mixed precision post-training quantization for learned image compression,” in 2026 Data Compression Conference (DCC), 2026, pp. 487–487
work page 2026
-
[9]
Quantization and training of neural networks for efficient integer-arithmetic-only inference,
B. Jacob, S. Kligys, B. Chen, M. Zhu, M. Tang, A. Howard, H. Adam, and D. Kalenichenko, “Quantization and training of neural networks for efficient integer-arithmetic-only inference,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
work page 2018
Show all 31 references
-
[10]
Learning to quantize deep networks by optimizing quantization inter- vals with task loss,
S. Jung, C. Son, S. Lee, J. Son, J. Han, Y . Kwak, and S. J. Hwang, “Learning to quantize deep networks by optimizing quantization inter- vals with task loss,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
2019
-
[11]
Post training 4- bit quantization of convolutional networks for rapid-deployment,
R. Banner, Y . Nahshan, E. Hoffer, and D. Soudry, “Post training 4- bit quantization of convolutional networks for rapid-deployment,” in Advances in Neural Information Processing Systems (NeurIPS), 2019
2019
-
[12]
Gptq: Accurate post-training quantization for generative pre-trained transformers,
E. Frantar, S. Ashkboos, T. Hoefler, and D. Alistarh, “Gptq: Accurate post-training quantization for generative pre-trained transformers,” in Advances in Neural Information Processing Systems (NeurIPS), 2022
2022
-
[13]
Up or down? adaptive rounding for post-training quantization,
M. Nagel, R. A. Amjad, M. van Baalen, C. Louizos, and T. Blankevoort, “Up or down? adaptive rounding for post-training quantization,” in International Conference on Machine Learning (ICML), 2020
2020
-
[14]
BRECQ: pushing the limit of post-training quantization by block reconstruction,
Y . Li, R. Gong, X. Tan, Y . Yang, P. Hu, Q. Zhang, F. Yu, W. Wang, and S. Gu, “BRECQ: pushing the limit of post-training quantization by block reconstruction,” inInternational Conference on Learning Representations (ICLR). OpenReview.net, 2021. [Online]. Available: https://op...
2021
-
[15]
Improving post training neural quantization: Layer-wise calibration and integer programming,
I. Hubara, Y . Nahshan, Y . Hanani, R. Banner, and D. Soudry, “Improving post training neural quantization: Layer-wise calibration and integer programming,”CoRR, vol. abs/2006.10518, 2020
2006 arXiv
-
[16]
Qdrop: Randomly drop- ping quantization for extremely low-bit post-training quantization,
X. Wei, R. Gong, Y . Li, X. Liu, and F. Yu, “Qdrop: Randomly drop- ping quantization for extremely low-bit post-training quantization,” in International Conference on Learning Representations (ICLR). Open- Review.net, 2022
2022
-
[17]
Q-LIC: quantizing learned image compres- sion with channel splitting,
H. Sun, L. Yu, and J. Katto, “Q-LIC: quantizing learned image compres- sion with channel splitting,”IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), vol. 35, no. 4, pp. 3798–3811, 2025
2025
-
[18]
Haq: Hardware-aware automated quantization with mixed precision,
K. Wang, Z. Liu, Y . Lin, J. Lin, and S. Han, “Haq: Hardware-aware automated quantization with mixed precision,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019
2019
-
[19]
Mixed precision quantization of convnets via differentiable neural architecture search,
B. Wu, Y . Wang, P. Zhang, Y . Tian, P. Vajda, and K. Keutzer, “Mixed precision quantization of convnets via differentiable neural architecture search,”CoRR, vol. abs/1812.00090, 2018
2018 arXiv
-
[20]
Adaptive quantization for deep neural network,
Y . Zhou, S. Moosavi-Dezfooli, N. Cheung, and P. Frossard, “Adaptive quantization for deep neural network,” inAssociation for the Advance- ment of Artificial Intelligence (AAAI). AAAI Press, 2018, pp. 4596– 4604
2018
-
[21]
SDQ: stochastic differentiable quantization with mixed precision,
X. Huang, Z. Shen, S. Li, Z. Liu, X. Hu, J. Wicaksana, E. P. Xing, and K. Cheng, “SDQ: stochastic differentiable quantization with mixed precision,” inInternational Conference on Machine Learning (ICML), ser. Proceedings of Machine Learning Research, vol. 162. PMLR, 2022, pp. ...
2022
-
[22]
Fracbits: Mixed precision quantization via frac- tional bit-widths,
L. Yang and Q. Jin, “Fracbits: Mixed precision quantization via frac- tional bit-widths,” inAssociation for the Advancement of Artificial Intelligence (AAAI). AAAI Press, 2021, pp. 10 612–10 620
2021
-
[23]
HAWQ-V2: Hessian aware trace-weighted quantization of neural networks,
Z. Dong, Z. Yao, Y . Cai, D. Arfeen, A. Gholami, M. W. Mahoney, and K. Keutzer, “HAWQ-V2: Hessian aware trace-weighted quantization of neural networks,” inNeural Information Processing Systems (NIPS), vol. 33, 2020, pp. 18 518–18 529
2020
-
[24]
Joint autoregressive and hi- erarchical priors for learned image compression,
D. Minnen, J. Ball ´e, and G. Toderici, “Joint autoregressive and hi- erarchical priors for learned image compression,”Neural Information Processing Systems (NIPS), 2018
2018
-
[25]
Learned image com- pression with discretized gaussian mixture likelihoods and attention modules,
Z. Cheng, H. Sun, M. Takeuchi, and J. Katto, “Learned image com- pression with discretized gaussian mixture likelihoods and attention modules,” inProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 7936–7945
2020
-
[26]
Compressai: a pytorch library and evaluation platform for end-to-end compression research,
J. B ´egaint, F. Racap’e, S. Feltman, and A. Pushparaja, “Compressai: a pytorch library and evaluation platform for end-to-end compression research,”ArXiv, vol. abs/2011.03029, 2020. [Online]. Available: https://api.semanticscholar.org/CorpusID:226254313
2011 arXiv
-
[27]
Adam: A method for stochastic optimization,
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” International Conference for Learning Representations (ICLR), 2015
2015
-
[28]
Bpg image format,
Bellard, “Bpg image format,” https://bellard.org/bpg/, 2014
2014
-
[29]
Vvc test model (vtm),
JVET, “Vvc test model (vtm),” https://vcgit.hhi.fraunhofer.de/jvet/ VVCSoftware VTM, 2018
2018
-
[30]
Kodak lossless true color image suite,
E. K. Company, “Kodak lossless true color image suite,” http://r0k.us/ graphics/kodak/, 1999
1999
-
[31]
Testimages: A large data archive for display and algorithm testing,
N. Asuni and A. Giachetti, “Testimages: A large data archive for display and algorithm testing,”J. Graph. Tools, vol. 17, pp. 113–125, 2013. [Online]. Available: https://api.semanticscholar.org/CorpusID:8082012
2013
-
[32]
Workshop and challenge on learned image compression (clic2020),
T. George, S. Wenzhe, T. Radu, T. Lucas, B. Johannes, A. Eirikur, J. Nick, and M. Fabian, “Workshop and challenge on learned image compression (clic2020),” CVPR, 2020. [Online]. Available: http://www.compression.cc
2020
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.