Pith. sign in

REVIEW 4 major objections 4 minor 155 references

MixQuant: Adaptive Mixed-Precision Quantization for Large Language Models

T0 review · 4 major / 4 minor · reviewed 2026-08-01 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A layer's quantization sensitivity in an LLM depends on upstream bitwidths; MixQuant marginalizes errors over random quantized contexts, yielding budget-agnostic scores that beat every baseline tested.

desk verdict Genuinely new idea about context-dependent layer sensitivity, empirically strong but with fixable evidence gaps—worth a serious referee. read the letter →

arxiv 2607.23047 v1 pith:UGGK55AP submitted 2026-07-25 cs.LG cs.AI

Ashitabh Misra , Madhav Agrawal , Arham Jain , Tarek Abdelzaher This is my paper · ORCID
classification cs.LGcs.AI
keywords mixed-precisionquantizationadaptivepost-traininglargelanguagemodelsmean-fieldapproximationbitallocationgreedycontext-awaresensitivity
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to show that mixed-precision quantization of large language models is being scored in the wrong context. Existing adaptive methods measure each layer's sensitivity against a full-precision (FP16) network, but at deployment every layer is quantized, and the paper demonstrates that a layer's NMSE and downstream allocation shift by up to two to three orders of magnitude depending on the bitwidths of its upstream layers. MixQuant's remedy is a mean-field marginalization: each layer's distortion is averaged over random quantized upstream configurations, giving budget-agnostic scores, plus quantizer parameters calibrated on plans the allocator itself produces and a tail penalty that steers spare budget away from the lowest bitwidths. If these claims hold, a single offline calibration can serve any memory budget at deployment with a cheap greedy solve, improving average downstream accuracy by up to 8 points and cutting perplexity from 12.43 to 10.70 at the tightest budget across Llama-3.2-3B, Llama-2-7B, and Mistral-7B under both AWQ and GPTQ.

What carries the argument

The load-bearing object is the decoupled distortion score, the expected normalized mean-squared error of quantizing module ℓ to b bits when upstream bitwidths are drawn i.i.d. from the uniform prior over the admissible bit set, estimated by K=10 Monte Carlo draws. This mean-field marginalization makes each module's score independent of the other modules' assigned bitwidths, which in turn makes the ensuing multiple-choice knapsack objective additive and budget-agnostic. Supporting machinery: plan-aware technique parameters, where the feasible budget range is bucketed and each bucket's parameters are averaged over anchor plans the greedy solver produces; and the tail regularizer, which discoun

What would settle it

Re-run the MixQuant pipeline but sample the upstream contexts in Stage 1 from plans the greedy allocator itself produces across the budget range, instead of from the uniform prior; if the resulting bit allocations and downstream accuracies shift materially, or if increasing K from 10 to several hundred changes the distortion table, the mean-field marginalization is not genuinely budget-agnostic. A second check: test at a budget far outside the range used to build the Stage-2 parameter buckets and see whether the advantage over FP16-scored baselines collapses, which would indicate the plan-awar

Watch

Extended reading notes

Core claim

The central discovery is that per-layer sensitivity scores computed on the FP16 model are systematically unrepresentative of the fully quantized networks actually deployed: the output distortion of a module, and even the bit allocation it induces through a solver, varies by up to two to three orders of magnitude across different quantized upstream contexts. MixQuant replaces the unknown deployment context with a random prior: it draws upstream bitwidths independently and uniformly from the admissible bit set, measures each module's normalized mean-squared error under K random contexts, and averages. The resulting decoupled distortion table depends only on (module, bitwidth), so it is budget-

Load-bearing premise

The load-bearing premise is that averaging each module's distortion over ten independently, uniformly drawn upstream bitwidths correctly ranks module upgrades under the actual deployment distribution, which is neither independent nor uniform — it is produced by the greedy solver under a memory budget, with many modules pinned at the floor bitwidth, and the paper gives no analysis of this mismatch.

Editorial extensions

If this is right

  • One offline calibration serves any memory budget at deployment: a new budget triggers a single O(L|B| log L) greedy pass over the precomputed distortion table, with no re-calibration.
  • The largest gains appear where quantization is most aggressive — at the tightest budgets many modules sit at the floor and upstream drift is largest — so the method is most valuable for low-memory edge deployment.
  • The framework wraps any base quantizer whose parameters can be recalibrated on a given context; the paper demonstrates this for AWQ and GPTQ, so other PTQ techniques should inherit the same benefit.
  • Scoring against the FP16 network is a correctable bias: even strong FP16-scored metrics paired with an exact ILP solver are outperformed by the context-averaged scores, and the greedy allocation matches the ILP's downstream quality at a fraction of the cost.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The uniform prior over upstream bitwidths is likely a loose surrogate for the contexts the greedy solver actually produces — at a given budget many modules are pinned at the floor, not spread uniformly — so an allocator-aware prior (sampling contexts from solver-generated plans) could rank upgrades more accurately at extreme budgets; this is a directly testable variant.
  • The context-dependence finding suggests a broader design principle for LLM quantization: any module whose input statistics are perturbed by upstream compression (activation quantization, KV-cache compression, low-rank approximations) should be scored under those perturbed contexts rather than against a full-precision reference; testing this on activation-only quantization would be a natural next e
  • The tail penalty saturates beyond γ≈5, and the mechanism implies the penalty changes results only when a few modules would otherwise monopolize spare budget; comparing plan bitwidth distributions at γ=0 and γ=10 would let practitioners set γ by inspection rather than by sweep.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper proposes MixQuant, an adaptive mixed-precision quantization framework for LLMs. Stage 1 computes per-module distortion scores by averaging NMSE over K random quantized upstream contexts drawn from a uniform prior. Stage 2 calibrates base-quantizer parameters (GPTQ Hessians, AWQ scales/clipping) on anchor plans generated by the same greedy solver used at deployment. Stage 3 adds a tail penalty that discourages leaving modules at the lowest bitwidths. A single greedy multiple-choice knapsack solve then serves any memory budget at deployment. The evaluation covers Llama-3.2-3B, Llama-2-7B, and Mistral-7B with AWQ and GPTQ across three budgets per model, reporting consistent improvements over FP16-scored metrics, LIM, and CoopQ, plus a component ablation and a tail-penalty sensitivity sweep.

Significance. If the claims hold, MixQuant is a practically valuable contribution: one offline calibration supports arbitrary deployment budgets, and the reported gains at tight budgets are large (e.g., 7–8 average accuracy points on Llama-3.2-3B at 1.25 GB). The paper has real strengths: the component ablation (Table 5) shows that the distortion table carries signal and that the greedy solver matches an ILP on the surrogate objective; the tail-penalty sweep (Figure 4) shows a saturating benefit; and the evaluation is broad in models, base quantizers, and budgets. However, the central theoretical device—the uniform-prior mean-field score—is not validated against the actual distribution of contexts produced by the allocator, and the empirical claims lack any error bars or multiple-seed analysis. These issues need to be addressed before the contribution can be fully credited as stated.

major comments (4)
  1. [§4.1, Eq. (4)] The uniform prior π(b_{<ℓ}) = ∏ Unif(B) is an unvalidated assumption. Figure 2 documents that per-module NMSE varies by 2–3 orders of magnitude across contexts, and Figure 2b shows that the induced allocations vary with context. Yet the paper never compares the distortion table D_π with one computed under the empirical distribution of contexts generated by Algorithm 1 at the actual deployment budgets. The component ablation (Table 5) demonstrates that the score table carries signal relative to no scores or reversed scores, but it does not test whether the uniform weighting is the right weighting. Please add (i) a direct comparison of allocations and downstream metrics under the uniform prior vs. an allocator-induced context distribution, and (ii) a sensitivity analysis over the prior (e.g., different marginal bitwidth distributions or an empirical prior). Without this, the claim that mea
  2. [§5, Tables 2–4] All results are single point estimates with no error bars, multiple seeds, or confidence intervals. This matters because the scoring procedure is stochastic: K=10 Monte Carlo draws per (module, bitwidth) pair (§4.1), and the MC estimator is unlikely to resolve the 2–3 orders-of-magnitude variation shown in Figure 2a. Since the paper repeatedly claims improvement 'in every setting,' please report means and variances over independent MC seeds and, if feasible, multiple calibration runs. A single run cannot support claims built on margins as small as 0.8 points (Table 3, Llama-2-7B at 4.0 GB under GPTQ).
  3. [§5, baselines paragraph] LIM and CoopQ are evaluated on bitwidth set B={3,...,8}, while the paper itself acknowledges they 'were designed and validated on small bitwidth sets, typically {2,3,4}.' Figure 3 confirms they collapse to the extremes of B. This makes the headline claim 'outperforms adaptive and mixed-precision baselines in every setting' less informative: for these two baselines the comparison is outside their validated operating range. Please either evaluate LIM and CoopQ on their native bitwidth sets (and clearly report the corresponding memory budgets), or explicitly restrict the claim to methods designed for wide bitwidth sets. The controlled FP16-prior baselines are informative, but the LIM/CoopQ comparison needs to be reframed or re-run.
  4. [§4.2 and Table 5] The plan-aware parameter calibration is stated as a contribution, but its individual effect is never isolated. The text acknowledges that for AWQ the averaging of parameter sets 'is a heuristic' (§4.2), and Table 5 ablates only the full Stage 1+Stage 2 pipeline versus score-free and reversed allocations. There is no comparison of plan-aware µ versus FP16-calibrated µ, nor a sensitivity study over the number of intervals I and anchor plans J. Given that this component is claimed to exploit the fact that 'the technique and the solver are fixed before deployment,' please add an ablation that turns Stage 2 on/off or compares against FP16 calibration, and report sensitivity to I and J.
minor comments (4)
  1. [Figure 4] The y-axis labels (0, -0.1, -0.3, -1, -3) appear to be on a reciprocal or log scale but are not labeled as such. Please clarify the axis scale or use a standard log axis.
  2. [Table 5] The row label 'Mem. budget' is terse and could be misread as the memory budget itself. Consider renaming to 'Budget-only (no scores)' for clarity.
  3. [§3 and Algorithm 1] Notation is overloaded: b denotes a full plan in §3, a single module bitwidth in Eq. (5)–(6), and the current plan in Algorithm 1, while b^+ denotes a successor bitwidth. Please make the level of the variable explicit throughout.
  4. [§5] The text alternates between 'WikiText-2' and 'Wikitext' (e.g., 'Wikitext PPL' in Table 1). Please standardize the spelling.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: core claims are measured on held-out tasks and the only self-citation is non-load-bearing.

full rationale

MixQuant's derivation chain is self-contained: Stage 1 computes d_bar_l(b) by Monte Carlo averaging over a stated uniform prior (Eq. 4), Stage 2 calibrates technique parameters on anchor plans produced by the same greedy solver, and Stage 3 adds a tuned tail penalty, with final allocations evaluated on held-out WikiText-2 validation and EleutherAI tasks. No fitted constant is renamed as a prediction: the reported accuracy and perplexity gains are measured outcomes, not algebraic consequences of the calibration quantities. The only self-citation (Misra et al. 2025 for the MCKP formulation, Section 3) appears alongside two independent citations (Yao et al. 2020, Li et al. 2023) and is not load-bearing; the formulation is standard and the paper's contribution does not rest on it. The uniform-prior mean-field choice and the possible mismatch with the solver-induced context distribution are robustness and correctness concerns, not circularity, because the paper does not define its predicted quantities in terms of that prior and the evaluation is external to the calibration objective. The Stage 2 calibration-on-solver-plans loop is a heuristic self-consistency procedure rather than a reduction of the reported gains to the calibration inputs.

Assumptions & free parameters 4 free parameters · 4 assumptions · 0 invented entities

The ledger shows that the method's main free choices are the uniform prior, the Monte Carlo sample size, the tail penalty, and the plan-bucketing hyperparameters. These are set by hand and not derived from first principles; the empirical gains depend on them, though the sensitivity sweep for γ mitigates that particular choice. The uniform prior is the most consequential ad hoc assumption because it defines the entire distortion table.

free parameters (4)
  • Tail penalty γ = 10
    Chosen by hand (Section 5, 'unless stated otherwise ... tail penalty γ=10'). The sensitivity sweep (Figure 4) shows the effect saturates around γ≈5, but no selection criterion (e.g., validation-based tuning) is reported. The value 10 sits in the flat region, but the choice is not derived.
  • Monte Carlo draws K = 10
    Chosen by hand (Section 5, 'K=10 Monte Carlo context draws per (module, bitwidth) pair'). No sensitivity analysis is reported. Figure 2a shows NMSE/KL variation of 2–3 orders of magnitude across contexts, implying high variance in the marginal estimate; K=10 may be too small for stable scores.
  • Budget intervals I and anchor plans J = I=3, J=5
    Chosen by hand (Section 4.2, 'partition the feasible memory range into I intervals', 'sample J budgets ... yields J anchor plans'). No sensitivity analysis is reported. The bucketing heuristic determines how plan-aware the technique parameters are.
  • Uniform prior π over upstream bitwidths = Unif(B) for each upstream module
    The marginalization distribution in Eq. (4) assumes independent uniform bitwidths for every upstream module. This is a modelling assumption, not derived from deployment conditions or the solver's output distribution. The choice of uniform over B is arbitrary and affects all distortion scores.
assumptions (4)
  • domain assumption The deployment loss is well-approximated by the sum of per-module mean-field decoupled NMSE scores (Section 3, Eq. 2).
    The true network loss is replaced with an additive MCKP surrogate. The paper states the additive objective presumes independence; averaging over a prior does not guarantee that the sum of marginal scores is a faithful proxy for the actual network loss under a specific plan.
  • ad hoc to paper Upstream bitwidths are independent and uniformly distributed over B (Section 4.1, Eq. 4).
    Deployed plans are memory-budget-constrained and produced by the greedy solver, so upstream bitwidths are neither independent nor uniform. The uniform prior is chosen for tractability and is not justified by the deployment distribution.
  • domain assumption Simulated quantization (quantize–dequantize to FP16) is a faithful proxy for real integer hardware inference (Section 5, 'Quantization is simulated').
    All reported memory and accuracy numbers are based on simulation; no actual hardware deployment or integer kernel validation is performed. Real inference may introduce additional errors (e.g., non-linear operations, mixed-precision kernels) not captured here.
  • domain assumption The base quantizer's technique parameters can be recalibrated under arbitrary quantized upstream contexts (Section 4.1, 'the technique parameters (µ) of the quantized modules are recalibrated under that context').
    For GPTQ this is Hessian recomputation on drifted activations, which is well-defined. For AWQ, it requires re-estimating smoothing factors and clipping ranges on quantized inputs; the paper does not specify how this is done or whether it is stable across contexts.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MixQuant: Adaptive Mixed-Precision Quantization for Large Language Models." pith.science (2026). https://pith.science/paper/UGGK55AP

@misc{pith2026260723047,
  author       = {Pith},
  title        = {Pith review of: MixQuant: Adaptive Mixed-Precision Quantization for Large Language Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/UGGK55AP}},
  note         = {Machine review of arXiv:2607.23047}
}
read the original abstract

Mixed-precision quantization improves the accuracy of post-training quantization by allocating higher bitwidths to sensitive layers, but existing methods solve the allocation for a single fixed memory budget. In practice the budget varies across deployments and is unknown at calibration time. Adaptive quantization addresses this with one offline calibration that serves any budget, yet current methods score layer sensitivity in a manner that does not consider its dependency on quantization levels of other layers. We show that a layer's sensitivity depends strongly on the bitwidths of its upstream layers and that this dependence shifts the resulting preferred bit allocation. We propose MixQuant, a technique-agnostic adaptive framework that wraps any base quantizer. MixQuant marginalizes each layer's distortion over random quantized upstream configurations to obtain budget-agnostic scores, calibrates the quantizer's parameters on plans the allocator itself produces, and penalizes allocations that leave layers at the lowest bitwidths. A single greedy pass then serves any budget at deployment. Across Llama-3.2-3B, Llama-2-7B, and Mistral-7B under AWQ and GPTQ, MixQuant outperforms adaptive and mixed-precision baselines in every setting, improving average accuracy by up to 8 points and reducing perplexity from 12.43 to 10.70 at the tightest budget, while matching an ILP solver at negligible deployment cost.

Figures

Figures reproduced from arXiv: 2607.23047 by the authors.

Figure 1
Figure 1. Overview of MIXQUANT. Stage 1 builds a budget-agnostic distortion table D ∈ R L×|B| by scoring each (module, bitwidth) pair under K random quantized upstream contexts (Section 4.1). Stage 2 estimates the technique parameters µ on activations induced by anchor plans the greedy solver produces across the feasible budget range, rather than on FP16 activations (Section 4.2). Stage 3 adds a tail penalty γ that steers spa… view at source ↗
Figure 2
Figure 2. Effect of upstream context, measured over the same 20 random quantized contexts in both [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Per-linear-layer bitwidth allocations by method. For Llama-3.2-3B (1.25 GB), Llama-2- [PITH_FULL_IMAGE:figures/full_fig_p010_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Effect of the tail penalty. Relative change in WikiText-2 perplexity versus the unregular [PITH_FULL_IMAGE:figures/full_fig_p011_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

155 extracted references · 21 canonical work pages

  1. [1]

    Wood , title =

    Brooks Paige and Frank D. Wood , title =. Proceedings of the 31th International Conference on Machine Learning,. 2014 , url =

    2014

  2. [2]

    2023 , url =

    Li, Shiyao and Ning, Xuefei and Hong, Ke and Liu, Tengxuan and Wang, Luning and Li, Xiuhong and Zhong, Kai and Dai, Guohao and Yang, Huazhong and Wang, Yu , booktitle =. 2023 , url =

    2023

  3. [3]

    Approximate Computing: A Survey , year=

    Xu, Qiang and Mytkowicz, Todd and Kim, Nam Sung , journal=. Approximate Computing: A Survey , year=

  4. [4]

    PLDI , year=

    Reactive probabilistic programming , author=. PLDI , year=

  5. [5]

    Density-Based Semantics for Reactive Probabilistic Programming

    Guillaume Baudart and Louis Mandel and Christine Tasson , title =. CoRR , volume =. 2023 , url =. doi:10.48550/ARXIV.2308.01676 , eprinttype =. 2308.01676 , timestamp =

    work page Pith review arXiv doi:10.48550/arxiv.2308.01676 2023

  6. [6]

    Advances in Variational Inference , journal =

    Cheng Zhang and Judith B. Advances in Variational Inference , journal =. 2019 , url =. doi:10.1109/TPAMI.2018.2889774 , timestamp =

    arXiv 2019

  7. [7]

    2022 , url =

    Guillaume Baudart and Louis Mandel and Reyyan Tekin , editor =. 2022 , url =. doi:10.1145/3519941.3535066 , timestamp =

    arXiv 2022

  8. [8]

    2020 Design, Automation

    Hiromitsu Awano and Masanori Hashimoto , title =. 2020 Design, Automation. 2020 , url =. doi:10.23919/DATE48585.2020.9116302 , timestamp =

    arXiv 2020

Show all 155 references
  1. [9]

    Rutenbar and Tsuhan Chen , title =

    Claire Fang Fang and Rob A. Rutenbar and Tsuhan Chen , title =. 2003 International Conference on Computer-Aided Design,. 2003 , url =. doi:10.1109/ICCAD.2003.1257675 , timestamp =

    2003 arXiv

  2. [10]

    Rozier and Johann Schumann , editor =

    Johannes Geist and Kristin Y. Rozier and Johann Schumann , editor =. Runtime Observer Pairs and Bayesian Network Reasoners On-board FPGAs: Flight-Certifiable System Health Management for Embedded Systems , booktitle =. 2014 , url =. doi:10.1007/978-3-319-11164-3\_18 , timestamp =

    2014 doi

  3. [11]

    Eric Atkinson and Charles Yuan and Guillaume Baudart and Louis Mandel and Michael Carbin , title =. Proc. 2022 , url =. doi:10.1145/3563347 , timestamp =

    2022 doi

  4. [12]

    Bayesian Robot Programming , journal =

    Olivier Lebeltel and Pierre Bessi. Bayesian Robot Programming , journal =. 2004 , url =. doi:10.1023/B:AURO.0000008671.38949.43 , timestamp =

    2004

  5. [13]

    2013 , url=

    Fixed-Point Arithmetic: An Introduction , author=. 2013 , url=

    2013

  6. [14]

    2017 , url =

    Rajesh Ranganath , title =. 2017 , url =

    2017

  7. [15]

    Banerjee and Zbigniew T

    Subho S. Banerjee and Zbigniew T. Kalbarczyk and Ravishankar K. Iyer , editor =. AcMC \(. Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems,. 2019 , url =. doi:10.1145/3297858.3304019 , timestamp =

    2019

  8. [16]

    Flexpoint: An Adaptive Numerical Format for Efficient Training of Deep Neural Networks , booktitle =

    Urs K. Flexpoint: An Adaptive Numerical Format for Efficient Training of Deep Neural Networks , booktitle =. 2017 , url =

    2017

  9. [17]

    2022 , booktitle =

    Chandra et al, Kartik , title =. 2022 , booktitle =

    2022

  10. [18]

    Journal of the American statistical Association , year=

    Variational inference: A review for statisticians , author=. Journal of the American statistical Association , year=

  11. [19]

    Zixin Huang and Saikat Dutta and Sasa Misailovic , title =. Innov. Syst. Softw. Eng. , volume =. 2022 , url =. doi:10.1007/S11334-021-00433-3 , timestamp =

    2022 doi

  12. [20]

    fpm library , author=

  13. [21]

    Jacob Laurel and Rem Yang and Shubham Ugare and Robert Nagel and Gagandeep Singh and Sasa Misailovic , title =. Proc. 2022 , url =. doi:10.1145/3563324 , timestamp =

    2022 doi

  14. [22]

    Jacob Laurel and Rem Yang and Gagandeep Singh and Sasa Misailovic , title =. Proc. 2022 , url =. doi:10.1145/3498718 , timestamp =

    2022 doi

  15. [23]

    Design Automation Conference (DAC) , year=

    Statheros: Compiler for Efficient Low-Precision Probabilistic Programming , author=. Design Automation Conference (DAC) , year=

  16. [24]

    Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems,

    Ruizhe Cai and Ao Ren and Ning Liu and Caiwen Ding and Luhao Wang and Xuehai Qian and Massoud Pedram and Yanzhi Wang , editor =. Proceedings of the Twenty-Third International Conference on Architectural Support for Programming Languages and Operating Systems,. 2018 , url =. do...

    2018

  17. [25]

    Goodman , title =

    Daniel Ritchie and Paul Horsfall and Noah D. Goodman , title =. CoRR , volume =. 2016 , url =. 1610.05735 , timestamp =

    2016 arXiv

  18. [26]

    Continualization of Probabilistic Programs With Correction , booktitle =

    Jacob Laurel and Sasa Misailovic , editor =. Continualization of Probabilistic Programs With Correction , booktitle =. 2020 , url =. doi:10.1007/978-3-030-44914-8\_14 , timestamp =

    2020 doi

  19. [27]

    and Henzinger, Thomas A

    Gordon, Andrew D. and Henzinger, Thomas A. and Nori, Aditya V. and Rajamani, Sriram K. , title =. Future of Software Engineering Proceedings , pages =. 2014 , isbn =. doi:10.1145/2593882.2593900 , abstract =

    2014

  20. [28]

    Proceedings of the 55th Annual Design Automation Conference,

    Shubham Jain and Swagath Venkataramani and Vijayalakshmi Srinivasan and Jungwook Choi and Pierce Chuang and Leland Chang , title =. Proceedings of the 55th Annual Design Automation Conference,. 2018 , url =. doi:10.1145/3195970.3196012 , timestamp =

    2018

  21. [29]

    arXiv: Learning , year=

    Training deep neural networks with low precision multiplications , author=. arXiv: Learning , year=

  22. [30]

    An Unbiased

    Shuanglong Liu and Grigorios Mingas and Christos. An Unbiased. 2017 , url =. doi:10.1109/TC.2016.2630682 , timestamp =

    2017

  23. [31]

    CoRR , volume =

    Nimish Shah and Laura Isabel Galindez Olascoaga and Wannes Meert and Marian Verhelst , title =. CoRR , volume =. 2021 , url =. 2103.00216 , timestamp =

    2021 arXiv

  24. [32]

    Neurocomputing , volume =

    Nico Piatkowski and Sangkyun Lee and Katharina Morik , title =. Neurocomputing , volume =. 2016 , url =. doi:10.1016/J.NEUCOM.2015.01.091 , timestamp =

    2016 doi

  25. [33]

    Ko and Yuji Chai and Rob A

    Glenn G. Ko and Yuji Chai and Rob A. Rutenbar and David Brooks and Gu. Accelerating Bayesian Inference on Structured Graphs Using Parallel Gibbs Sampling , booktitle =. 2019 , url =. doi:10.1109/FPL.2019.00033 , timestamp =

    2019

  26. [34]

    Lebeck , title =

    Xiangyu Zhang and Ramin Bashizade and Yicheng Wang and Cheng Lyu and Sayan Mukherjee and Alvin R. Lebeck , title =. CoRR , volume =. 2020 , url =. 2003.04223 , timestamp =

    2020 arXiv

  27. [35]

    and Vainio, O

    Saramaki, T. and Vainio, O. , booktitle=. Structures for generating polynomial responses , year=

  28. [36]

    Bertrand Jeannet and Antoine Min. Apron:. Computer Aided Verification, 21st International Conference,. 2009 , url =. doi:10.1007/978-3-642-02658-4\_52 , timestamp =

    2009 doi

  29. [37]

    Vechev , editor =

    Timon Gehr and Sasa Misailovic and Martin T. Vechev , editor =. Computer Aided Verification - 28th International Conference,. 2016 , url =. doi:10.1007/978-3-319-41528-4\_4 , timestamp =

    2016 doi

  30. [38]

    IEEE Standard for Floating-Point Arithmetic , year=

    , journal=. IEEE Standard for Floating-Point Arithmetic , year=

  31. [39]

    Compiling Stan to generative probabilistic languages and extension to deep probabilistic programming , booktitle =

    Guillaume Baudart and Javier Burroni and Martin Hirzel and Louis Mandel and Avraham Shinnar , editor =. Compiling Stan to generative probabilistic languages and extension to deep probabilistic programming , booktitle =. 2021 , url =. doi:10.1145/3453483.3454058 , timestamp =

    2021

  32. [40]

    Journal of Statistical Software , author=

    Stan: A Probabilistic Programming Language , volume=. Journal of Statistical Software , author=. 2017 , pages=. doi:10.18637/jss.v076.i01 , abstract=

    2017 doi

  33. [41]

    Automatically improving accuracy for floating point expressions , booktitle =

    Pavel Panchekha and Alex Sanchez. Automatically improving accuracy for floating point expressions , booktitle =. 2015 , url =. doi:10.1145/2737924.2737959 , timestamp =

    2015

  34. [42]

    CoRR , volume =

    Yu Cheng and Duo Wang and Pan Zhou and Tao Zhang , title =. CoRR , volume =. 2017 , url =. 1710.09282 , timestamp =

    2017 arXiv

  35. [43]

    and Jankowiak, Martin and Obermeyer, Fritz and Pradhan, Neeraj and Karaletsos, Theofanis and Singh, Rohit and Szerlip, Paul and Horsfall, Paul and Goodman, Noah D

    Bingham, Eli and Chen, Jonathan P. and Jankowiak, Martin and Obermeyer, Fritz and Pradhan, Neeraj and Karaletsos, Theofanis and Singh, Rohit and Szerlip, Paul and Horsfall, Paul and Goodman, Noah D. , title =. J. Mach. Learn. Res. , month = jan, pages =. 2019 , issue_date =

    2019

  36. [44]

    Deep Learning with Limited Numerical Precision , booktitle =

    Suyog Gupta and Ankur Agrawal and Kailash Gopalakrishnan and Pritish Narayanan , editor =. Deep Learning with Limited Numerical Precision , booktitle =. 2015 , url =

    2015

  37. [45]

    and Krishnan, S

    Ramalingam, A. and Krishnan, S. , title =. Trans. Info. For. Sec. , month =. 2006 , issue_date =. doi:10.1109/TIFS.2006.885036 , abstract =

    2006

  38. [46]

    CoRR , volume =

    Jonathan Long and Evan Shelhamer and Trevor Darrell , title =. CoRR , volume =. 2014 , url =. 1411.4038 , timestamp =

    2014 arXiv

  39. [47]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Bit-Mixer: Mixed-precision networks with runtime bit-width selection , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  40. [48]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Adabits: Neural network quantization with adaptive bit-widths , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  41. [49]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Instance-aware dynamic neural network quantization , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  42. [50]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Eq-net: Elastic quantization neural networks , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  43. [51]

    Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=

    Improved Techniques for Quantizing Deep Networks with Adaptive Bit-Widths , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=

  44. [52]

    Latency-Constrained Input-Aware Quantization of Time Series Inference Workflows at the Edge , year=

    Misra, Ashitabh and Saoda, Nurani and Abdelzaher, Tarek , booktitle=. Latency-Constrained Input-Aware Quantization of Time Series Inference Workflows at the Edge , year=

  45. [53]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    One-shot model for mixed-precision quantization , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  46. [54]

    International Conference on Machine Learning , pages=

    Sdq: Stochastic differentiable quantization with mixed precision , author=. International Conference on Machine Learning , pages=. 2022 , organization=

    2022

  47. [55]

    Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

    Haq: Hardware-aware automated quantization with mixed precision , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

  48. [56]

    NeurIPS ML for Systems workshop, 2018 , year=

    Releq: an automatic reinforcement learning approach for deep quantization of neural networks , author=. NeurIPS ML for Systems workshop, 2018 , year=

    2018

  49. [57]

    Le , title =

    Barret Zoph and Quoc V. Le , title =. 5th International Conference on Learning Representations,. 2017 , url =

    2017

  50. [58]

    Search What You Want: Barrier Panelty

    Haibao Yu and Qi Han and Jianbo Li and Jianping Shi and Guangliang Cheng and Bin Fan , editor =. Search What You Want: Barrier Panelty. Computer Vision -. 2020 , url =. doi:10.1007/978-3-030-58545-7\_1 , timestamp =

    2020 doi

  51. [59]

    2021 , url =

    Dilin Wang and Meng Li and Chengyue Gong and Vikas Chandra , title =. 2021 , url =. doi:10.1109/CVPR46437.2021.00635 , timestamp =

    2021

  52. [60]

    CoRR , volume =

    Bichen Wu and Yanghan Wang and Peizhao Zhang and Yuandong Tian and Peter Vajda and Kurt Keutzer , title =. CoRR , volume =. 2018 , url =. 1812.00090 , timestamp =

    2018 arXiv

  53. [61]

    Temporal Dynamic Quantization for Diffusion Models , booktitle =

    Junhyuk So and Jungwon Lee and Daehyun Ahn and Hyungjun Kim and Eunhyeok Park , editor =. Temporal Dynamic Quantization for Diffusion Models , booktitle =. 2023 , url =

    2023

  54. [62]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Insta-bnn: Binary neural network with instance-aware threshold , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  55. [63]

    European Conference on Computer Vision , pages=

    Cadyq: Content-aware dynamic quantization for image super-resolution , author=. European Conference on Computer Vision , pages=. 2022 , organization=

    2022

  56. [64]

    Bashima Islam and Shahriar Nirjon , title =. Proc. 2020 , url =. doi:10.1145/3411808 , timestamp =

    2020 doi

  57. [65]

    2022 , url =

    Kwanghee Choi and Martin Kersner and Jacob Morton and Buru Chang , title =. 2022 , url =. doi:10.1109/ICASSP43922.2022.9747908 , timestamp =

    2022

  58. [66]

    Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation , pages=

    LightEQ: On-Device Earthquake Detection with Embedded Machine Learning , author=. Proceedings of the 8th ACM/IEEE Conference on Internet of Things Design and Implementation , pages=

  59. [67]

    Bronstein and Uri C

    Moran Shkolnik and Brian Chmiel and Ron Banner and Gil Shomron and Yury Nahshan and Alexander M. Bronstein and Uri C. Weiser , title =. CoRR , volume =. 2020 , url =. 2002.07686 , timestamp =

    2020 arXiv

  60. [68]

    MultiQuant: Training Once for Multi-bit Quantization of Neural Networks , url =

    Xu, Ke and Feng, Qiantai and Zhang, Xingyi and Wang, Dong , year =. MultiQuant: Training Once for Multi-bit Quantization of Neural Networks , url =. doi:10.24963/ijcai.2022/504 , booktitle =

    2022 doi

  61. [69]

    Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks , booktitle =

    Minyoung Huh and Brian Cheung and Pulkit Agrawal and Phillip Isola , editor =. Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks , booktitle =. 2023 , url =

    2023

  62. [70]

    Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation , journal =

    Yoshua Bengio and Nicholas L. Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation , journal =. 2013 , url =. 1308.3432 , timestamp =

    2013 arXiv

  63. [71]

    Classification of Radar Targets using Features Based on Warped Discrete Fourier Transform , url =

    Bujakovic, Dimitrije and Andric, Milenko and Bondzulic, Boban and Simic, Slobodan , year =. Classification of Radar Targets using Features Based on Warped Discrete Fourier Transform , url =. doi:10.23919/eusipco55093.2022.9909909 , booktitle =

    2022

  64. [72]

    , author=

    Wavelet Transform Based Mel-scaled Features for Acoustic Scene Classification. , author=. INTERSPEECH , volume=

  65. [73]

    D. G. Bhalke and C. B. Rama Rao and Dattatraya S. Bormane , title =. J. Intell. Inf. Syst. , volume =. 2016 , url =. doi:10.1007/S10844-015-0360-9 , timestamp =

    2016 doi

  66. [74]

    Progressive Neural Compression for Adaptive Image Offloading Under Timing Constraints , url=

    Wang, Ruiqi and Liu, Hanyang and Qiu, Jiaming and Xu, Moran and Guérin, Roch and Lu, Chenyang , year=. Progressive Neural Compression for Adaptive Image Offloading Under Timing Constraints , url=. doi:10.1109/rtss59052.2023.00020 , booktitle=

    2023

  67. [75]

    Howard and Menglong Zhu and Bo Chen and Dmitry Kalenichenko and Weijun Wang and Tobias Weyand and Marco Andreetto and Hartwig Adam , title =

    Andrew G. Howard and Menglong Zhu and Bo Chen and Dmitry Kalenichenko and Weijun Wang and Tobias Weyand and Marco Andreetto and Hartwig Adam , title =. CoRR , volume =. 2017 , url =. 1704.04861 , timestamp =

    2017 arXiv

  68. [76]

    and Zhu, Menglong and Zhmoginov, Andrey and Chen, Liang-Chieh , title =

    Sandler, Mark and Howard, Andrew G. and Zhu, Menglong and Zhmoginov, Andrey and Chen, Liang-Chieh , title =. CoRR , volume =. 2018 , url =

    2018

  69. [77]

    and Adam, Hartwig , title =

    Howard, Andrew and Sandler, Mark and Chu, Grace and Chen, Liang-Chieh and Chen, Bo and Tan, Mingxing and Wang, Weijun and Zhu, Yukun and Pang, Ruoming and Vasudevan, Vijay and Le, Quoc V. and Adam, Hartwig , title =. Proceedings of the IEEE International Conference on Computer...

  70. [78]

    PyTorch: An Imperative Style, High-Performance Deep Learning Library , journal =

    Adam Paszke and Sam Gross and Francisco Massa and Adam Lerer and James Bradbury and Gregory Chanan and Trevor Killeen and Zeming Lin and Natalia Gimelshein and Luca Antiga and Alban Desmaison and Andreas K. PyTorch: An Imperative Style, High-Performance Deep Learning Library ,...

    2019 arXiv

  71. [79]

    2024 33rd International Conference on Computer Communications and Networks (ICCCN) , pages=

    Acies-OS: A Content-Centric Platform for Edge AI Twinning and Orchestration , author=. 2024 33rd International Conference on Computer Communications and Networks (ICCCN) , pages=. 2024 , organization=

    2024

  72. [80]

    Advances in Neural Information Processing Systems , year =

    FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Space , author =. Advances in Neural Information Processing Systems , year =

  73. [81]

    and Ba, Jimmy , keywords =

    Kingma, Diederik P. and Ba, Jimmy , keywords =. Adam: A Method for Stochastic Optimization , publisher =. 2014 , copyright =. doi:10.48550/ARXIV.1412.6980 , url =

    2014 doi arXiv

  74. [82]

    CoRR , volume =

    Shuchang Zhou and Zekun Ni and Xinyu Zhou and He Wen and Yuxin Wu and Yuheng Zou , title =. CoRR , volume =. 2016 , url =. 1606.06160 , timestamp =

    2016 arXiv

  75. [83]

    CoRR , volume =

    Jungwook Choi and Zhuo Wang and Swagath Venkataramani and Pierce I. CoRR , volume =. 2018 , url =. 1805.06085 , timestamp =

    2018 arXiv

  76. [84]

    and Zhang, Yonggang and Han, Bo and Tan, Mingkui , keywords =

    Li, Huantong and Wu, Xiangmiao and Lv, Fanbing and Liao, Daihai and Li, Thomas H. and Zhang, Yonggang and Han, Bo and Tan, Mingkui , keywords =. Hard Sample Matters a Lot in Zero-Shot Quantization , publisher =. 2023 , copyright =. doi:10.48550/ARXIV.2303.13826 , url =

    2023 doi arXiv

  77. [85]

    Proceedings of the 21st ACM Conference on Embedded Networked Sensor Systems , pages=

    SudokuSens: Enhancing Deep Learning Robustness for IoT Sensing Applications using a Generative Approach , author=. Proceedings of the 21st ACM Conference on Embedded Networked Sensor Systems , pages=

  78. [86]

    2024 33rd International Conference on Computer Communications and Networks (ICCCN) , pages=

    Data Augmentation for Human Activity Recognition via Condition Space Interpolation within a Generative Model , author=. 2024 33rd International Conference on Computer Communications and Networks (ICCCN) , pages=. 2024 , organization=

    2024

  79. [87]

    Proceedings of the ACM on Web Conference 2024 , pages=

    FreqMAE: Frequency-Aware Masked Autoencoder for Multi-Modal IoT Sensing , author=. Proceedings of the ACM on Web Conference 2024 , pages=

    2024

  80. [88]

    Raspberry Pi Pico , url =

  81. [89]

    Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

    Real-time video inference on edge devices via adaptive model streaming , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

  82. [90]

    Wu, Di and Ouyang, Jinhui and Dai, Ningyi and Wu, Mingzhu and Tan, Haodan and Deng, Hanhui and Fan, Yongmei and Wang, Dakuo and Jin, Zhanpeng , title =. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. , month = sep, articleno =. 2022 , issue_date =. doi:10.1145/3550334 ,...

    2022 doi

  83. [91]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Natural language-assisted sign language recognition , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  84. [92]

    Dawei Liang and Edison Thomaz , title =. Proc. 2019 , url =. doi:10.1145/3314404 , timestamp =

    2019 doi

  85. [93]

    MultiMedia LLC , title =

  86. [94]

    Triton: an intermediate language and compiler for tiled neural network computations , booktitle =

    Philippe Tillet and Hsiang. Triton: an intermediate language and compiler for tiled neural network computations , booktitle =. 2019 , url =. doi:10.1145/3315508.3329973 , timestamp =

    2019

  87. [95]

    Pengzhi Li and Yan Pei and Jianqiang Li , title =. Appl. Soft Comput. , volume =. 2023 , url =. doi:10.1016/J.ASOC.2023.110176 , timestamp =

    2023

  88. [96]

    Bourdev , title =

    Yunchao Gong and Liu Liu and Ming Yang and Lubomir D. Bourdev , title =. CoRR , volume =. 2014 , url =. 1412.6115 , timestamp =

    2014 arXiv

  89. [97]

    Gray , title =

    Allen Gersho and Robert M. Gray , title =. 1991 , url =. doi:10.1007/978-1-4615-3626-0 , isbn =

    1991 doi

  90. [98]

    , journal=

    Gray, R. , journal=. Vector quantization , year=

  91. [99]

    Rama Muni Reddy Yanamala and Muralidhar Pullakandam , title =. Int. J. Circuit Theory Appl. , volume =. 2024 , url =. doi:10.1002/CTA.3957 , timestamp =

    2024 doi

  92. [100]

    Sensors , volume =

    Yeongseo Shin and Chanjun Chun , title =. Sensors , volume =. 2023 , url =. doi:10.3390/S23073398 , timestamp =

    2023 doi

  93. [101]

    2021 , url =

    Archontis Politis and Annamaria Mesaros and Sharath Adavanne and Toni Heittola and Tuomas Virtanen , title =. 2021 , url =. doi:10.1109/TASLP.2020.3047233 , timestamp =

    2021

  94. [102]

    A Method of Sound Event Localization and Detection Based on Three-Dimension Convolution , year=

    Mei, Pengcheng and Yang, Jibin and Zhang, Qiang and Huang, Xiang , booktitle=. A Method of Sound Event Localization and Detection Based on Three-Dimension Convolution , year=

  95. [103]

    Magnetic Anamoly-Based Detection of a Submarine , year=

    Ashraf, Ayesha and Abbas, Tanveer and Ejaz, Amna , booktitle=. Magnetic Anamoly-Based Detection of a Submarine , year=

  96. [104]

    2022 , url =

    Guansong Pang and Chunhua Shen and Longbing Cao and Anton van den Hengel , title =. 2022 , url =. doi:10.1145/3439950 , timestamp =

    2022 doi

  97. [105]

    Xinwen Liu and Huan Wang and Zongjin Li and Lang Qin , title =. Knowl. Based Syst. , volume =. 2021 , url =. doi:10.1016/J.KNOSYS.2021.107187 , timestamp =

    2021

  98. [106]

    7th International Conference on Learning Representations,

    Zhuang Liu and Mingjie Sun and Tinghui Zhou and Gao Huang and Trevor Darrell , title =. 7th International Conference on Learning Representations,. 2019 , url =

    2019

  99. [107]

    Importance Estimation for Neural Network Pruning , year=

    Molchanov, Pavlo and Mallya, Arun and Tyree, Stephen and Frosio, Iuri and Kautz, Jan , booktitle=. Importance Estimation for Neural Network Pruning , year=

  100. [108]

    Hinton and Oriol Vinyals and Jeffrey Dean , title =

    Geoffrey E. Hinton and Oriol Vinyals and Jeffrey Dean , title =. CoRR , volume =. 2015 , url =. 1503.02531 , timestamp =

    2015 arXiv

  101. [109]

    Maybank and Dacheng Tao , title =

    Jianping Gou and Baosheng Yu and Stephen J. Maybank and Dacheng Tao , title =. Int. J. Comput. Vis. , volume =. 2021 , url =. doi:10.1007/S11263-021-01453-Z , timestamp =

    2021 doi

  102. [110]

    , booktitle=

    Rhu, Minsoo and Gimelshein, Natalia and Clemons, Jason and Zulfiqar, Arslan and Keckler, Stephen W. , booktitle=. vDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design , year=

  103. [111]

    Quantization Networks , year=

    Yang, Jiwei and Shen, Xu and Xing, Jun and Tian, Xinmei and Li, Houqiang and Deng, Bing and Huang, Jianqiang and Hua, Xian-sheng , booktitle=. Quantization Networks , year=

  104. [112]

    ResQ: Residual Quantization for Video Perception , year=

    Abati, Davide and Yahia, Haitam Ben and Nagel, Markus and Habibian, Amirhossein , booktitle=. ResQ: Residual Quantization for Video Perception , year=

  105. [113]

    Proceedings of the ACM on Web Conference 2024 , pages =

    Kara, Denizhan and Kimura, Tomoyoshi and Liu, Shengzhong and Li, Jinyang and Liu, Dongxin and Wang, Tianshi and Wang, Ruijie and Chen, Yizhuo and Hu, Yigong and Abdelzaher, Tarek , title =. Proceedings of the ACM on Web Conference 2024 , pages =. 2024 , isbn =. doi:10.1145/358...

    2024

  106. [114]

    Gupta and Dezhi Hong , editor =

    Shuheng Li and Ranak Roy Chowdhury and Jingbo Shang and Rajesh K. Gupta and Dezhi Hong , editor =. UniTS: Short-Time Fourier Inspired Neural Networks for Sensory Time Series Classification , booktitle =. 2021 , url =. doi:10.1145/3485730.3485942 , timestamp =

    2021

  107. [115]

    Abdelzaher , editor =

    Shuochao Yao and Shaohan Hu and Yiran Zhao and Aston Zhang and Tarek F. Abdelzaher , editor =. DeepSense:. Proceedings of the 26th International Conference on World Wide Web,. 2017 , url =. doi:10.1145/3038912.3052577 , timestamp =

    2017

  108. [116]

    Lee and H

    C. Lee and H. Kim and E. Park and J. Kim , booktitle =. INSTA-BNN: Binary Neural Network with INSTAnce-aware Threshold , year =. doi:10.1109/ICCV51070.2023.01589 , url =

    2023

  109. [117]

    Vector Quantization , howpublished =

  110. [118]

    2013 , publisher=

    Knapsack Problems , author=. 2013 , publisher=

    2013

  111. [119]

    2023 , eprint=

    EQ-Net: Elastic Quantization Neural Networks , author=. 2023 , eprint=

    2023

  112. [120]

    Auer, Peter , title =. J. Mach. Learn. Res. , month =. 2003 , issue_date =

    2003

  113. [121]

    CoRR , volume =

    Kaiming He and Xiangyu Zhang and Shaoqing Ren and Jian Sun , title =. CoRR , volume =. 2015 , url =. 1512.03385 , timestamp =

    2015 arXiv

  114. [122]

    Le , editor =

    Mingxing Tan and Quoc V. Le , editor =. EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , booktitle =. 2019 , url =

    2019

  115. [123]

    2015 , url =

    Jonathan Long and Evan Shelhamer and Trevor Darrell , title =. 2015 , url =. doi:10.1109/CVPR.2015.7298965 , timestamp =

    2015

  116. [124]

    Huang and Gang Hua , title =

    Haichao Yu and Haoxiang Li and Humphrey Shi and Thomas S. Huang and Gang Hua , title =. Thirty-Fifth. 2021 , url =. doi:10.1609/AAAI.V35I12.17286 , timestamp =

    2021 doi

  117. [125]

    LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks , booktitle =

    Dongqing Zhang and Jiaolong Yang and Dongqiangzi Ye and Gang Hua , editor =. LQ-Nets: Learned Quantization for Highly Accurate and Compact Deep Neural Networks , booktitle =. 2018 , url =. doi:10.1007/978-3-030-01237-3\_23 , timestamp =

    2018 doi

  118. [126]

    Mahoney and Kurt Keutzer , title =

    Amir Gholami and Sehoon Kim and Zhen Dong and Zhewei Yao and Michael W. Mahoney and Kurt Keutzer , title =. CoRR , volume =. 2021 , url =

    2021

  119. [127]

    2023 , url =

    Babak Rokh and Ali Azarpeyvand and Alireza Khanteymoori , title =. 2023 , url =. doi:10.1145/3623402 , timestamp =

    2023 doi

  120. [128]

    Expert Syst

    Saidul Islam and Hanae Elmekki and Ahmed Elsebai and Jamal Bentahar and Nagat Drawel and Gaith Rjoub and Witold Pedrycz , title =. Expert Syst. Appl. , volume =. 2024 , url =. doi:10.1016/J.ESWA.2023.122666 , timestamp =

    2024

  121. [129]

    Computing , volume =

    Nidhi Dua and Shiva Nand Singh and Vijay Bhaskar Semwal , title =. Computing , volume =. 2021 , url =. doi:10.1007/S00607-021-00928-8 , timestamp =

    2021 doi

  122. [130]

    Lane and Emiliano Miluzzo and Hong Lu and Daniel Peebles and Tanzeem Choudhury and Andrew T

    Nicholas D. Lane and Emiliano Miluzzo and Hong Lu and Daniel Peebles and Tanzeem Choudhury and Andrew T. Campbell , title =. 2010 , url =. doi:10.1109/MCOM.2010.5560598 , timestamp =

    2010

  123. [131]

    2012 , howpublished =

    Reiss, Attila , title =. 2012 , howpublished =

    2012

  124. [132]

    5th International Conference on Learning Representations,

    Eric Jang and Shixiang Gu and Ben Poole , title =. 5th International Conference on Learning Representations,. 2017 , url =

    2017

  125. [133]

    Improved Knowledge Distillation via Teacher Assistant , booktitle =

    Seyed. Improved Knowledge Distillation via Teacher Assistant , booktitle =. 2020 , url =. doi:10.1609/AAAI.V34I04.5963 , timestamp =

    2020 doi

  126. [134]

    SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models , booktitle =

    Guangxuan Xiao and Ji Lin and Micka. SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models , booktitle =. 2023 , url =

    2023

  127. [135]

    Proceedings of the Seventh Annual Conference on Machine Learning and Systems, MLSys 2024, Santa Clara, CA, USA, May 13-16, 2024 , publisher =

    Ji Lin and Jiaming Tang and Haotian Tang and Shang Yang and Wei. Proceedings of the Seventh Annual Conference on Machine Learning and Systems, MLSys 2024, Santa Clara, CA, USA, May 13-16, 2024 , publisher =. 2024 , url =

    2024

  128. [136]

    Mahoney and Kurt Keutzer , editor =

    Sehoon Kim and Coleman Hooper and Amir Gholami and Zhen Dong and Xiuyu Li and Sheng Shen and Michael W. Mahoney and Kurt Keutzer , editor =. SqueezeLLM: Dense-and-Sparse Quantization , booktitle =. 2024 , url =

    2024

  129. [137]

    Forty-first International Conference on Machine Learning,

    Cheng Zhang and Jianyi Cheng and George Anthony Constantinides and Yiren Zhao , editor =. Forty-first International Conference on Machine Learning,. 2024 , url =

    2024

  130. [138]

    Croci and Bo Li and Pashmina Cameron and Martin Jaggi and Dan Alistarh and Torsten Hoefler and James Hensman , editor =

    Saleh Ashkboos and Amirkeivan Mohtashami and Maximilian L. Croci and Bo Li and Pashmina Cameron and Martin Jaggi and Dan Alistarh and Torsten Hoefler and James Hensman , editor =. QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs , booktitle =. 2024 , url =

    2024

  131. [139]

    The Thirteenth International Conference on Learning Representations,

    Zechun Liu and Changsheng Zhao and Igor Fedorov and Bilge Soran and Dhruv Choudhary and Raghuraman Krishnamoorthi and Vikas Chandra and Yuandong Tian and Tijmen Blankevoort , title =. The Thirteenth International Conference on Learning Representations,. 2025 , url =

    2025

  132. [140]

    CoRR , volume =

    Elias Frantar and Saleh Ashkboos and Torsten Hoefler and Dan Alistarh , title =. CoRR , volume =. 2022 , url =. doi:10.48550/ARXIV.2210.17323 , eprinttype =. 2210.17323 , timestamp =

    2022 doi arXiv

  133. [141]

    Layer-Wise Quantization:

    Razvan. Layer-Wise Quantization:. CoRR , volume =. 2024 , url =. doi:10.48550/ARXIV.2406.17415 , eprinttype =. 2406.17415 , timestamp =

    2024 doi arXiv

  134. [142]

    Harris , editor =

    Junchen Zhao and Ali Derakhshan and Jayden Kana Hyman and Junhao Dong and Sangeetha Abdu Jyothi and Ian G. Harris , editor =. CoopQ: Cooperative Game Inspired Layerwise Mixed Precision Quantization for LLMs , booktitle =. 2026 , url =

    2026

  135. [143]

    Lee , editor =

    Yeonhong Park and Jake Hyun and SangLyul Cho and Bonggeun Sim and Jae W. Lee , editor =. Any-Precision. Forty-first International Conference on Machine Learning,. 2024 , url =

    2024

  136. [144]

    Proceedings of the 37th International Conference on Machine Learning,

    Markus Nagel and Rana Ali Amjad and Mart van Baalen and Christos Louizos and Tijmen Blankevoort , title =. Proceedings of the 37th International Conference on Machine Learning,. 2020 , url =

    2020

  137. [145]

    9th International Conference on Learning Representations,

    Yuhang Li and Ruihao Gong and Xu Tan and Yang Yang and Peng Hu and Qi Zhang and Fengwei Yu and Wei Wang and Shi Gu , title =. 9th International Conference on Learning Representations,. 2021 , url =

    2021

  138. [146]

    Mahoney and Kurt Keutzer , editor =

    Zhen Dong and Zhewei Yao and Daiyaan Arfeen and Amir Gholami and Michael W. Mahoney and Kurt Keutzer , editor =. Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual , year =

    2020

  139. [147]

    doi:10.5281/zenodo.12608602 , url =

    Gao, Leo and Tow, Jonathan and Abbasi, Baber and Biderman, Stella and Black, Sid and DiPofi, Anthony and Foster, Charles and Golding, Laurence and Hsu, Jeffrey and Le Noac'h, Alain and Li, Haonan and McDonell, Kyle and Muennighoff, Niklas and Ociepa, Chris and Phang, Jason and...

    doi

  140. [148]

    Llama 2: Open Foundation and Fine-Tuned Chat Models , journal =

    Hugo Touvron and Louis Martin and Kevin Stone and Peter Albert and Amjad Almahairi and Yasmine Babaei and Nikolay Bashlykov and Soumya Batra and Prajjwal Bhargava and Shruti Bhosale and Dan Bikel and Lukas Blecher and Cristian Canton. Llama 2: Open Foundation and Fine-Tuned Ch...

    2023 doi arXiv

  141. [149]

    Efficient Memory Management for Large Language Model Serving with PagedAttention , booktitle =

    Woosuk Kwon and Zhuohan Li and Siyuan Zhuang and Ying Sheng and Lianmin Zheng and Cody Hao Yu and Joseph Gonzalez and Hao Zhang and Ion Stoica , editor =. Efficient Memory Management for Large Language Model Serving with PagedAttention , booktitle =. 2023 , url =. doi:10.1145/...

    2023

  142. [150]

    Mahoney and Kurt Keutzer , title =

    Zhewei Yao and Zhen Dong and Zhangcheng Zheng and Amir Gholami and Jiali Yu and Eric Tan and Leyuan Wang and Qijing Huang and Yida Wang and Michael W. Mahoney and Kurt Keutzer , title =. CoRR , volume =. 2020 , url =. 2011.10680 , timestamp =

    2020 arXiv

  143. [151]

    Parhi , title =

    Xingyi Liu and Keshab K. Parhi , title =. CoRR , volume =. 2023 , url =. doi:10.48550/ARXIV.2304.13539 , eprinttype =. 2304.13539 , timestamp =

    2023 doi arXiv

  144. [152]

    Retrieval-Augmented Generation for Knowledge-Intensive

    Patrick Lewis and Ethan Perez and Aleksandra Piktus and Fabio Petroni and Vladimir Karpukhin and Naman Goyal and Heinrich K. Retrieval-Augmented Generation for Knowledge-Intensive. Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Pr...

    2020

  145. [153]

    Xing and Kwang

    Xijie Huang and Zhiqiang Shen and Shichao Li and Zechun Liu and Xianghong Hu and Jeffry Wicaksana and Eric P. Xing and Kwang. International Conference on Machine Learning,. 2022 , url =

    2022

  146. [154]

    Extreme Compression of Large Language Models via Additive Quantization , booktitle =

    Vage Egiazarian and Andrei Panferov and Denis Kuznedelev and Elias Frantar and Artem Babenko and Dan Alistarh , editor =. Extreme Compression of Large Language Models via Additive Quantization , booktitle =. 2024 , url =

    2024

  147. [155]

    Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,

    Sangjun Lee and Seung. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,. 2025 , url =. doi:10.18653/V1/2025.EMNLP-MAIN.1799 , timestamp =

    2025 doi

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.