Dynamic int8 quantization via Quanto on Whisper-small reduces size by 57% and improves WER on LibriSpeech test sets compared to the unquantized baseline.
In practice, this means storing weights and activations in com- pact formats such asint8orfp8, with memory usage scaling approximately as1/bwherebis the bit-width [6, 7]
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
eess.AS 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Quantizing Whisper-small: How design choices affect ASR performance
Dynamic int8 quantization via Quanto on Whisper-small reduces size by 57% and improves WER on LibriSpeech test sets compared to the unquantized baseline.