REVIEW 3 cited by
Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We employ a combination of recent developments in semi-supervised learning for automatic speech recognition to obtain state-of-the-art results on LibriSpeech utilizing the unlabeled audio of the Libri-Light dataset. More precisely, we carry out noisy student training with SpecAugment using giant Conformer models pre-trained using wav2vec 2.0 pre-training. By doing so, we are able to achieve word-error-rates (WERs) 1.4%/2.6% on the LibriSpeech test/test-other sets against the current state-of-the-art WERs 1.7%/3.3%.
Forward citations
Cited by 3 Pith papers
-
OMAR-RQ: Open Music Audio Representation Model Trained with Multi-Feature Masked Token Prediction
OMAR-RQ, an open 580M-parameter music audio model trained with multi-codebook, multi-feature masked token prediction on 330k hours, reports leading open-model results on several MIR benchmarks.
-
ASKD-Whisper: Adaptive Self-knowledge Distillation for Efficient and Low-Latency Automatic Speech Recognition
A distillation method that decays teacher loss then applies self-distillation yields a Whisper-derived ASR model with 5x lower latency and slightly better average WER only on in-domain noisy datasets.
-
Contextualized Token Discrimination for Speech Search Query Correction
CTD uses BERT token representations plus a composition layer to correct Chinese spelling errors in ASR queries, but the reported gains lack matched baselines and released data.
Discussion (0). Continue with ORCID to comment.