REVIEW 4 cited by
Fast Conformer with Linearly Scalable Attention for Efficient Speech Recognition
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Conformer-based models have become the dominant end-to-end architecture for speech processing tasks. With the objective of enhancing the conformer architecture for efficient training and inference, we carefully redesigned Conformer with a novel downsampling schema. The proposed model, named Fast Conformer(FC), is 2.8x faster than the original Conformer, supports scaling to Billion parameters without any changes to the core architecture and also achieves state-of-the-art accuracy on Automatic Speech Recognition benchmarks. To enable transcription of long-form speech up to 11 hours, we replaced global attention with limited context attention post-training, while also improving accuracy through fine-tuning with the addition of a global token. Fast Conformer, when combined with a Transformer decoder also outperforms the original Conformer in accuracy and in speed for Speech Translation and Spoken Language Understanding.
Forward citations
Cited by 4 Pith papers
-
Towards Resource-Efficient Compound AI Systems
A declarative workflow system with an adaptive runtime can cut compound AI workflow completion time and energy use by auto-selecting resources and parallelism.
-
High-precision medical speech recognition through synthetic data and semantic correction: UNITED-MEDASR
A synthetic-data pipeline for medical ASR reports sub-1% WER on standard benchmarks, but the reported numbers are internally inconsistent and not reproducible from the paper.
-
From a Multilingual Streaming ASR Backbone to Kenyan-Language Systems: Data-Centric Adaptation of Nemotron 3.5 for Kikuyu, Dholuo, and Kalenjin
Full-parameter fine-tuning of a streaming multilingual backbone yields internally evaluated 42.97% WER (Kikuyu) and 33.98% WER (Dholuo), with Kalenjin at 68.74% on a filtered diagnostic that the paper itself flags as ...
-
The SVASR System for Text-dependent Speaker Verification (TdSV) AAIC Challenge 2024
An ASR content gate plus concatenated wav2vec-BERT and ReDimNet speaker embeddings achieved normalized min-DCF 0.0452 and rank 2 on the TDSV 2024 text-dependent speaker verification challenge.
Discussion (0). Continue with ORCID to comment.