REVIEW 1 cited by
Self-Training for End-to-End Speech Translation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
One of the main challenges for end-to-end speech translation is data scarcity. We leverage pseudo-labels generated from unlabeled audio by a cascade and an end-to-end speech translation model. This provides 8.3 and 5.7 BLEU gains over a strong semi-supervised baseline on the MuST-C English-French and English-German datasets, reaching state-of-the art performance. The effect of the quality of the pseudo-labels is investigated. Our approach is shown to be more effective than simply pre-training the encoder on the speech recognition task. Finally, we demonstrate the effectiveness of self-training by directly generating pseudo-labels with an end-to-end model instead of a cascade model.
Forward citations
Cited by 1 Pith paper
-
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
A cascaded speech-to-text translation model that feeds five aligned ASR candidates and self-supervised speech units to a translation model matches end-to-end performance on GigaST, with an English-to-Chinese BLEU of 38.1.
Discussion (0). Continue with ORCID to comment.