On Knowledge Distillation for Direct Speech Translation

Marco Gaido; Marco Turchi; Matteo Negri; Mattia A. Di Gangi

On Knowledge Distillation for Direct Speech Translation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2012.04964 v1 pith:EU6DVCNB submitted 2020-12-09 cs.CL

Marco Gaido , Mattia A. Di Gangi , Matteo Negri , Marco Turchi This is my paper · ORCID

classification cs.CL

keywords knowledgetranslationspeechdirectdistillationtasktransferalleviate

verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments

read the original abstract

Direct speech translation (ST) has shown to be a complex task requiring knowledge transfer from its sub-tasks: automatic speech recognition (ASR) and machine translation (MT). For MT, one of the most promising techniques to transfer knowledge is knowledge distillation. In this paper, we compare the different solutions to distill knowledge in a sequence-to-sequence task like ST. Moreover, we analyze eventual drawbacks of this approach and how to alleviate them maintaining the benefits in terms of translation quality.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Addressing speaker gender bias in large scale speech translation systems
cs.CL 2025-01 conditional novelty 6.0 of 10

Fine-tuning a large speech translation model on GPT-4-reformulated gender-balanced training data raises MuST-SHE feminine-form accuracy from about 10% to over 84% without BLEU loss.

Pith tools