The reviewed record of science sign in
Pith

arxiv: 2211.15009 · v1 · pith:OY7Z2DJV · submitted 2022-11-28 · cs.CL

BJTU-WeChat's Systems for the WMT22 Chat Translation Task

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:OY7Z2DJVrecord.jsonopen to challenge →

classification cs.CL
keywords datachatcometenglish-germanfine-tuninggenerationscoresstage
0
0 comments X
read the original abstract

This paper introduces the joint submission of the Beijing Jiaotong University and WeChat AI to the WMT'22 chat translation task for English-German. Based on the Transformer, we apply several effective variants. In our experiments, we utilize the pre-training-then-fine-tuning paradigm. In the first pre-training stage, we employ data filtering and synthetic data generation (i.e., back-translation, forward-translation, and knowledge distillation). In the second fine-tuning stage, we investigate speaker-aware in-domain data generation, speaker adaptation, prompt-based context modeling, target denoising fine-tuning, and boosted self-COMET-based model ensemble. Our systems achieve 0.810 and 0.946 COMET scores. The COMET scores of English-German and German-English are the highest among all submissions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.