REVIEW 7 cited by
Fine-tuning Large Language Models for Domain-specific Machine Translation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large language models (LLMs) have shown great potential in domain-specific machine translation (MT). However, one major issue is that LLMs pre-trained on general domain corpus might not generalize well to specific domains due to the lack of domain-specific knowledge. To address this issue, this paper focuses on enhancing the domain-specific MT capability of LLMs, by providing high-quality training datasets and proposing a novel fine-tuning framework denoted by DragFT. DragFT augments LLMs via three techniques: (i) Dictionary-enhanced prompting integrates dictionary information into prompts to improve the translation of domain-specific terminology.; (ii) RAG-based few-shot example selection provides high-quality examples that simulate both the domain and style characteristics; (iii) Fine-tuning with few-shot examples further enhances performance when using in-domain examples. We deploy DragFT on three well-known LLM backbones with 13B training parameters to validate its effectiveness. The results on three domain-specific datasets show that DragFT achieves a significant performance boost and shows superior performance compared to advanced models such as GPT-3.5 and GPT-4o. The drastic performance improvement of DragFT over existing LLMs can be attributed to incorporating relevant knowledge while mitigating noise.
Forward citations
Cited by 7 Pith papers
-
Training-Free Token-Level Steering for LLM Personalized Co-Writing
A token-level, training-free steering framework that improves LLM personalized co-writing by mixing the base model's posterior with a kernel-density estimate from a small user dataset.
-
TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
Word-alignment rewards for RL-trained translation raise terminology accuracy on RTT from 54.42 to 56.42 TA without hurting general translation quality.
-
Robot Operation of Home Appliances by Reading User Manuals
A robot system that constructs a symbolic appliance model from a user manual and uses it to reliably execute natural language appliance operation tasks, outperforming direct VLM-based policies.
-
Collaborative Editable Model
CoEM scores user-contributed knowledge fragments using user ratings and LLM attribution, keeps the high scorers in a prompt-level knowledge pool, and reports 76% agreement with FinGPT on fragment value.
-
Optimizing GPT for Video Understanding: Zero-Shot Performance and Prompt Engineering
Zero-shot GPT-4o comes close to production classifiers on several video-moderation tasks, and prompt simplification plus decomposition-aggregation improves accuracy, though key gains are partly fitted to the test set.
-
Aligning Knowledge Graphs and Language Models for Factual Accuracy
ALIGNed-LLM aligns knowledge graph entity embeddings with language model text embeddings through a trainable projection layer, improving question answering accuracy on KG-derived datasets.
-
FuxiMT: Sparsifying Large Language Models for Chinese-Centric Multilingual Machine Translation
FuxiMT combines a frozen BLOOMz model with sparse mixture-of-experts layers, Chinese-first pretraining, and curriculum learning to translate into Chinese from 65 languages, with claimed low-resource gains that the pap...
Discussion (0). Continue with ORCID to comment.