REVIEW 6 cited by
Evaluating o1-Like LLMs: Unlocking Reasoning for Translation through Comprehensive Analysis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The o1-Like LLMs are transforming AI by simulating human cognitive processes, but their performance in multilingual machine translation (MMT) remains underexplored. This study examines: (1) how o1-Like LLMs perform in MMT tasks and (2) what factors influence their translation quality. We evaluate multiple o1-Like LLMs and compare them with traditional models like ChatGPT and GPT-4o. Results show that o1-Like LLMs establish new multilingual translation benchmarks, with DeepSeek-R1 surpassing GPT-4o in contextless tasks. They demonstrate strengths in historical and cultural translation but exhibit a tendency for rambling issues in Chinese-centric outputs. Further analysis reveals three key insights: (1) High inference costs and slower processing speeds make complex translation tasks more resource-intensive. (2) Translation quality improves with model size, enhancing commonsense reasoning and cultural translation. (3) The temperature parameter significantly impacts output quality-lower temperatures yield more stable and accurate translations, while higher temperatures reduce coherence and precision.
Forward citations
Cited by 6 Pith papers
-
Translation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation
A two-stage SFT+RL recipe (TwT) that allocates reasoning depth by input difficulty matches large reasoning models on auto-metric MT quality with 32-60% fewer tokens, but the auto-metric edge is partly the training objective.
-
Can Peter Pan Survive MT? A Stylometric Study of LLMs, NMTs, and HTs in Children's Literature Translation
LLM translations of Peter Pan sit stylistically closer to human translations than NMT outputs do on several child-literature features, but the prompting strategy and possible training-data overlap partly explain the c...
-
TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
Word-alignment rewards for RL-trained translation raise terminology accuracy on RTT from 54.42 to 56.42 TA without hurting general translation quality.
-
Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning
Self-Route uses hidden-layer representations from a brief pre-inference plan to route each question to either short or long chain-of-thought, cutting tokens by 30-55% with under 2% accuracy loss.
-
Reasoning Before Translation: Enhancing Legal Machine Translation with Structured Reasoning
On Swiss legal translation, reinforcement learning with a ChrF reward improves small open models more than supervised fine-tuning, but frontier reasoning models still score higher.
-
DeepSeek in Healthcare: A Survey of Capabilities, Risks, and Clinical Applications of Open-Source Large Language Models
A narrative review of DeepSeek-R1's healthcare capabilities, risks, and applications, without new experiments.
Discussion (0). Sign in to comment.