Pith. sign in

REVIEW 3 major objections 5 minor 117 references

Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models

T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read A structured survey maps context-aware machine translation with LLMs into prompting, fine-tuning, and post-editing/agent approaches, and finds prompting is a solid baseline.

desk verdict A useful map of a young subfield, but the headline comparison of commercial vs open-source LLMs is mislabeled and unsupported. read the letter →

arxiv 2506.07583 v1 pith:NODTR4C4 submitted 2025-06-09 cs.CL cs.AI

classification cs.CLcs.AI
keywords context-awaremachinetranslationdocument-levellargelanguagemodelsin-contextlearningfine-tuningautomaticpost-editingagentsevaluationmetrics
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey aims to fill the gap left by prior reviews that covered either non-LLM document-level translation or LLM-based sentence-level translation. It classifies existing work into prompting approaches, fine-tuning approaches, and a smaller set of other uses such as automatic post-editing and translation agents. The survey's main observations are that prompt-based methods work well enough to serve as baselines, that commercial LLMs outperform open-source LLMs in that prompting setting, and that fine-tuning open-source LLMs brings them close to commercial performance. The motivation matters because sentence-level translation systems still mishandle discourse phenomena such as pronouns, ellipsis, and cross-sentence consistency, and the survey argues that LLM-based document translation is a young area needing a clearer map and better evaluation.

What carries the argument

The organising device is a three-branch taxonomy—prompt-based, fine-tuning-based, and other applications—rendered in three tables that list each surveyed work's LLM and language pair. The taxonomy carries the argument because it turns papers with different models, languages, and evaluation styles into comparable strategy families, and the survey's qualitative conclusions (prompts as baselines, commercial models ahead in prompting, fine-tuning closing the gap) are drawn from reading across those rows. The supporting concepts are the context window, meaning the number of previous sentences available to the model, and the distinction between automatic sentence-level metrics and context-aware evaluation.

What would settle it

Run the same set of document-level prompts on a commercial model like ChatGPT and an open-source model like Llama, with the same test documents and the same automatic and human error metrics, then repeat with fine-tuned versions of the open model; if open models match or beat commercial models in the prompting setting, or if fine-tuning fails to narrow the gap, the survey's central observations would need revision.

Watch

Extended reading notes

Core claim

The paper's central claim is that context-aware translation with LLMs is a distinct, early-stage research area whose scattered results can be organised into three strategy families. In prompting, zero-shot and few-shot in-context learning let an LLM translate documents with surrounding context, and the surveyed papers show that how much context is given and how examples are selected changes quality. In fine-tuning, adapting open LLMs on document-level corpora, often with parameter-efficient methods and instruction-style data, produces the strongest and most consistent gains, and in the reported comparisons it lets open models like Llama and Bloom nearly match closed models like ChatGPT and Tower. A third set of works applies LLMs to automatic post-editing of existing MT output and to agent-based translation frameworks with memory or multi-stage refinement. The survey also claims that standard sentence-level metrics are poorly suited to measuring context quality, and it flags low-resource language translation, translation agents, and context-aware evaluation as the priorities for future work.

Load-bearing premise

The survey's headline comparison—commercial chat models beat open-source models when translating with prompts—is built from papers that use different datasets, metrics, prompts, and model versions, and the survey does not run a controlled head-to-head test to verify it.

Editorial extensions

If this is right

  • A newcomer can establish a strong document-translation baseline with prompting alone, before spending compute on fine-tuning.
  • Fine-tuning open-source LLMs is a viable route to document-level translation quality near commercial systems, which lowers the cost of private or domain-specific deployment.
  • The scarcity of document-level parallel corpora matters less than it once did, because prompting with context and fine-tuning on smaller instruction-style corpora can compensate.
  • Translation agents and automatic post-editing deserve attention as under-explored mechanisms for consistency and fluency across long documents.
  • Evaluation of context-aware translation should move beyond sentence-level BLEU toward structured, interpretable metrics, including LLM-based judging.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper, if the survey's map is right, the commercial-versus-open gap in prompting may be largely a gap in instruction-following and prompt robustness rather than raw translation capacity; a fair test would hold prompts and compute fixed across model families.
  • The repeated finding that multi-turn or conversation-style translation caches context suggests a natural engineering extension: combine an open fine-tuned model with a memory-augmented agent, which the survey's own future-directions section already gestures toward.
  • The survey's comparison is qualitative, so a controlled re-benchmark of all three strategy families on one document-level test set would be the next step; this is our inference, not something the paper itself reports.
  • Because LLM-based post-editing of NMT output shows gains, a testable extension is to use fine-tuned open models as post-editors for their own prompt-based translations, potentially closing the gap to commercial models further.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper is a literature survey of context-aware machine translation with large language models. It organizes recent work into prompt-based approaches (zero-shot prompting and in-context learning), fine-tuning-based approaches, and other applications such as automatic post-editing, translation agents, and evaluation/context-usage analysis, providing three overview tables that list models, language pairs, and tasks. The paper also presents several synthesized observations, most notably that commercial/closed-source LLMs outperform open-source LLMs in prompt-based settings and that prompting serves as a good baseline, and it closes with future research directions. The survey's contribution is primarily taxonomic and organizational rather than experimental.

Significance. If the comparative observations were accurately scoped, this survey would be a useful entry point for researchers new to context-aware LLM translation. Its strengths include recent coverage through 2025, a clear three-part taxonomy, summary tables of covered works, and attention to automatic post-editing and agentic frameworks that are often absent from earlier surveys. The paper does not present new experimental results or formal claims, but its value as a map depends on the reliability of its summary statements. The headline commercial-versus-open comparison is currently internally inconsistent because Tower LLM is classified as commercial despite the paper's own reference describing it as open, and the comparison is drawn from heterogeneous evaluations without systematic aggregation. These issues reduce the reliability of the survey's most visible conclusions and need to be corrected before the paper can serve as a dependable reference.

major comments (3)
  1. [Abstract; Section 5] The abstract and the conclusion describe Tower LLM as a commercial/closed-source model ('such as ChatGPT and Tower LLM') and state that it outperforms open-source LLMs in prompt-based approaches. This is inconsistent with the paper's own reference list: Alves et al. (2024) is titled 'Tower: An open multilingual large language model for translation-related tasks,' and in Section 3 Tower-Chat is discussed as a fine-tuning system (Pombal et al., 2024), not a prompt-based method. Tower also does not appear in Table 1, which lists the prompt-based works covered. Since this comparison is one of the survey's headline findings, the classification must be corrected and the claim it supports must be re-qualified or removed.
  2. [Abstract; Section 5] The comparative claim that commercial/closed-source LLMs outperform open-source LLMs in prompt-based approaches is not supported by a controlled or systematic comparison. The cited studies differ in datasets (WMT, literary texts, chat, news), evaluation metrics (BLEU, COMET, ChrF, MQM, human evaluation), prompting schemes (zero-shot, few-shot, multi-turn), and model families. Some discussed works, such as Cui et al. (2024a), report that zero-shot prompting performs comparably to their proposed context-aware prompting, and several prompt-based studies use only open models. Without an aggregation table or an explicit methodology for combining these heterogeneous results, this observation should be presented as a tentative trend rather than a definitive finding.
  3. [Section 5] The statement that 'fine-tuning Llama or Bloom LLMs achieved nearly the same performance as ChatGPT or Tower LLM' is not tied to a specific supporting comparison in the survey. The paper's own Section 3 discussion reports mixed evidence: Wu et al. (2024a) find GPT-4-Turbo best across language pairs, Wang et al. (2024a) find GPT-4 best except in the Novels domain, and Zafar et al. (2024) report that NLLB outperforms their fine-tuned Llama-3. The conclusion should either name which works support the 'nearly the same performance' claim or soften it to reflect the heterogeneous findings presented in the body of the survey.
minor comments (5)
  1. [Section 3] In the paragraph on Wu et al. (2024a), the phrase 'close-source models' should be 'closed-source models.'
  2. [References] The references list Xu et al. (2023) and Xu et al. (2024a) as separate entries, but both point to the same arXiv identifier (arXiv:2309.11674) and the same title; this duplication should be removed.
  3. [Section 4; Table 3] The text for Wang et al. (2024b) says the experiments used GPT-3.5, GPT-4, and Qwen, while Table 3 lists GPT-3.5-Turbo, GPT-4o-mini, and Qwen2; these entries should be harmonized.
  4. [Section 1] The survey does not state its literature search and inclusion criteria (e.g., venues, time window, keyword sources). Adding a short methodology note would make the coverage boundaries explicit and improve reproducibility for readers.
  5. [References] Several author names contain unusual spacing, such as 'V oita' and 'V olume,' presumably from LaTeX source; these should be corrected in the final formatting.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: this is a survey that aggregates external works; the Tower labeling error is a factual inconsistency, not a self-referential derivation.

full rationale

This paper is a literature survey, not a derivation chain. Its central claims are the taxonomy of prompt-based, fine-tuning-based, and other approaches, plus qualitative observations about the surveyed works. Those observations are summaries of externally cited papers whose results were produced independently of this survey, and each summarized work is attributed to its own authors and tables. There is no equation in the paper, no fitted parameter renamed as a prediction, and no result that is asserted solely on the authority of the authors' own prior work. The self-citations (Appicharla et al., 2023, 2024; Gain et al., 2025) appear only as background references when situating the survey relative to earlier document-level MT and LLM-based MT surveys; they are not load-bearing for the taxonomy or for any synthesized claim. The abstract and conclusion state that commercial LLMs such as ChatGPT and Tower outperform open-source LLMs such as Llama and Bloom, but the paper's own reference list identifies Tower as open (Alves et al., 2024: 'Tower: An open multilingual large language model'), and the cited Pombal et al. (2024) work fine-tunes Tower-Chat rather than using it in a prompt-based setting. This is a substantive accuracy problem for the survey's headline comparison, but it is not circularity: the comparison is an aggregation of external results, not a claim that is made true by the survey's own definitions or by self-citation. No 'uniqueness theorem' or ansatz is imported from the authors' prior work, and no quantity is defined in terms of another quantity it is supposed to predict. The paper is self-contained as a review relative to external benchmarks, so the honest finding is no significant circularity.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The survey's central claims rest on the assumption that the cited papers have been described accurately and that their evaluations are comparable. It does not state a systematic literature search protocol, and it draws comparative conclusions from heterogeneous experiments.

assumptions (3)
  • domain assumption Faithful representation of cited works
    The survey assumes that each cited paper's experiments, models, and results are accurately described. Any misrepresentation would affect the survey's conclusions.
  • domain assumption Representative literature coverage
    The survey assumes the selected works are representative of the research area, despite no systematic search or inclusion criteria being stated.
  • domain assumption Comparability of heterogeneous evaluations
    The observation that commercial LLMs outperform open-source ones assumes that results across papers with different datasets, metrics, and prompting strategies are comparable enough to support a general claim.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models." pith.science (2026). https://pith.science/paper/NODTR4C4

@misc{pith2026250607583,
  author       = {Pith},
  title        = {Pith review of: Beyond the Sentence: A Survey on Context-Aware Machine Translation with Large Language Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NODTR4C4}},
  note         = {Machine review of arXiv:2506.07583}
}
read the original abstract

Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with LLMs. The existing works utilise prompting and fine-tuning approaches, with few focusing on automatic post-editing and creating translation agents for context-aware machine translation. We observed that the commercial LLMs (such as ChatGPT and Tower LLM) achieved better results than the open-source LLMs (such as Llama and Bloom LLMs), and prompt-based approaches serve as good baselines to assess the quality of translations. Finally, we present some interesting future directions to explore.

Figures

Figures reproduced from arXiv: 2506.07583 by the authors.

Figure 1
Figure 1. Overview of the survey presented in this work. [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

117 extracted references · 16 canonical work pages

  1. [1]

    Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, and 1 others. 2023. Gpt-4 technical report. arXiv preprint arXiv:2303.08774

  2. [2]

    Ruchit Agrawal, Marco Turchi, and Matteo Negri. 2018. https://aclanthology.org/2018.eamt-main.1/ Contextual handling in neural machine translation: Look behind, ahead and on both sides . In Proceedings of the 21st Annual Conference of the European Association for Machine Translation, pages 31--40, Alicante, Spain

  3. [3]

    Sweta Agrawal, Amin Farajian, Patrick Fernandes, Ricardo Rei, and Andr \'e F. T. Martins. 2024. https://doi.org/10.1162/tacl_a_00700 Assessing the role of context in chat translation evaluation: Is context helpful and under what conditions? Transactions of the Association for Computational Linguistics, 12:1250--1267

  4. [4]

    Alves, José Pombal, Nuno M

    Duarte M. Alves, José Pombal, Nuno M. Guerreiro, Pedro H. Martins, João Alves, Amin Farajian, Ben Peters, Ricardo Rei, Patrick Fernandes, Sweta Agrawal, Pierre Colombo, José G. C. de Souza, and André F. T. Martins. 2024. https://arxiv.org/abs/2402.17733 Tower: An open multilingual large language model for translation-related tasks . Preprint, arXiv:2402.17733

  5. [5]

    Ramakrishna Appicharla, Baban Gain, Santanu Pal, and Asif Ekbal. 2023. https://aclanthology.org/2023.mtsummit-research.14/ A case study on context encoding in multi-encoder based document-level neural machine translation . In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, pages 160--172, Macau SAR, China. Asia-Pacific Association f...

  6. [6]

    Ramakrishna Appicharla, Baban Gain, Santanu Pal, Asif Ekbal, and Pushpak Bhattacharyya. 2024. https://aclanthology.org/2024.eamt-1.21/ A case study on context-aware neural machine translation with multi-task learning . In Proceedings of the 25th Annual Conference of the European Association for Machine Translation (Volume 1), pages 246--257, Sheffield, UK...

  7. [7]

    Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473

  8. [8]

    Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, and 1 others. 2023. Qwen technical report. arXiv preprint arXiv:2309.16609

Show all 117 references
  1. [9]

    Guangsheng Bao, Yue Zhang, Zhiyang Teng, Boxing Chen, and Weihua Luo. 2021. https://doi.org/10.18653/v1/2021.acl-long.267 G -transformer for document-level machine translation . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the ...

  2. [10]

    Rachel Bawden, Rico Sennrich, Alexandra Birch, and Barry Haddow. 2018. https://doi.org/10.18653/v1/N18-1118 Evaluating discourse phenomena in neural machine translation . In Proceedings of the 2018 Conference of the North A merican Chapter of the Association for Computational ...

  3. [11]

    Rachel Bawden and Fran c ois Yvon. 2023. https://aclanthology.org/2023.eamt-1.16/ Investigating the translation performance of a large multilingual language model: the case of BLOOM . In Proceedings of the 24th Annual Conference of the European Association for Machine Translat...

  4. [12]

    Sid Black, Leo Gao, Phil Wang, Connor Leahy, and Stella Biderman. 2021. https://doi.org/10.5281/zenodo.5297715 GPT-Neo: Large Scale Autoregressive Language Modeling with Mesh-Tensorflow . If you use this software, please cite it using these metadata

  5. [13]

    Eleftheria Briakou, Jiaming Luo, Colin Cherry, and Markus Freitag. 2024. https://doi.org/10.18653/v1/2024.wmt-1.123 Translating step-by-step: Decomposing the translation process for improved translation quality of long-form texts . In Proceedings of the Ninth Conference on Mac...

  6. [14]

    Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey W...

  7. [15]

    Gonzalez, Ion Stoica, and Eric P

    Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023. https://lmsys.org/blog/2023-03-30-vicuna/ Vicuna: An open-source chatbot impressing gpt-4 with 90\

  8. [16]

    Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, Parker Schuh, Kensen Shi, Sasha Tsvyashchenko, Joshua Maynez, Abhishek Rao, Parker Barnes, Yi Tay, Noam Shazeer, Vino...

  9. [17]

    Marta R Costa-Juss \`a , James Cross, Onur C elebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, and 1 others. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672

  10. [18]

    Menglong Cui, Jiangcun Du, Shaolin Zhu, and Deyi Xiong. 2024 a . https://doi.org/10.18653/v1/2024.findings-acl.646 Efficiently exploring large language models for document-level machine translation with in-context learning . In Findings of the Association for Computational Lin...

  11. [19]

    Yiming Cui, Ziqing Yang, and Xin Yao. 2024 b . https://arxiv.org/abs/2304.08177 Efficient and effective text encoding for chinese llama and alpaca . Preprint, arXiv:2304.08177

  12. [20]

    Tim Dettmers, Artidoro Pagnoni, Ari Holtzman, and Luke Zettlemoyer. 2023. Qlora: Efficient finetuning of quantized llms. Advances in neural information processing systems, 36:10088--10115

  13. [21]

    Domenic Donato, Lei Yu, and Chris Dyer. 2021. https://doi.org/10.18653/v1/2021.acl-long.104 Diverse pretrained context encodings improve document translation . In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International...

  14. [22]

    Yichen Dong, Xinglin Lyu, Junhui Li, Daimeng Wei, Min Zhang, Shimin Tao, and Hao Yang. 2025. https://arxiv.org/abs/2504.05614 Two intermediate translations are better than one: Fine-tuning llms for document-level translation refinement . Preprint, arXiv:2504.05614

  15. [23]

    Bryan Eikema and Wilker Aziz. 2020. https://doi.org/10.18653/v1/2020.coling-main.398 Is MAP decoding all you need? the inadequacy of the mode in neural machine translation . In Proceedings of the 28th International Conference on Computational Linguistics, pages 4506--4520, Bar...

  16. [24]

    Denis Elshin, Nikolay Karpachev, Boris Gruzdev, Ilya Golovanov, Georgy Ivanov, Alexander Antonov, Nickolay Skachkov, Ekaterina Latypova, Vladimir Layner, Ekaterina Enikeeva, Dmitry Popov, Anton Chekashev, Vladislav Negodin, Vera Frantsuzova, Alexander Chernyshev, and Kirill De...

  17. [25]

    Maxim Enis and Mark Hopkins. 2024. From llm to nmt: Advancing low-resource machine translation with claude. arXiv preprint arXiv:2404.13813

  18. [26]

    Patrick Fernandes, Ant \'o nio Farinhas, Ricardo Rei, Jos \'e G. C. de Souza, Perez Ogayo, Graham Neubig, and Andre Martins. 2022. https://doi.org/10.18653/v1/2022.naacl-main.100 Quality-aware decoding for neural machine translation . In Proceedings of the 2022 Conference of t...

  19. [27]

    Javier Ferrando, Gerard I G \'a llego, Ioannis Tsiamas, and Marta R Costa-juss \`a . 2023. Explaining how transformers use context to build predictions. arXiv preprint arXiv:2305.12535

  20. [28]

    Markus Freitag, George Foster, David Grangier, Viresh Ratnakar, Qijun Tan, and Wolfgang Macherey. 2021. Experts, errors, and context: A large-scale study of human evaluation for machine translation. Transactions of the Association for Computational Linguistics, 9:1460--1474

  21. [29]

    Markus Freitag, David Grangier, Qijun Tan, and Bowen Liang. 2022. https://doi.org/10.1162/tacl_a_00491 High quality rather than high model probability: Minimum B ayes risk decoding with neural metrics . Transactions of the Association for Computational Linguistics, 10:811--825

  22. [30]

    Baban Gain, Dibyanayan Bandyopadhyay, and Asif Ekbal. 2025. https://arxiv.org/abs/2504.01919 Bridging the linguistic divide: A survey on leveraging large language models for machine translation . Preprint, arXiv:2504.01919

  23. [31]

    Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Alex Vaughan, and 1 others. 2024. The llama 3 herd of models. arXiv preprint arXiv:2407.21783

  24. [32]

    Jiaxin Guo, Yuanchang Luo, Daimeng Wei, Ling Zhang, Zongyao Li, Hengchao Shang, Zhiqiang Rao, Shaojun Li, Jinlong Yang, Zhanglin Wu, and 1 others. 2025. Doc-guided sent2sent++: A sent2sent++ agent with doc-guided memory for document-level machine translation. arXiv preprint ar...

  25. [33]

    Jiaxin Guo, Hao Yang, Zongyao Li, Daimeng Wei, Hengchao Shang, and Xiaoyu Chen. 2024. https://doi.org/10.18653/v1/2024.findings-naacl.42 A novel paradigm boosting translation capabilities of large language models . In Findings of the Association for Computational Linguistics: ...

  26. [34]

    Amr Hendy, Mohamed Abdelrehim, Amr Sharaf, Vikas Raunak, Mohamed Gabr, Hitokazu Matsushita, Young Jin Kim, Mohamed Afify, and Hany Hassan Awadalla. 2023. How good are gpt models at machine translation? a comprehensive evaluation. arXiv preprint arXiv:2302.09210

  27. [35]

    Christian Herold, Yingbo Gao, Mohammad Zeineldeen, and Hermann Ney. 2023. https://doi.org/10.18653/v1/2023.findings-acl.444 Improving language model integration for neural machine translation . In Findings of the Association for Computational Linguistics: ACL 2023, pages 7114-...

  28. [36]

    Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, and 1 others. 2022. Lora: Low-rank adaptation of large language models. ICLR, 1(2):3

  29. [37]

    Hanxu Hu, Jannis Vamvas, and Rico Sennrich. 2025. Source-primed multi-turn conversation helps large language models translate documents. arXiv preprint arXiv:2503.10494

  30. [38]

    Jingjing Huo, Christian Herold, Yingbo Gao, Leonard Dahlmann, Shahram Khadivi, and Hermann Ney. 2020. https://aclanthology.org/2020.wmt-1.71/ Diving deep into context-aware neural machine translation . In Proceedings of the Fifth Conference on Machine Translation, pages 604--6...

  31. [39]

    Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, and 1 others. 2024. Gpt-4o system card. arXiv preprint arXiv:2410.21276

  32. [40]

    Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas ...

  33. [41]

    Marcin Junczys-Dowmunt. 2019. https://doi.org/10.18653/v1/W19-5321 M icrosoft translator at WMT 2019: Towards large-scale document-level neural machine translation . In Proceedings of the Fourth Conference on Machine Translation (Volume 2: Shared Task Papers, Day 1), pages 225...

  34. [42]

    Marzena Karpinska and Mohit Iyyer. 2023. https://doi.org/10.18653/v1/2023.wmt-1.41 Large language models effectively leverage document-level context for literary translation, but critical errors persist . In Proceedings of the Eighth Conference on Machine Translation, pages 41...

  35. [43]

    Yunsu Kim, Duc Thanh Tran, and Hermann Ney. 2019. https://doi.org/10.18653/v1/D19-6503 When and why is document-level context useful in neural machine translation? In Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019), pages 24--34, Hong Kong...

  36. [44]

    Philipp Koehn and Rebecca Knowles. 2017. https://doi.org/10.18653/v1/W17-3204 Six challenges for neural machine translation . In Proceedings of the First Workshop on Neural Machine Translation, pages 28--39, Vancouver. Association for Computational Linguistics

  37. [45]

    Sai Koneru, Miriam Exel, Matthias Huck, and Jan Niehues. 2024. https://doi.org/10.18653/v1/2024.naacl-long.148 Contextual refinement of translations: Large language models for sentence and document-level post-editing . In Proceedings of the 2024 Conference of the North America...

  38. [46]

    Keito Kudo, Hiroyuki Deguchi, Makoto Morishita, Ryo Fujii, Takumi Ito, Shintaro Ozaki, Koki Natsumi, Kai Sato, Kazuki Yano, Ryosuke Takahashi, Subaru Kimura, Tomomasa Hara, Yusuke Sakai, and Jun Suzuki. 2024. https://doi.org/10.18653/v1/2024.wmt-1.14 Document-level translation...

  39. [47]

    Bei Li, Hui Liu, Ziyang Wang, Yufan Jiang, Tong Xiao, Jingbo Zhu, Tongran Liu, and Changliang Li. 2020. https://doi.org/10.18653/v1/2020.acl-main.322 Does multi-encoder help? a case study on context-aware neural machine translation . In Proceedings of the 58th Annual Meeting o...

  40. [48]

    Jiwei Li, Will Monroe, and Dan Jurafsky. 2016. Understanding neural networks through representation erasure. arXiv preprint arXiv:1612.08220

  41. [49]

    Xiang Lisa Li and Percy Liang. 2021. Prefix-tuning: Optimizing continuous prompts for generation. arXiv preprint arXiv:2101.00190

  42. [50]

    Yachao Li, Junhui Li, Jing Jiang, Shimin Tao, Hao Yang, and Min Zhang. 2023. P-transformer: Towards better document-to-document neural machine translation. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 31:3859--3870

  43. [51]

    Yachao Li, Junhui Li, Jing Jiang, and Min Zhang. 2024. Enhancing document-level translation of large language model via translation mixed-instructions. arXiv preprint arXiv:2401.08088

  44. [52]

    Zongyao Li, Zhiqiang Rao, Hengchao Shang, Jiaxin Guo, Shaojun Li, Daimeng Wei, and Hao Yang. 2025. https://aclanthology.org/2025.coling-main.591/ Enhancing large language models for document-level translation post-editing using monolingual data . In Proceedings of the 31st Int...

  45. [53]

    Xi Victoria Lin, Todor Mihaylov, Mikel Artetxe, Tianlu Wang, Shuohui Chen, Daniel Simig, Myle Ott, Naman Goyal, Shruti Bhosale, Jingfei Du, and 1 others. 2021. Few-shot learning with multilingual language models. arXiv preprint arXiv:2112.10668

  46. [54]

    Xiao Liu, Kaixuan Ji, Yicheng Fu, Weng Lam Tam, Zhengxiao Du, Zhilin Yang, and Jie Tang. 2021. P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks. arXiv preprint arXiv:2110.07602

  47. [55]

    Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020. https://doi.org/10.1162/tacl_a_00343 Multilingual denoising pre-training for neural machine translation . Transactions of the Association for Computational...

  48. [56]

    Amin Farajian, Rachel Bawden, Michael Zhang, and Andr \'e F

    Ant \'o nio Lopes, M. Amin Farajian, Rachel Bawden, Michael Zhang, and Andr \'e F. T. Martins. 2020. https://aclanthology.org/2020.eamt-1.24/ Document-level neural MT : A systematic comparison . In Proceedings of the 22nd Annual Conference of the European Association for Machi...

  49. [57]

    Yuanchang Luo, Jiaxin Guo, Daimeng Wei, Hengchao Shang, Zongyao Li, Zhanglin Wu, Zhiqiang Rao, Shaojun Li, Jinlong Yang, and Hao Yang. 2024. https://doi.org/10.18653/v1/2024.wmt-1.97 Context-aware and style-related incremental decoding framework for discourse-level literary tr...

  50. [58]

    Wong, and Longyue Wang

    Chenyang Lyu, Zefeng Du, Jitao Xu, Yitao Duan, Minghao Wu, Teresa Lynn, Alham Fikri Aji, Derek F. Wong, and Longyue Wang. 2024 a . https://aclanthology.org/2024.lrec-main.120/ A paradigm shift: The future of machine translation lies with large language models . In Proceedings ...

  51. [59]

    Xinglin Lyu, Junhui Li, Yanqing Zhao, Min Zhang, Daimeng Wei, Shimin Tao, Hao Yang, and Min Zhang. 2024 b . https://doi.org/10.18653/v1/2024.emnlp-main.1131 D e MPT : Decoding-enhanced multi-phase prompt tuning for making LLM s be better context-aware translators . In Proceedi...

  52. [60]

    Shuming Ma, Dongdong Zhang, and Ming Zhou. 2020. https://doi.org/10.18653/v1/2020.acl-main.321 A simple and effective unified encoder for document-level machine translation . In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 3505...

  53. [61]

    Sameen Maruf and Gholamreza Haffari. 2018. https://doi.org/10.18653/v1/P18-1118 Document context neural machine translation with memory networks . In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1275--12...

  54. [62]

    Sameen Maruf, Fahimeh Saleh, and Gholamreza Haffari. 2021. A survey on document-level neural machine translation: Methods and evaluation. ACM Computing Surveys (CSUR), 54(2):1--36

  55. [63]

    Wafaa Mohammed and Vlad Niculae. 2024. Analyzing context utilization of llms in document-level translation. arXiv preprint arXiv:2410.14391

  56. [64]

    Kelleher, Rejwanul Haque, and Andy Way

    Yasmin Moslem, Gianfranco Romani, Mahdi Molaei, John D. Kelleher, Rejwanul Haque, and Andy Way. 2023. https://doi.org/10.18653/v1/2023.wmt-1.82 Domain terminology integration into machine translation: Leveraging large language models . In Proceedings of the Eighth Conference o...

  57. [65]

    Niklas Muennighoff, Thomas Wang, Lintang Sutawika, Adam Roberts, Stella Biderman, Teven Le Scao, M Saiful Bari, Sheng Shen, Zheng Xin Yong, Hailey Schoelkopf, Xiangru Tang, Dragomir Radev, Alham Fikri Aji, Khalid Almubarak, Samuel Albanie, Zaid Alyafeai, Albert Webson, Edward ...

  58. [66]

    Mathias M \"u ller, Annette Rios, Elena Voita, and Rico Sennrich. 2018. https://doi.org/10.18653/v1/W18-6307 A large-scale test set for the evaluation of context-aware pronoun translation in neural machine translation . In Proceedings of the Third Conference on Machine Transla...

  59. [67]

    Santanu Pal, Sudip Kumar Naskar, Mihaela Vela, and Josef van Genabith. 2016. https://doi.org/10.18653/v1/P16-2046 A neural network based approach to automatic post-editing . In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: S...

  60. [68]

    Jianhui Pang, Fanghua Ye, Derek Fai Wong, Dian Yu, Shuming Shi, Zhaopeng Tu, and Longyue Wang. 2025. https://doi.org/10.1162/tacl_a_00730 Salute the classic: Revisiting challenges of machine translation in the age of large language models . Transactions of the Association for ...

  61. [69]

    Ziqian Peng, Rachel Bawden, and Fran c ois Yvon. 2024. Handling Very Long Contexts in Neural Machine Translation: a Survey. Ph.D. thesis, Projet ANR MaTOS

  62. [70]

    Frithjof Petrick, Christian Herold, Pavel Petrushkov, Shahram Khadivi, and Hermann Ney. 2023. https://doi.org/10.18653/v1/2023.wmt-1.39 Document-level language models for machine translation . In Proceedings of the Eighth Conference on Machine Translation, pages 375--391, Sing...

  63. [71]

    Jose Pombal, Sweta Agrawal, and Andr \'e Martins. 2024. https://doi.org/10.18653/v1/2024.wmt-1.100 Improving context usage for translating bilingual customer support chat with large language models . In Proceedings of the Ninth Conference on Machine Translation, pages 993--100...

  64. [72]

    Matt Post and Marcin Junczys-Dowmunt. 2023. Escaping the sentence-level paradigm in machine translation. arXiv preprint arXiv:2304.12959

  65. [73]

    Ricardo Rei, Jos \'e G. C. de Souza, Duarte Alves, Chrysoula Zerva, Ana C Farinha, Taisiya Glushkova, Alon Lavie, Luisa Coheur, and Andr \'e F. T. Martins. 2022. https://aclanthology.org/2022.wmt-1.52/ COMET -22: Unbabel- IST 2022 submission for the metrics shared task . In Pr...

  66. [74]

    Nils Reimers and Iryna Gurevych. 2019. https://doi.org/10.18653/v1/D19-1410 Sentence- BERT : Sentence embeddings using S iamese BERT -networks . In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference...

  67. [75]

    Suzanna Sia and Kevin Duh. 2023. https://aclanthology.org/2023.mtsummit-research.15/ In-context learning as maintaining coherency: A study of on-the-fly machine translation using large language models . In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, ...

  68. [76]

    Yirong Sun, Dawei Zhu, Yanjun Chen, Erjia Xiao, Xinghao Chen, and Xiaoyu Shen. 2025. https://aclanthology.org/2025.naacl-srw.1/ Fine-grained and multi-dimensional metrics for document-level machine translation . In Proceedings of the 2025 Conference of the Nations of the Ameri...

  69. [77]

    Zewei Sun, Mingxuan Wang, Hao Zhou, Chengqi Zhao, Shujian Huang, Jiajun Chen, and Lei Li. 2022. https://doi.org/10.18653/v1/2022.findings-acl.279 Rethinking document-level neural machine translation . In Findings of the Association for Computational Linguistics: ACL 2022, page...

  70. [78]

    Mingi Sung, Seungmin Lee, Jiwon Kim, and Sejoon Kim. 2024. https://doi.org/10.18653/v1/2024.wmt-1.102 Context-aware LLM translation system using conversation summarization and dialogue history . In Proceedings of the Ninth Conference on Machine Translation, pages 1011--1015, M...

  71. [79]

    Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014. Sequence to sequence learning with neural networks. In Advances in neural information processing systems, pages 3104--3112

  72. [80]

    Hashimoto

    Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. 2023. Stanford alpaca: An instruction-following llama model. https://github.com/tatsu-lab/stanford_alpaca

  73. [81]

    Gemini Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Shibo Wang, and 1 others. 2024 a . Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context. arXiv preprint arXiv:2403.05530

  74. [82]

    Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, Johan Ferret, Peter Liu, Pouya Tafti, Abe Friesen, Michelle Casbon, Sabela Ramos, Ravin Kumar, Charline Le Lan...

  75. [83]

    Katherine Thai, Marzena Karpinska, Kalpesh Krishna, Bill Ray, Moira Inghilleri, John Wieting, and Mohit Iyyer. 2022. https://doi.org/10.18653/v1/2022.emnlp-main.672 Exploring document-level literary machine translation with parallel paragraphs from world literature . In Procee...

  76. [84]

    J \"o rg Tiedemann and Yves Scherrer. 2017. https://doi.org/10.18653/v1/W17-4811 Neural machine translation with extended context . In Proceedings of the Third Workshop on Discourse in Machine Translation, pages 82--92, Copenhagen, Denmark. Association for Computational Linguistics

  77. [85]

    Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth \'e e Lacroix, Baptiste Rozi \`e re, Naman Goyal, Eric Hambro, Faisal Azhar, and 1 others. 2023 a . Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971

  78. [86]

    Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, and 1 others. 2023 b . Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288

  79. [87]

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems, pages 5998--6008

  80. [88]

    Elena Voita, Rico Sennrich, and Ivan Titov. 2019. https://doi.org/10.18653/v1/P19-1116 When a good translation is wrong in context: Context-aware machine translation improves on deixis, ellipsis, and lexical cohesion . In Proceedings of the 57th Annual Meeting of the Associati...

  81. [89]

    Elena Voita, Pavel Serdyukov, Rico Sennrich, and Ivan Titov. 2018. https://doi.org/10.18653/v1/P18-1117 Context-aware neural machine translation learns anaphora resolution . In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: L...

  82. [90]

    Longyue Wang, Zefeng Du, Wenxiang Jiao, Chenyang Lyu, Jianhui Pang, Leyang Cui, Kaiqiang Song, Derek Wong, Shuming Shi, and Zhaopeng Tu. 2024 a . https://doi.org/10.18653/v1/2024.findings-acl.428 Benchmarking and improving long-text translation with large language models . In ...

  83. [91]

    Longyue Wang, Siyou Liu, Mingzhou Xu, Linfeng Song, Shuming Shi, and Zhaopeng Tu. 2023 a . https://doi.org/10.18653/v1/2023.acl-long.187 A survey on zero pronoun translation . In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1:...

  84. [92]

    Longyue Wang, Chenyang Lyu, Tianbo Ji, Zhirui Zhang, Dian Yu, Shuming Shi, and Zhaopeng Tu. 2023 b . https://doi.org/10.18653/v1/2023.emnlp-main.1036 Document-level machine translation with large language models . In Proceedings of the 2023 Conference on Empirical Methods in N...

  85. [93]

    Yutong Wang, Jiali Zeng, Xuebo Liu, Derek F Wong, Fandong Meng, Jie Zhou, and Min Zhang. 2024 b . Delta: An online document-level translation agent based on multi-level memory. arXiv preprint arXiv:2410.08143

  86. [94]

    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, and 1 others. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824--24837

  87. [95]

    BigScience Workshop, Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ili \'c , Daniel Hesslow, Roman Castagn \'e , Alexandra Sasha Luccioni, Fran c ois Yvon, and 1 others. 2022. Bloom: A 176b-parameter open-access multilingual language model. arXiv preprint...

  88. [96]

    Minghao Wu, Thuy-Trang Vu, Lizhen Qu, George Foster, and Gholamreza Haffari. 2024 a . Adapting large language models for document-level machine translation. arXiv preprint arXiv:2401.06468

  89. [97]

    Minghao Wu, Yufei Wang, George Foster, Lizhen Qu, and Gholamreza Haffari. 2024 b . https://aclanthology.org/2024.eacl-long.44/ Importance-aware data augmentation for document-level neural machine translation . In Proceedings of the 18th Conference of the European Chapter of th...

  90. [98]

    Minghao Wu, Yulin Yuan, Gholamreza Haffari, and Longyue Wang. 2024 c . (perhaps) beyond human translation: Harnessing multi-agent collaboration for translating ultra-long literary texts. arXiv preprint arXiv:2405.11804

  91. [99]

    Yangjian Wu and Gang Hu. 2023. https://doi.org/10.18653/v1/2023.wmt-1.15 Exploring prompt engineering with GPT language models for document-level machine translation: Insights and findings . In Proceedings of the Eighth Conference on Machine Translation, pages 166--169, Singap...

  92. [100]

    Zhanglin Wu, Daimeng Wei, Zongyao Li, Hengchao Shang, Jiaxin Guo, Shaojun Li, Zhiqiang Rao, Yuanchang Luo, Ning Xie, and Hao Yang. 2024 d . https://doi.org/10.18653/v1/2024.wmt-1.9 Choose the final translation from NMT and LLM hypotheses using MBR decoding: HW - TSC `s submiss...

  93. [102]

    Haoran Xu, Young Jin Kim, Amr Sharaf, and Hany Hassan Awadalla. 2024 a . https://arxiv.org/abs/2309.11674 A paradigm shift in machine translation: Boosting translation performance of large language models . Preprint, arXiv:2309.11674

  94. [103]

    Haoran Xu, Amr Sharaf, Yunmo Chen, Weiting Tan, Lingfeng Shen, Benjamin Van Durme, Kenton Murray, and Young Jin Kim. 2024 b . https://arxiv.org/abs/2401.08417 Contrastive preference optimization: Pushing the boundaries of llm performance in machine translation . Preprint, arXi...

  95. [104]

    Aiyuan Yang, Bin Xiao, Bingning Wang, Borong Zhang, Ce Bian, Chao Yin, Chenxu Lv, Da Pan, Dian Wang, Dong Yan, and 1 others. 2023. Baichuan 2: Open large-scale language models. arXiv preprint arXiv:2309.10305

  96. [105]

    An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Haoran Wei, and 1 others. 2024 a . Qwen2. 5 technical report. arXiv preprint arXiv:2412.15115

  97. [106]

    Xinye Yang, Yida Mu, Kalina Bontcheva, and Xingyi Song. 2024 b . https://doi.org/10.18653/v1/2024.wmt-1.101 Optimising LLM -driven machine translation with context-aware sliding windows . In Proceedings of the Ninth Conference on Machine Translation, pages 1004--1010, Miami, F...

  98. [107]

    Maria Zafar, Antonio Castaldo, Prashanth Nayak, Rejwanul Haque, and Andy Way. 2024. https://doi.org/10.18653/v1/2024.wmt-1.104 The SETU - ADAPT submissions to WMT 2024 chat translation tasks . In Proceedings of the Ninth Conference on Machine Translation, pages 1023--1030, Mia...

  99. [108]

    Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, and 1 others. 2022. Glm-130b: An open bilingual pre-trained model. arXiv preprint arXiv:2210.02414

  100. [109]

    Biao Zhang, Ankur Bapna, Melvin Johnson, Ali Dabirmoghaddam, Naveen Arivazhagan, and Orhan Firat. 2022 a . https://doi.org/10.18653/v1/2022.acl-long.287 Multilingual document-level translation enables zero-shot transfer from sentences to documents . In Proceedings of the 60th ...

  101. [110]

    Biao Zhang, Barry Haddow, and Alexandra Birch. 2023 a . Prompting large language model for machine translation: A case study. In International Conference on Machine Learning, pages 41092--41110. PMLR

  102. [111]

    Jiacheng Zhang, Huanbo Luan, Maosong Sun, Feifei Zhai, Jingfang Xu, Min Zhang, and Yang Liu. 2018. https://doi.org/10.18653/v1/D18-1049 Improving the transformer translation model with document-level context . In Proceedings of the 2018 Conference on Empirical Methods in Natur...

  103. [112]

    Pei Zhang, Boxing Chen, Niyu Ge, and Kai Fan. 2020. https://doi.org/10.18653/v1/2020.emnlp-main.81 Long-short term masking transformer: A simple but effective baseline for document-level neural machine translation . In Proceedings of the 2020 Conference on Empirical Methods in...

  104. [113]

    Shaolei Zhang, Qingkai Fang, Zhuocheng Zhang, Zhengrui Ma, Yan Zhou, Langlin Huang, Mengyu Bu, Shangtong Gui, Yunji Chen, Xilin Chen, and Yang Feng. 2023 b . https://arxiv.org/abs/2306.10968 Bayling: Bridging cross-lingual alignment and instruction following through interactiv...

  105. [114]

    Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, and 1 others. 2022 b . Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.01068

  106. [115]

    Xuan Zhang, Navid Rajabi, Kevin Duh, and Philipp Koehn. 2023 c . https://doi.org/10.18653/v1/2023.wmt-1.43 Machine translation with large language models: Prompting, few-shot learning, and fine-tuning with QL o RA . In Proceedings of the Eighth Conference on Machine Translatio...

  107. [116]

    P Xing, Hao Zhang, Joseph E

    Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, Dacheng Li, Eric. P Xing, Hao Zhang, Joseph E. Gonzalez, and Ion Stoica. 2023. https://arxiv.org/abs/2306.05685 Judging llm-as-a-judge with mt-bench and chatbot arena . P...

  108. [117]

    online" 'onlinestring :=

    ENTRY address archivePrefix author booktitle chapter edition editor eid eprint eprinttype howpublished institution journal key month note number organization pages publisher school series title type volume year doi pubmed url lastchecked label extra.label sort.label short.list...

  109. [118]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.