Pith. sign in

REVIEW 1 cited by

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.19884 v1 pith:P253ZE6C submitted 2024-07-29 cs.CL

Preliminary WMT24 Ranking of General MT Systems and LLMs

Tom Kocmi , Eleftherios Avramidis , Rachel Bawden , Ondrej Bojar , Anton Dvorkovich , Christian Federmann , Mark Fishel , Markus Freitag
show 13 more authors
Thamme Gowda Roman Grundkiewicz Barry Haddow Marzena Karpinska Philipp Koehn Benjamin Marie Kenton Murray Masaaki Nagata Martin Popel Maja Popovic Mariya Shmatova Stein{\th}\'or Steingr\'imsson Vil\'em Zouhar
This is my paper
classification cs.CL
keywords rankinggeneralpreliminaryautomaticsystemswmt24duringevaluation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. MADE: Beyond Scoring via a Multilingual Agentic Diagnosing Engine for Fine-Grained Evaluation Insights

    cs.CL 2026-06 unverdicted novelty 6.0

    MADE is a new multilingual agentic diagnosing engine that produces higher-quality diagnostic reports (47% better than baseline) on a large-scale evaluation substrate covering 33 model families and 26 languages.