Pith. sign in

Paper Citation Record · LEDGER

The Roles of English in Evaluating Multilingual Language Models

As of 13 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2412.08392.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.08392 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T17:55:10.666794Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T15:06:55.213500Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-08T15:06:56.620307Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy1
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b3037e3d-a232-40cc-ab68-377717c57b08 · outbound

This paper cites URL: " 'urlintro :=.

The Roles of English in Evaluating Multilingual Language Models URL: " 'urlintro :=

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.573299Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.573299Z digest=sha256:583def71644cc15d8f7adb020e328584d174d1ce86fa2d5bade0d3ed3c897bb1

Observation 3f627e18-60e4-4fd7-96db-1f76e4d0d04b · outbound

This paper cites write newline.

The Roles of English in Evaluating Multilingual Language Models write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.577295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.577295Z digest=sha256:3f9f210934137353699754348bf431a89c0e913d8ee3f3926d24757fe6c0a46d

Observation f8881331-d826-4d8c-aad5-b3271f9adf50 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.083851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.581333Z digest=sha256:51054f923a86e850ca69a4ded85ed000db3c63f065dd9dc0b550b3ad5fdf1408

Observation 6b78d241-0550-4e8d-b8c9-e5ad9abfbdad · outbound

This paper cites IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.584655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.584655Z digest=sha256:b56a6e2c16a908406cbccf11840bd757544d272684352456d06a52c3db9d48d5

Observation bdd75e9e-4178-4b52-9df2-3b9c24bcb6c6 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.074649Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.588515Z digest=sha256:2db39117a0d6a15307163499932d13ac8f3523a9c8b7ba9b5920b99a2afaebdc

Observation ff125af0-9abb-4ab2-9d2b-992f16e46831 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.065832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.591869Z digest=sha256:55a53d568185e32be75e96e8975873772e0d3d9359fa7d61131ca024d2cb25bb

Observation 812b29e0-224b-454b-9460-3c8f446315ae · outbound

This paper cites Lessons from the Trenches on Reproducible Evaluation of Language Models.

The Roles of English in Evaluating Multilingual Language Models Lessons from the Trenches on Reproducible Evaluation of Language Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.595259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.595259Z digest=sha256:e8189f02bf5e4ae4592a69c2e37da786d7e5b38925d008611648b6b9077cd832

Observation 39719529-198b-4788-996b-21ca66141b5e · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.056952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.599181Z digest=sha256:de01cf26ddabb1a6e233a4bd6e5d49f856fefcae2fa71cb1710e21607b634168

Observation 77174f19-1ec2-4e95-a1ad-530a9f8309ff · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.047315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.602594Z digest=sha256:f1bc9e741478be216782215d961a4624e881f7d0741ef24972fd1cbc51a8d9d2

Observation 50ae6a8c-cb1b-4c1f-9958-a6a7721ab64a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.038570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.605852Z digest=sha256:f46c84c6d92ed66dd6b99d68b2d8ad70c60fb68a2006acdb07fffd016716a644

Observation 28b68d3e-4d5c-4e2e-9dcb-9105ba14b097 · outbound

This paper cites How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation.

The Roles of English in Evaluating Multilingual Language Models How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.608871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.608871Z digest=sha256:a2661725fa92d601645bf0929ed9f75e1f3ad48895112d56bd81816a76a6591b

Observation 1034d0d0-0595-4dc9-9bd9-5550f6f3763c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.030436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.612347Z digest=sha256:f42f91b3aa127d914fc3d0f4ec1dd67748a1fccd8336723500af488dcea79216

Observation 470ac45e-e404-47d3-80d8-18cbc571c0ea · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.022422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.615701Z digest=sha256:629ff0c838e30f37cf17a8024caa8c12616bb1d16adced4ee61a6d3823f2d91f

Observation a1332c8b-edcc-4289-8a9a-406a1e975ec1 · outbound

This paper cites o pf, Yannic Kilcher, Dimitri von R \.

The Roles of English in Evaluating Multilingual Language Models o pf, Yannic Kilcher, Dimitri von R \

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T17:55:11.014394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.618800Z digest=sha256:4ad70fcfde1d2dfb2f83591e291ec81a597373430fe9daa4df3b2a8261a7db5d

Observation 9bfb0914-6ed5-4c10-9b4a-7d3157f1cb9e · outbound

This paper cites MaLA-500: Massive Language Adaptation of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models MaLA-500: Massive Language Adaptation of Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.621876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.621876Z digest=sha256:7974830af62b692f536c8dada34b35ef8f2232728348ac45e198b9390819bce1

Observation 2ac7734a-ca2a-4580-8bbb-5364623c4955 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.005907Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.625398Z digest=sha256:f96e07580e81a1bc5ca19adfa454ddfeb03d834fa18d9e23bde4cd03f3b36d1e

Observation 68888c09-6a55-4967-b849-139d32d04ff8 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.996925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.628527Z digest=sha256:2abf3abaefba8546ad01a5ef87e977ba3c28193f8e1dc06bf3ca8e41e3d5c179

Observation 127e6c2c-473a-4fe6-90db-2c51f65380f9 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.987730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.631521Z digest=sha256:63c57281139dec2a9644e944c50ce1f7d992d6fa08b34c794d7026ed3f986602

Observation 6a41e1b0-e11b-4db7-9f3f-c3623fe56f68 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.977733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.634537Z digest=sha256:403f8c0b0c0077c4823bbc96b62e68028c99942bec3f6f4a307b7f3f04bd795d

Observation 429e1d6c-88f2-4f86-8f28-be71240ca772 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.968309Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.637663Z digest=sha256:91753f8aed7935de737ea70497369624ff68752a0dd3a15fc1c335a7f0170190

Observation a895bc84-0eef-4cd4-ac86-b3e583132d3f · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.958543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.642124Z digest=sha256:d1335a83d23af94e584e7bffcb2b60ef23f7128e1c8e13851241ca529c208d0e

Observation 3af72875-7a54-47cd-af1e-57fd6d54fd2a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.947560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.645307Z digest=sha256:8758d1f4afc038f52f3d47374583b990da9c8f6e0a7dc28bcb5760d7bd483e68

Observation 5544f47c-1a80-4f5e-bbaf-be3cc288e9c5 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.938077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.648446Z digest=sha256:ff104158b00651e0de1c85663b526cbfb9fb4b92ce91002c8a1138ad3c98b68c

Observation 8674580a-c8e5-4fe0-91da-23e4e7ef1042 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

The Roles of English in Evaluating Multilingual Language Models Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.651637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.651637Z digest=sha256:03d521a62bbd4af5230ebfef526232cd513cb2c2d5ab8d7944b7c81d345b4615

Observation 734c96f4-c839-4bde-b0a7-d1eb0faf51fb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 25

Resolution
metadata mismatch
raw_fallback, observed 2026-08-11T17:55:10.856385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.655251Z digest=sha256:97ab1d5cf3b7983b67286a27a55f33a36280ddf98dd18da69c330a7d92f770ff

Observation 4ad5eb4c-c7ef-4d94-84a1-5a68724abddb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.928417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.658376Z digest=sha256:cb2b8011b08f91fb62a349782b4e4fbc77a4a9878d1f20f9a2ac786cf726f0ba

Observation 4841b11d-3226-4ac2-a7af-274172aeb907 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.661380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.661380Z digest=sha256:74dfcfe284d5aa816a635a895d254f7ed22434ff0877c98eba1db1bf671ac986

Observation 2a29e947-be23-4ff3-97b9-6a6a636a848c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.918801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.663939Z digest=sha256:66f8400d033af4173a76f1bacf0d97b2d0e43a2994c72ae8a3a8d05d84713e59

Observation 82b774c8-8796-4faf-871a-36c6174e2adb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.909943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.666794Z digest=sha256:a9e99f0e5fe0191e6a02bff08e13a95f4fc7b3f5e61f4d950625a84adfe9c41f

Pith citing papers

Observation 22c55187-dd1c-467d-8772-e84504bdcd3a · inbound

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation cites this paper.

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation The Roles of English in Evaluating Multilingual Language Models

Reference 101

Resolution
verified exact
local_arxiv, observed 2026-08-08T15:06:56.626299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=arxiv_source observed=2026-08-08T15:06:55.213500Z digest=sha256:12b3e6391530295eb92241554af136a025e71fbc5d84dc4efbfe64ccf970759b