Pith. sign in

Paper Citation Record · LEDGER

The Roles of English in Evaluating Multilingual Language Models

As of 13 August 2026, this Paper Citation Record lists 29 of 29 outbound references and 1 inbound Pith citation observation for arXiv:2412.08392.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.08392 v1

Coverage vector

measured 29 of 29 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T17:55:10.666794Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T15:06:55.213500Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-08T15:06:56.620307Z

Reference resolution

29 of 29 outbound references displayed

  • verified exact0
  • verified fuzzy1
  • unresolved27
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b3037e3d-a232-40cc-ab68-377717c57b08 · outbound

This paper cites URL: " 'urlintro :=.

The Roles of English in Evaluating Multilingual Language Models URL: " 'urlintro :=

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.573299Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.573299Z digest=sha256:583def71644cc15d8f7adb020e328584d174d1ce86fa2d5bade0d3ed3c897bb1

Observation 3f627e18-60e4-4fd7-96db-1f76e4d0d04b · outbound

This paper cites write newline.

The Roles of English in Evaluating Multilingual Language Models write newline

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.577295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.577295Z digest=sha256:3f9f210934137353699754348bf431a89c0e913d8ee3f3926d24757fe6c0a46d

Observation f8881331-d826-4d8c-aad5-b3271f9adf50 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.083851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.581333Z digest=sha256:59a1bfb49617d50639952a3b58fafa90add8a7a27c05b00f62d54c6a878f1f17

Observation 6b78d241-0550-4e8d-b8c9-e5ad9abfbdad · outbound

This paper cites IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models IrokoBench: A New Benchmark for African Languages in the Age of Large Language Models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.584655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.584655Z digest=sha256:b56a6e2c16a908406cbccf11840bd757544d272684352456d06a52c3db9d48d5

Observation bdd75e9e-4178-4b52-9df2-3b9c24bcb6c6 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.074649Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.588515Z digest=sha256:08c5e7e05d494650dcf38bc8ffc136ed822a7a8b47052ac836e9b00693869181

Observation ff125af0-9abb-4ab2-9d2b-992f16e46831 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.065832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.591869Z digest=sha256:841bb5b764dce916a6b17121462c336db1b329c26597e9c90c9c11a8a107b552

Observation 812b29e0-224b-454b-9460-3c8f446315ae · outbound

This paper cites Lessons from the Trenches on Reproducible Evaluation of Language Models.

The Roles of English in Evaluating Multilingual Language Models Lessons from the Trenches on Reproducible Evaluation of Language Models

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.595259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.595259Z digest=sha256:e8189f02bf5e4ae4592a69c2e37da786d7e5b38925d008611648b6b9077cd832

Observation 39719529-198b-4788-996b-21ca66141b5e · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.056952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.599181Z digest=sha256:861d7dfdcc9d60c63a3f7a8eee8cc8194af4056d0c98a3200c4b0f1d225a7510

Observation 77174f19-1ec2-4e95-a1ad-530a9f8309ff · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.047315Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.602594Z digest=sha256:d874909b13ff4b5fe91c1701bffde6e59a5df1bcaa12fa0678c7299ac0031dd7

Observation 50ae6a8c-cb1b-4c1f-9958-a6a7721ab64a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.038570Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.605852Z digest=sha256:ab164572f2cef338c218f25331961697f8baa56cf8674cf631baa5a63454564e

Observation 28b68d3e-4d5c-4e2e-9dcb-9105ba14b097 · outbound

This paper cites How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation.

The Roles of English in Evaluating Multilingual Language Models How Good Are GPT Models at Machine Translation? A Comprehensive Evaluation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.608871Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.608871Z digest=sha256:a2661725fa92d601645bf0929ed9f75e1f3ad48895112d56bd81816a76a6591b

Observation 1034d0d0-0595-4dc9-9bd9-5550f6f3763c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.030436Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.612347Z digest=sha256:247a98f5a02ad4fed798223b0aff0d0d409501f50e4b22a6eb8022470e6fe304

Observation 470ac45e-e404-47d3-80d8-18cbc571c0ea · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.022422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.615701Z digest=sha256:6f5d1517911a04692690870f02a688501f638a95bafcc6ca50ed8e1c29ce98fc

Observation a1332c8b-edcc-4289-8a9a-406a1e975ec1 · outbound

This paper cites o pf, Yannic Kilcher, Dimitri von R \.

The Roles of English in Evaluating Multilingual Language Models o pf, Yannic Kilcher, Dimitri von R \

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T17:55:11.014394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.618800Z digest=sha256:7a979ddca442c72e62de30a787b5a3409c5c6e90bc609e6c9b149af354c85be0

Observation 9bfb0914-6ed5-4c10-9b4a-7d3157f1cb9e · outbound

This paper cites MaLA-500: Massive Language Adaptation of Large Language Models.

The Roles of English in Evaluating Multilingual Language Models MaLA-500: Massive Language Adaptation of Large Language Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.621876Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.621876Z digest=sha256:7974830af62b692f536c8dada34b35ef8f2232728348ac45e198b9390819bce1

Observation 2ac7734a-ca2a-4580-8bbb-5364623c4955 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:11.005907Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.625398Z digest=sha256:200ccbaa78e40ee802ab4b5752c9765345b24847fac2bca6807b8a8ea8139fe9

Observation 68888c09-6a55-4967-b849-139d32d04ff8 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.996925Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.628527Z digest=sha256:34a04e0fee0bf7e7a88f4ad486a882a0701f4609e553495242f752712c98a776

Observation 127e6c2c-473a-4fe6-90db-2c51f65380f9 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.987730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.631521Z digest=sha256:30f63e8a2e84e693e8cfbe740d93ef634a0071d70252bc5d49ef7829ce436770

Observation 6a41e1b0-e11b-4db7-9f3f-c3623fe56f68 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.977733Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.634537Z digest=sha256:7c24cc43107c4957f7a1d2e04e6af404a26e14076ac730bf040c5c9cd7535986

Observation 429e1d6c-88f2-4f86-8f28-be71240ca772 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.968309Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.637663Z digest=sha256:156eaba990976b54431edb9bae6e1646fbb65ccad5cb1cd50b01a3b5980b4920

Observation a895bc84-0eef-4cd4-ac86-b3e583132d3f · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.958543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.642124Z digest=sha256:c779cb682fd21a5d507aaa95647422764463d79f8901abef530ab2309fd12bfc

Observation 3af72875-7a54-47cd-af1e-57fd6d54fd2a · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.947560Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.645307Z digest=sha256:0cf9c5b5203752d69d8c17c65011cdd4b2931c3cd505e9934f4e7db76f5d74a4

Observation 5544f47c-1a80-4f5e-bbaf-be3cc288e9c5 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.938077Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.648446Z digest=sha256:c3cad02f68a67b66be0063a47b2412340adf5c4964ea316a4201f69f3073350c

Observation 8674580a-c8e5-4fe0-91da-23e4e7ef1042 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

The Roles of English in Evaluating Multilingual Language Models Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.651637Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.651637Z digest=sha256:03d521a62bbd4af5230ebfef526232cd513cb2c2d5ab8d7944b7c81d345b4615

Observation 734c96f4-c839-4bde-b0a7-d1eb0faf51fb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 25

Resolution
metadata mismatch
raw_fallback, observed 2026-08-11T17:55:10.856385Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.655251Z digest=sha256:6aa66266f735d0ee405c61eb890eefba9d3e2285996e9d56926ad54bb3798a42

Observation 4ad5eb4c-c7ef-4d94-84a1-5a68724abddb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.928417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.658376Z digest=sha256:ec218c8534449b6bfa64d01483f41f1b529c23740f2486efe3b9b90e420aca3e

Observation 4841b11d-3226-4ac2-a7af-274172aeb907 · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T17:55:10.661380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T17:55:10.661380Z digest=sha256:74dfcfe284d5aa816a635a895d254f7ed22434ff0877c98eba1db1bf671ac986

Observation 2a29e947-be23-4ff3-97b9-6a6a636a848c · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.918801Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.663939Z digest=sha256:e18d922c7d125319b81f77b24b929d798c21422ab6a8da4686fa769fd456aadd

Observation 82b774c8-8796-4faf-871a-36c6174e2adb · outbound

This paper cites an unresolved cited work.

The Roles of English in Evaluating Multilingual Language Models Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-11T17:55:10.909943Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-11T17:55:10.666794Z digest=sha256:59d53860032bba986d79b07625d11bcdf4a708467be56242ca2171d40fdd7a65

Pith citing papers

Observation 22c55187-dd1c-467d-8772-e84504bdcd3a · inbound

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation cites this paper.

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation The Roles of English in Evaluating Multilingual Language Models

Reference 101

Resolution
verified exact
local_arxiv, observed 2026-08-08T15:06:56.626299Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=arxiv_source observed=2026-08-08T15:06:55.213500Z digest=sha256:6135355b9bb83f7a3e729d380982107272cba8253614134bb037fee54dc394cc