Paper Citation Record · LEDGER

Conditional Unigram Tokenization with Parallel Data

As of 18 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 0 inbound Pith citation observations for arXiv:2507.07824.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07824 v1

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:35:44.562542Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

32 of 32 outbound references displayed

verified exact3
verified fuzzy10
unresolved18
parse uncertain0
malformed identifier1
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 77f33ca5-ac96-401e-bcd2-7dc775b95995 · outbound

This paper cites Do all languages cost the same? tokenization in the era of commercial language models.

Conditional Unigram Tokenization with Parallel Data Do all languages cost the same? tokenization in the era of commercial language models

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.414116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c0ec52fd-c846-4712-a59d-ba7485d6131d · outbound

This paper cites an unresolved cited work.

Conditional Unigram Tokenization with Parallel Data Unresolved cited work

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.419221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c245d5f8-f3c1-4ebf-9d18-c209eee0b1f3 · outbound

This paper cites F., Della-Pietra, S.

Conditional Unigram Tokenization with Parallel Data F., Della-Pietra, S

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:45.086897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 214d5a65-0d0a-422e-9db2-5db2ca7ec439 · outbound

This paper cites and Gildea, D.

Conditional Unigram Tokenization with Parallel Data and Gildea, D

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:45.070376Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 1d9f4ebb-be58-4a70-9ca1-ec0eebed4b2a · outbound

This paper cites Bilingual subword segmentation for neural machine translation.

Conditional Unigram Tokenization with Parallel Data Bilingual subword segmentation for neural machine translation

Reference 5

Resolution: verified exact; doi, observed 2026-08-06T18:35:44.741472Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation dcf4f5e6-da66-4b00-b4a9-83dd15f92d57 · outbound

This paper cites and Neubig, G.

Conditional Unigram Tokenization with Parallel Data and Neubig, G

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:45.053862Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 404e8589-a896-4f62-9b0b-2032ad944587 · outbound

This paper cites an unresolved cited work.

Conditional Unigram Tokenization with Parallel Data Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T18:35:45.038191Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 66a952df-1706-40f5-b815-ed49da267573 · outbound

This paper cites Beyond literal token overlap: Token alignability for multilinguality.

Conditional Unigram Tokenization with Parallel Data Beyond literal token overlap: Token alignability for multilinguality

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:45.023443Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 276acd2e-72af-4633-882e-c661f88495cb · outbound

This paper cites The state and fate of linguistic diversity and inclusion in the NLP world.

Conditional Unigram Tokenization with Parallel Data The state and fate of linguistic diversity and inclusion in the NLP world

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.453373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c8b25ad3-8890-4910-85d3-930965c088a9 · outbound

This paper cites an unresolved cited work.

Conditional Unigram Tokenization with Parallel Data Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-06T18:35:45.007365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 104eb6a3-2c41-427f-bcca-2142750e42a1 · outbound

This paper cites Subword regularization: Improving neural network translation models with multiple subword candidates.

Conditional Unigram Tokenization with Parallel Data Subword regularization: Improving neural network translation models with multiple subword candidates

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.462215Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e576d87-52e5-4f1c-8f53-f258c86fc470 · outbound

This paper cites and Fraser, A.

Conditional Unigram Tokenization with Parallel Data and Fraser, A

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.992392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 7d48bc60-255f-4c9b-96e7-59f6277e529e · outbound

This paper cites and Helcl, J.

Conditional Unigram Tokenization with Parallel Data and Helcl, J

Reference 13

Resolution: verified exact; doi, observed 2026-08-06T18:35:44.703806Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 51fb6002-29ca-41f8-859a-392575ab6711 · outbound

This paper cites Tokenization impacts multilingual language modeling: Assessing vocabulary allocation and overlap across languages.

Conditional Unigram Tokenization with Parallel Data Tokenization impacts multilingual language modeling: Assessing vocabulary allocation and overlap across languages

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.478471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f61a3ec-f325-4bd5-ac86-9cf12dbc240c · outbound

This paper cites WECHSEL : Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

Conditional Unigram Tokenization with Parallel Data WECHSEL : Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.483452Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d5700e42-f094-4b92-bf54-2cde7530d9cc · outbound

This paper cites No Language Left Behind: Scaling Human-Centered Machine Translation.

Conditional Unigram Tokenization with Parallel Data No Language Left Behind: Scaling Human-Centered Machine Translation

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.488511Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 875828a4-f630-4df6-8355-c065c47909c7 · outbound

This paper cites and Tiedemann, J.

Conditional Unigram Tokenization with Parallel Data and Tiedemann, J

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.976947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 22083a4d-4dde-4c6a-8c77-f23e0616f09d · outbound

This paper cites Bleu: a Method for Automatic Evaluation of Machine Translation.

Conditional Unigram Tokenization with Parallel Data Bleu: a Method for Automatic Evaluation of Machine Translation

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.497932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c66bfc7a-f612-472e-89ff-d201b26e7cc8 · outbound

This paper cites Language Model Tokenizers Introduce Unfairness Between Languages.

Conditional Unigram Tokenization with Parallel Data Language Model Tokenizers Introduce Unfairness Between Languages

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.960471Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation c4060262-5718-436e-ba8a-0be7214a3df2 · outbound

This paper cites How multilingual is multilingual BERT ? In Korhonen, A., Traum, D., and M \`a rquez, L.

Conditional Unigram Tokenization with Parallel Data How multilingual is multilingual BERT ? In Korhonen, A., Traum, D., and M \`a rquez, L

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.506406Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d298363c-ce56-40f3-868a-575b745537f2 · outbound

This paper cites A call for clarity in reporting BLEU scores.

Conditional Unigram Tokenization with Parallel Data A call for clarity in reporting BLEU scores

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.511081Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5fa5563b-b172-4b29-96a3-2fc1dbeb3c5a · outbound

This paper cites Language models are unsupervised multitask learners.

Conditional Unigram Tokenization with Parallel Data Language models are unsupervised multitask learners

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.944507Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 9c0ae07a-b9d7-4497-acd9-a27346c868f9 · outbound

This paper cites C., and Lavie, A.

Conditional Unigram Tokenization with Parallel Data C., and Lavie, A

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.519581Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a8665cf7-5cfd-4b4a-929e-248b00747615 · outbound

This paper cites Tik-to-Tok: Translating Language Models One Token at a Time: An Embedding Initialization Strategy for Efficient Language Adaptation.

Conditional Unigram Tokenization with Parallel Data Tik-to-Tok: Translating Language Models One Token at a Time: An Embedding Initialization Strategy for Efficient Language Adaptation

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.523916Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d79e9c4-25fe-4109-b931-7409933b5139 · outbound

This paper cites Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP.

Conditional Unigram Tokenization with Parallel Data Trans-Tokenization and Cross-lingual Vocabulary Transfers: Language Adaptation of LLMs for Low-Resource NLP

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.528703Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7bb0fe1d-d9b0-45db-95ca-30cfd322eb58 · outbound

This paper cites How Good is Your Tokenizer ? On the Monolingual Performance of Multilingual Language Models.

Conditional Unigram Tokenization with Parallel Data How Good is Your Tokenizer ? On the Monolingual Performance of Multilingual Language Models

Reference 26

Resolution: malformed identifier; no resolver link, observed 2026-08-06T18:35:44.533454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8df6990b-ccaf-428f-8535-be850487643d · outbound

This paper cites W., Reddy, V., Zhang, H., Alameddine, A., Uzan, O., Pinter, Y., and Tanner, C.

Conditional Unigram Tokenization with Parallel Data W., Reddy, V., Zhang, H., Alameddine, A., Uzan, O., Pinter, Y., and Tanner, C

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.928832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 41589531-8b84-4d7b-945a-ea26408c880e · outbound

This paper cites Neural machine translation of rare words with subword units.

Conditional Unigram Tokenization with Parallel Data Neural machine translation of rare words with subword units

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.542993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 457187fc-0531-45c3-883e-f8340b0676e3 · outbound

This paper cites N., Kaiser, ., and Polosukhin, I.

Conditional Unigram Tokenization with Parallel Data N., Kaiser, ., and Polosukhin, I

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T18:35:44.912397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b25b0c18-afce-4873-96ec-1c3513c7fb28 · outbound

This paper cites The U niversity of H elsinki submission to the WMT 19 parallel corpus filtering task.

Conditional Unigram Tokenization with Parallel Data The U niversity of H elsinki submission to the WMT 19 parallel corpus filtering task

Reference 30

Resolution: verified exact; doi, observed 2026-08-06T18:35:44.897215Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 84b8d306-3a99-4b72-a2fc-cd6d3be95d2a · outbound

This paper cites Vocabulary learning via optimal transport for neural machine translation.

Conditional Unigram Tokenization with Parallel Data Vocabulary learning via optimal transport for neural machine translation

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.557893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ff2a1ee5-93e3-4856-ae44-ed3d73095443 · outbound

This paper cites Tokenization and the Noiseless Channel.

Conditional Unigram Tokenization with Parallel Data Tokenization and the Noiseless Channel

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-06T18:35:44.562542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.