Pith. sign in

Paper Citation Record · LEDGER

Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

As of 9 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 5 inbound Pith citation observations for arXiv:2403.06265.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2403.06265 v2

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 5 of 5 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 5 of 5 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T05:40:47.736679Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-18T05:52:24.931394Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 750354bf-6abd-424d-8f91-2a2e8c6c0b95 · inbound

Bit-level BPE: Below the byte boundary cites this paper.

Bit-level BPE: Below the byte boundary Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T05:40:47.736679Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T05:40:47.736679Z digest=sha256:54ba4cb8b639fe2882f8e6493f9ce215b77b85b6b2d0657878eedfb2039af82c

Observation 2b14736c-197a-4e1b-8386-6d34f635b68d · inbound

Improving Large Language Models with Concept-Aware Fine-Tuning cites this paper.

Improving Large Language Models with Concept-Aware Fine-Tuning Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T05:28:23.856911Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T05:28:23.856911Z digest=sha256:7e122cccb0b52b53132072bc6c486e744ec21269b7e2a1367280017505d09ae6

Observation 1d5a7a66-27f0-4744-9fa0-329ba24fd0b1 · inbound

Train It and Forget It: Merge Lists are Unnecessary for BPE Inference in Language Models cites this paper.

Train It and Forget It: Merge Lists are Unnecessary for BPE Inference in Language Models Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-05T22:43:22.326571Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T22:43:22.326571Z digest=sha256:9d2d1659a1639e391e58b6a4c0a84bd42c45842b626e39f4f855ae49f8f085b8

Observation 3804cdc8-8cc3-4706-8333-c75845585452 · inbound

Foundation Models for Discovery and Exploration in Chemical Space cites this paper.

Foundation Models for Discovery and Exploration in Chemical Space Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Reference 156

Resolution
verified exact
arxiv_id, observed 2026-05-18T05:52:24.933919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-18T05:52:10.848118Z digest=sha256:af0f99f5abad0ec6498ca0bf3001813985d2504319d9533f9735045b3cb40168

Observation a47a92df-9d5d-4660-a792-89b3ac0c11a7 · inbound

The Roots of Performance Disparity in Multilingual Language Models: Intrinsic Modeling Difficulty or Design Choices? cites this paper.

The Roots of Performance Disparity in Multilingual Language Models: Intrinsic Modeling Difficulty or Design Choices? Unpacking Tokenization: Evaluating Text Compression and its Correlation with Model Performance

Reference 3

Resolution
metadata mismatch
arxiv_id, observed 2026-05-16T15:01:03.886358Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-16T14:59:02.533789Z digest=sha256:b65f8cdcec44385ae68bfc19ed0aa0fd60ab33586aad065cee69074734f34488