Pith. sign in

Paper Citation Record · LEDGER

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content

As of 9 August 2026, this Paper Citation Record lists 58 of 58 outbound references and 0 inbound Pith citation observations for arXiv:2607.16117.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.16117 v1

Coverage vector

measured 58 of 58 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-01T21:22:42.436125Z

measured 58 of 58 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

58 of 58 outbound references displayed

  • verified exact3
  • verified fuzzy0
  • unresolved54
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 4afdfa54-f88a-46e0-9a15-bcbed05c5422 · outbound

This paper cites Alabi, Yanke Mao, Haonan Gao, and En-Shiun Annie Lee.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Alabi, Yanke Mao, Haonan Gao, and En-Shiun Annie Lee

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:36.763206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:36.763206Z digest=sha256:385651ef9d7c1f085ca9edc2d3f8fc529557353f60aac709cf7db0492abbe84c

Observation 7ebeb8e9-7f88-4a7f-b891-d2444363f441 · outbound

This paper cites Do all languages cost the same? tokenization in the era of commercial language models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Do all languages cost the same? tokenization in the era of commercial language models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:36.812325Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:36.812325Z digest=sha256:cce23ef2d347c9bb73c14eac4f423b03ee281ef4a408b51e23b9959e2fe87e01

Observation 690b540f-d575-476a-8e7d-c6a90a6cc88c · outbound

This paper cites Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Massively multilingual sentence embeddings for zero-shot cross-lingual transfer and beyond

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:36.902178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:36.902178Z digest=sha256:c21a0884cd0d1984fffa0d54e6af1e91046a88feb27d1c40d83882f29b44ef60

Observation 89d56c74-8406-4bfb-a1c7-5fb00e869092 · outbound

This paper cites MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content MorphBPE: A Morpho-Aware Tokenizer Bridging Linguistic Complexity for Efficient LLM Training Across Morphologies

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:36.983051Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:36.983051Z digest=sha256:452902bd6d69cc1eeca135f36c1bfb23b5e243b730441f84d49b6a5d531f00d1

Observation d9a50f12-f94e-496d-a3b0-c902f0c676c2 · outbound

This paper cites Longformer: The Long-Document Transformer.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Longformer: The Long-Document Transformer

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.066132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.066132Z digest=sha256:af42ef7bf11a05247dcdca51a3de61f33384ff0caeaab9946a12600f1d2271b1

Observation 1db98461-7eb8-4595-bc6f-c35a2a4aa943 · outbound

This paper cites A massively parallel corpus: the bible in 100 languages.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content A massively parallel corpus: the bible in 100 languages

Reference 6

Resolution
verified exact
doi, observed 2026-08-01T21:23:49.821748Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-01T21:22:37.209113Z digest=sha256:6d1282a15ee33c44a16e7559a46f1e410c5eb7014ee8b22fc00e4b63c4fc023b

Observation 56cfdd58-8a93-49ce-9d91-b3cb70c42225 · outbound

This paper cites Clark, Dan Garrette, Iulia Turc, and John Wieting.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Clark, Dan Garrette, Iulia Turc, and John Wieting

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.281928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.281928Z digest=sha256:ae44f82181f14b3c6f1608326dd8e7b794be0bf7c61c58d70ad67b1d1ddf646d

Observation 1c1471e1-2942-487b-a3f8-870c9090db12 · outbound

This paper cites BERT : Pre-training of deep bidirectional transformers for language understanding.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content BERT : Pre-training of deep bidirectional transformers for language understanding

Reference 8

Resolution
malformed identifier
no resolver link, observed 2026-08-01T21:22:37.384422Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.384422Z digest=sha256:784f08f414a1536553ae0ca49eba7114459fbec7c76eb590442cc4e227147cb4

Observation f84267cb-b37d-44e6-a32e-f03f760090f7 · outbound

This paper cites Multiscale byte language models -- a hierarchical architecture for causal million-length sequence modeling.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Multiscale byte language models -- a hierarchical architecture for causal million-length sequence modeling

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.479630Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.479630Z digest=sha256:193efb0edc228fa0c2ed59f89b2938adfc369a5d9675ec2d8592de4b26079c6e

Observation af455e76-ba7b-4c17-a00b-03e5f6650175 · outbound

This paper cites O mer Veysel C a g atan, Akash Kundu, Martin Bernstorff, Shitao Xiao, Akshita Sukhlecha, Bhavish Pahwa, Rafa Po \'s wiata, Kranthi Kiran GV, Shawon Ashraf, Daniel Auras, Bj \.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content O mer Veysel C a g atan, Akash Kundu, Martin Bernstorff, Shitao Xiao, Akshita Sukhlecha, Bhavish Pahwa, Rafa Po \'s wiata, Kranthi Kiran GV, Shawon Ashraf, Daniel Auras, Bj \

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.572373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.572373Z digest=sha256:404b42cf36c49d2fd2a666a5d48bd01b29b64203cd4045e0756cc7294551a35e

Observation 9b48849d-5b01-4662-8309-4b87b91a1977 · outbound

This paper cites GLM-5: from Vibe Coding to Agentic Engineering.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content GLM-5: from Vibe Coding to Agentic Engineering

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.680542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.680542Z digest=sha256:a2fca572f35fc1f237e08e9fe261b76c5c919ed5456295069e5855827643a9a6

Observation 3c9eeacf-439a-4216-9443-06f56ccc44ce · outbound

This paper cites The Llama 3 Herd of Models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.776856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.776856Z digest=sha256:9132053a7413ae84e3000c4731f5dfdbc3fb50766d477f50dc4a9ed72ab199e9

Observation 57a89f98-0c42-4bb8-affa-5c4801d5e21e · outbound

This paper cites Bitext mining using distilled sentence representations for low-resource languages.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Bitext mining using distilled sentence representations for low-resource languages

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.864150Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.864150Z digest=sha256:a508b829ac0f0953eea7b6327807410741d1a02d34b26315f87af2f988dfae06

Observation 66cc1f93-437d-4249-a7c2-cc3e3cfc178e · outbound

This paper cites HTML Bible Index -- Ukrainian.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content HTML Bible Index -- Ukrainian

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:37.939070Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:37.939070Z digest=sha256:c742ad77f14d570e0b62c876be011a6bcc239d2833d741c388761a581e3b03a8

Observation 4e885ffe-ebd8-4dfa-812c-11fbb4ae657e · outbound

This paper cites Perceiver: General perception with iterative attention.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Perceiver: General perception with iterative attention

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.019718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.019718Z digest=sha256:9aac645944336ac8ff861c1654c4484f163801d888e5beadbeb0006dd50b6fb8

Observation 51b4d924-55d4-48cf-a363-b90deaada197 · outbound

This paper cites Ticls: Tightly coupled language text spotter.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Ticls: Tightly coupled language text spotter

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.087203Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.087203Z digest=sha256:ad17aa209e34c69cb0c8cd40ae267d2f1dfeb906603480cf73a0110aba50e969

Observation 91cc27fb-f243-4255-b5ae-5eb7e8441060 · outbound

This paper cites Lotz, Ingo Ziegler, Phillip Rust, and Desmond Elliott.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Lotz, Ingo Ziegler, Phillip Rust, and Desmond Elliott

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.175841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.175841Z digest=sha256:f2094ba0993742bdcb2ba0613a1670b3768a95bf6ddcd006a17bd1515da5bea6

Observation 471917f3-ca0e-4399-8062-c12b98fd00ba · outbound

This paper cites Supervised contrastive learning.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Supervised contrastive learning

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.269022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.269022Z digest=sha256:6d14dc33e02925b9291b34328c942a7f71748d1e6da20c4fabdde0d9cc145faa

Observation b4e2f324-9862-4c83-bdeb-5478d9520292 · outbound

This paper cites Ocr-free document understanding transformer.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Ocr-free document understanding transformer

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.363007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.363007Z digest=sha256:f5e86cea768d66d2d33fd8321f048e5dc374af14c01661a83c95af73e144e58c

Observation ab8c803d-d344-4aa5-a89c-107a7c3ec915 · outbound

This paper cites Adam: A method for stochastic optimization.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Adam: A method for stochastic optimization

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.463697Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.463697Z digest=sha256:bb403ca57734214a211f679eea5c3bcaeabf32046a2d4e74cb456c29c3dced89

Observation c89ecd3e-30f7-4298-baeb-c123b5584fa9 · outbound

This paper cites E uroparl: A parallel corpus for statistical machine translation.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content E uroparl: A parallel corpus for statistical machine translation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.628112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.628112Z digest=sha256:b65f52249bb623b2f0efc702c336cb6df19b13cd85bdd7962ad1b4265a470a0d

Observation b48456d1-f3bd-4221-b18a-c26cb4e44827 · outbound

This paper cites Subword regularization: Improving neural network translation models with multiple subword candidates.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Subword regularization: Improving neural network translation models with multiple subword candidates

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.779807Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.779807Z digest=sha256:4897e91d5a5b7aa5c576b4b1cbb399d4e42e3b807a1af8a443b5efdf587707ca

Observation 7ba85ef0-8e0b-4cd5-bbe4-627f9a986fef · outbound

This paper cites S entence P iece: A simple and language independent subword tokenizer and detokenizer for neural text processing.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content S entence P iece: A simple and language independent subword tokenizer and detokenizer for neural text processing

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.914733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.914733Z digest=sha256:271ac4df9acca45fa52f76ab8251d417df1410c89f5a645e0f92e1ffdb63cb80

Observation 493f913f-00d2-4540-b3bc-2b1c2c5420a3 · outbound

This paper cites P ix2 S truct: Screenshot parsing as pretraining for visual language understanding.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content P ix2 S truct: Screenshot parsing as pretraining for visual language understanding

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:38.983778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:38.983778Z digest=sha256:ef8f23c130305c21f5e1dbafb18d080d847621cabdb9bf17a5bcb921df5fb7ab

Observation dedbb092-5bd6-4977-9bf3-ec1232f7e99f · outbound

This paper cites Trocr: transformer-based optical character recognition with pre-trained models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Trocr: transformer-based optical character recognition with pre-trained models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:39.135595Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:39.135595Z digest=sha256:bba4f7b07255567ead2ab6ff630c90622f2b8406da8e92065270e262a0d067e9

Observation de52aea0-b594-4c14-b241-c165b657feee · outbound

This paper cites Tokenization impacts multilingual language modeling: Assessing vocabulary allocation and overlap across languages.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Tokenization impacts multilingual language modeling: Assessing vocabulary allocation and overlap across languages

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:39.275565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:39.275565Z digest=sha256:51e69bf28949d66138f8d93ee6a38dc9ac0ce754b0fd8bc3b570b38af4d3b616

Observation ac2178cf-71ee-42c3-82be-3dd35c4887e3 · outbound

This paper cites Character-aware models improve visual text rendering.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Character-aware models improve visual text rendering

Reference 27

Resolution
verified exact
doi, observed 2026-08-01T21:23:49.478668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-01T21:22:39.449884Z digest=sha256:8f65d7821b0d920807a1e5cb839d1b8b11a9001d7e6c948515a9ad743e5b1f74

Observation 1de230ae-c90c-4808-848b-05ba9dfb49e1 · outbound

This paper cites Glyph-byt5: A customized text encoder for accurate visual text rendering.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Glyph-byt5: A customized text encoder for accurate visual text rendering

Reference 28

Resolution
verified exact
doi, observed 2026-08-01T21:23:49.345965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-01T21:22:39.605288Z digest=sha256:e6ac8df7e4c3e63bf939d6624375b298043fd59ecb4e2f544777842834a2c6d2

Observation cae33c4a-309e-4b18-8237-aa5ce9036c2f · outbound

This paper cites Decoupled weight decay regularization.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Decoupled weight decay regularization

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:39.790370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:39.790370Z digest=sha256:d170fac1995e2a8ebf23067c6b94658e7afc25976d73678a02b0bb834b83240e

Observation 7152fbb3-9129-4a9b-971d-25084ce08c86 · outbound

This paper cites Beyond fertility: STRR as a metric for multilingual tokenization evaluation.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Beyond fertility: STRR as a metric for multilingual tokenization evaluation

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:39.929199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:39.929199Z digest=sha256:b1eb16f80e8835adf16cc57d7e0322a9cd5c40fab7508b8c45a0c5c9929ee9da

Observation 4fac4be3-b216-46be-81f3-7fa56dff9d7a · outbound

This paper cites Hierarchical autoregressive transformers: Combining byte- and word-level processing for robust, adaptable language models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Hierarchical autoregressive transformers: Combining byte- and word-level processing for robust, adaptable language models

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.053631Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.053631Z digest=sha256:f8f9d2798bdf6888a9bd1d57f8f4dd027360ca660c663444d67dc70b511d59b9

Observation 664c8bad-32ff-47e9-ab49-1e76f9ff9703 · outbound

This paper cites No Language Left Behind: Scaling Human-Centered Machine Translation.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content No Language Left Behind: Scaling Human-Centered Machine Translation

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.189860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.189860Z digest=sha256:d54599f8bc3ffc06e5c7c50f5a8cdd05f605471b50159e91815d0e7e380ca1d1

Observation aefc44b6-41f4-4a9f-b909-64291cf33feb · outbound

This paper cites Byte latent transformer: Patches scale better than tokens.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Byte latent transformer: Patches scale better than tokens

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.322457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.322457Z digest=sha256:9e1b4c94b0ba57be7b2a40115af713f0adb20235fe3c0a23cac6ec275703d244

Observation 46aa5a51-013f-4128-b092-16f4a6a767c0 · outbound

This paper cites Language model tokenizers introduce unfairness between languages.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Language model tokenizers introduce unfairness between languages

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.485573Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.485573Z digest=sha256:709fd83d5c55fab3beecbccb6318fabbdde419af6e6150f7a489f02d897cf9d3

Observation 1990d8bf-9dc6-4202-9278-839befd4f4fe · outbound

This paper cites Language Models are Unsupervised Multitask Learners , 2019.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Language Models are Unsupervised Multitask Learners , 2019

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.573849Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.573849Z digest=sha256:7793dd7e96d6e64ffcc19c22ea047b5d4e68381b7890ef2cad574fed018dbec3

Observation 6e76818f-677f-4f88-aa77-f5dbdd3cfe6b · outbound

This paper cites Learning transferable visual models from natural language supervision.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Learning transferable visual models from natural language supervision

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.652257Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.652257Z digest=sha256:3691051b8a7907b23137f3c2b22e371bad53f6bdbe8d8599c07cd4b19c59a7e9

Observation 4122f4c8-1c4b-47c0-93ea-8717ca75631b · outbound

This paper cites When every token counts: Optimal segmentation for low-resource language models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content When every token counts: Optimal segmentation for low-resource language models

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.764452Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.764452Z digest=sha256:69fdc2d83c747fb43ced7dfb08b552b3d7a36e6c5686be0a4580b799db0e74ca

Observation fbd82c04-164b-4c27-a563-ae7bf0763a07 · outbound

This paper cites Making monolingual sentence embeddings multilingual using knowledge distillation.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Making monolingual sentence embeddings multilingual using knowledge distillation

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.866372Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.866372Z digest=sha256:9444cc08256931aa8179c348368fc2d6af1f3cdb1c76c39efc690d6aa594714e

Observation 708f2e87-c438-477a-a744-7abc754436c6 · outbound

This paper cites How good is your tokenizer? on the monolingual performance of multilingual language models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content How good is your tokenizer? on the monolingual performance of multilingual language models

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:40.965157Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:40.965157Z digest=sha256:27e78b284c204d19f849e9ad610a49468ba621f5075bbc6f6cb7d851d0d399cb

Observation e93f06ce-3a4d-43f8-893d-0a810a01ee8b · outbound

This paper cites Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, and Desmond Elliott.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Lotz, Emanuele Bugliarello, Elizabeth Salesky, Miryam de Lhoneux, and Desmond Elliott

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.052936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.052936Z digest=sha256:1fdf5634d8b39129c9e3b3fbbe0155b1a6336957b9a939848d0fe9c9b92ac8e1

Observation e818e859-dcd0-4289-8205-6ec2795292d9 · outbound

This paper cites Robust open-vocabulary translation from visual text representations.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Robust open-vocabulary translation from visual text representations

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.122188Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.122188Z digest=sha256:70bb19e5bccbd0906ad4e7559be0f797b7b206ce6d76797126a61bb60dd923e3

Observation 1365610e-2bd3-485b-a54e-c061e205b892 · outbound

This paper cites Neural machine translation of rare words with subword units.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Neural machine translation of rare words with subword units

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.193745Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.193745Z digest=sha256:185331a3e379db9eb0d9c513bee4b6685c654023325f188cc72206a3d0bafcf9

Observation 3e0a7752-7c68-436e-908b-176d6a0ff37c · outbound

This paper cites Dropout: A simple way to prevent neural networks from overfitting.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Dropout: A simple way to prevent neural networks from overfitting

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.268227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.268227Z digest=sha256:e818f32352206b8d9a49b96bdde0af337b25f761f7913dc6a6c58c918f72e872

Observation c9fffd0b-2f2a-4b62-9e69-cd84c0bacdff · outbound

This paper cites Roformer: Enhanced transformer with rotary position embedding.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Roformer: Enhanced transformer with rotary position embedding

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.340888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.340888Z digest=sha256:4b875239584fb1a99d6089e1aa000902601806cce61185a0e0a36a4ead003a6d

Observation acfe7422-013c-4cc1-9c27-d9272676e2dc · outbound

This paper cites Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, and Donald Metzler.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, and Donald Metzler

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.408834Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.408834Z digest=sha256:37a9204464acf33ec5b093ea09d572a60923e6283e56046c9741e2e369de2244

Observation 29f73f0c-4deb-4a60-9613-bf83de9ab48c · outbound

This paper cites Representation Learning with Contrastive Predictive Coding.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Representation Learning with Contrastive Predictive Coding

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.479804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.479804Z digest=sha256:44d400f2958f35843d3a5eaecf05b32b37c19110c0ca04375320919dbfa1653f

Observation 617299bd-5135-4124-9555-716636fe1476 · outbound

This paper cites Attention is all you need.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Attention is all you need

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.567529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.567529Z digest=sha256:6cc1b8111ee9f1d7ef0bfc51525d51787e60ca40e678a74aa701f6a0d89ab2b1

Observation 11952a5d-fd7e-4996-987c-c84521da349f · outbound

This paper cites Error patterns in historical ocr: A comparative analysis of trocr and a vision-language model, 2026.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Error patterns in historical ocr: A comparative analysis of trocr and a vision-language model, 2026

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.668392Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.668392Z digest=sha256:adbfe06c5fc8f4cab0a65f2a0f905970455f7b4b350fbaf2c1227fc2e6516b07

Observation 2b1bc23a-7e06-44ad-ad71-17b0b215c266 · outbound

This paper cites an unresolved cited work.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Unresolved cited work

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.767793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.767793Z digest=sha256:655c969a6ed0e965aee679e0998caa6ff50caf9baec89c131cde07330eb6653b

Observation 0f8bf97d-6fe7-460e-892e-9b1b9dbaa99f · outbound

This paper cites The Holy Bible international: Text and audio bibles.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content The Holy Bible international: Text and audio bibles

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.836533Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.836533Z digest=sha256:2024163e9750dbbf31477027301e5eb43d7ff81e0db7e06f213aa0bfcdff5a6e

Observation 708009d9-68af-40ca-b455-d605ac09cc3d · outbound

This paper cites On layer normalization in the transformer architecture.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content On layer normalization in the transformer architecture

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.913579Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.913579Z digest=sha256:943a7c40a1933248177b1b421309a951c6a8c5b4929924545ae7bc1fe4d121d8

Observation 478fbc81-65c8-4675-8d82-87983efe1de8 · outbound

This paper cites B y T 5: Towards a token-free future with pre-trained byte-to-byte models.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content B y T 5: Towards a token-free future with pre-trained byte-to-byte models

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:41.984457Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:41.984457Z digest=sha256:6758341196de111688e242612366fd01b1697794b74ef890bb570b3c67df3192

Observation 298aecb2-20e4-4f5e-b979-36255ca1d114 · outbound

This paper cites Qwen3 Technical Report.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Qwen3 Technical Report

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.054784Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.054784Z digest=sha256:6b5257814d885e39334173edfbd8686e655842dd27339877a764e28193d03762

Observation 53396375-1549-4551-9fa7-5bac8d3560ea · outbound

This paper cites Megabyte: Predicting million-byte sequences with multiscale transformers.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Megabyte: Predicting million-byte sequences with multiscale transformers

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.124243Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.124243Z digest=sha256:d4faed7c457130dc87e357978f08c3dab4b502ea1b76e60f8404089d101d43a8

Observation 2c442f75-bb28-49ac-a844-8fb21ebba32d · outbound

This paper cites Big bird: Transformers for longer sequences.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Big bird: Transformers for longer sequences

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.199436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.199436Z digest=sha256:3e4bf15de9ed3755d559fdba8a3182fb7da64d5c615b3cec30c083b10c237a65

Observation 072e5444-8eeb-43ff-90a2-3b30afa727cb · outbound

This paper cites Root mean square layer normalization.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content Root mean square layer normalization

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.285016Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.285016Z digest=sha256:4ff4c50d89560177361dace2c6119a549610aa6a5f8115362537b52315435a3b

Observation 5b5aa7f9-d62b-4d8d-8579-5c62997a6ba5 · outbound

This paper cites MIRACL : A multilingual retrieval dataset covering 18 diverse languages.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content MIRACL : A multilingual retrieval dataset covering 18 diverse languages

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.357323Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.357323Z digest=sha256:9772a0bd285ceb9f3b0b8f31c93419cdd1264b1488cd8d153a8acae694a8eb2b

Observation d1798f42-01cd-43cb-938c-cf700bd193e7 · outbound

This paper cites The U nited N ations parallel corpus v1.0.

Rate-Utility Frontiers for Language Encodings: Comparing Tokens, Bytes, and Pixels Under Controlled Linguistic Content The U nited N ations parallel corpus v1.0

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-01T21:22:42.436125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T21:22:42.436125Z digest=sha256:4e59bc75a5dd7c03fddd651ad2d0b7d4734d33c41f89fc2a365c61d7e3521880

Pith citing papers

No inbound Pith citation observations are available.