Pith. sign in

Paper Citation Record · LEDGER

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora

As of 14 August 2026, this Paper Citation Record lists 97 of 97 outbound references and 0 inbound Pith citation observations for arXiv:2608.09093.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.09093 v1

Coverage vector

measured 97 of 97 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T23:46:08.884591Z

measured 97 of 97 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

97 of 97 outbound references displayed

  • verified exact16
  • verified fuzzy28
  • unresolved50
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch3

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7d80d665-7783-47b8-b398-985c485bc325 · outbound

This paper cites OLMo-core: src/scripts/official/OLMo3/.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OLMo-core: src/scripts/official/OLMo3/

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.516340Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.516340Z digest=sha256:eb03ab8645068184720ad192cc26035ab87a7216a3e47500686362da38ec012c

Observation 7b1702d0-a405-4401-b8c6-294d43e24ab5 · outbound

This paper cites Physics of Language Models: Part 3.1, Knowledge Storage and Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.520788Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.520788Z digest=sha256:f41d896fa6a003c0618811f4758ef729017c769513a9fd6fbc7e02ac073b803a

Observation 08c41e25-757f-40c0-b855-2fd6185ed4d1 · outbound

This paper cites Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Altmann, Giampaolo Cristadoro, and Mirko Degli Esposti

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.525122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.525122Z digest=sha256:ebd26999b783e37fd7aee5af1e487e3ba791dca104695a9205c799746ea06fdf

Observation 2ca7b3bd-3eec-4f70-879a-c680a63efbe1 · outbound

This paper cites Álvarez-Lacalle, B.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Álvarez-Lacalle, B

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.529259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.529259Z digest=sha256:b2d7471066e1f9e36a6a5174359fa11d0bd4a200292434d2bcbc1a8a8e4872d4

Observation a7e1a1d5-c899-4e67-8e42-2ff258354cfc · outbound

This paper cites Predicting the Emergence of Induction Heads in Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Predicting the Emergence of Induction Heads in Language Model Pretraining

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.533454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.533454Z digest=sha256:d669267481728888c6eb62795bb2b9cb1798a703eb2c49a153a6db3c88b4935c

Observation 4b526753-8d16-4b72-9684-f05e771197f8 · outbound

This paper cites Docling Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Docling Technical Report

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.537942Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.537942Z digest=sha256:5e8264f4e92444aebc0bcfd050eefb55052bcec2f89ebcda49953eced0683cf6

Observation 3ee3c7b5-e28b-4441-98da-1e15113f6aae · outbound

This paper cites Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hubs or Fringes: Pretraining Data Selection via Web Graph Centrality

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.988195Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.542506Z digest=sha256:920cfe8cd4b99936f0241dfcf9a8cbf63d1b5b33682381cebbf33cf25db56e1d

Observation 281a80ca-56a9-4770-bf0d-cf4a8498a064 · outbound

This paper cites One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora One Token Away from Collapse: The Fragility of Instruction-Tuned Helpfulness

Reference 8

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.972459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.546573Z digest=sha256:f4c57a6380342763398507026bfe70d0fa4c7473b47b51999907597519aaf92f

Observation 41bcf5ad-13c7-433a-a79e-24192c9b15cb · outbound

This paper cites trafilatura: trafilatura/xml.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora trafilatura: trafilatura/xml.py

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.550671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.550671Z digest=sha256:1ae52640a733c983aca59e2f261184781f7356159541d04410db57ab285d7b20

Observation fe866f33-5d83-4152-a709-23cb068733a7 · outbound

This paper cites so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora so much depends / upon / a whitespace: Why whitespace matters for poets and LLMs

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.554957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.554957Z digest=sha256:6aafbf18bf5b49892c63ce691bbe8da30e9690264893f501193eee0b91bb1d57

Observation 2f9d920d-da0f-464f-9bd6-bbb8cda7e9ab · outbound

This paper cites Datasheet for the Pile.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheet for the Pile

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.558757Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.558757Z digest=sha256:c88bf02a6bb20288b9bdc6960267ca70e0f3782f4f0859df5800311b79ff5d31

Observation f461e1e9-fc02-44e2-8ec1-199119b99b6c · outbound

This paper cites Document structure in long document transformers.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Document structure in long document transformers

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.562683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.562683Z digest=sha256:14191d09cbda0e983bac57ba3b643f2116560e9e1663ac3a2ee258916c77d198

Observation 8de5518a-bc11-4239-b640-0938ff3c83a7 · outbound

This paper cites Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Institutional Books 1.0: A 242B token dataset from Harvard Library's collections, refined for accuracy and usability

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.566283Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.566283Z digest=sha256:6fb704782d759dc7a308691d8491eba61dcef70e8d873647e1a74941b9f45260

Observation 43aa3385-dc1c-4f16-b758-417d27f747bb · outbound

This paper cites The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The hyperfitting phenomenon: Sharpening and stabilizing LLMs for open-ended text generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.570096Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.570096Z digest=sha256:ba8838e8f55c7361b099ef15eca9c3b49fab609d77abf16078081dcbff80be74

Observation 156cc986-1daa-496c-8fe1-8c5cc669b1fc · outbound

This paper cites LADM: Long-context training data selection with attention-based dependency measurement for LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LADM: Long-context training data selection with attention-based dependency measurement for LLMs

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.573675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.573675Z digest=sha256:9a58ff73dfa819d50e5a3bbfc167247f0e0e0efa365eafa4470b07125b14b487

Observation 4d1abd8a-90fd-4fb2-a152-b747d8e0faf0 · outbound

This paper cites Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Demystifying Training-Time Augmentation for Data-Constrained Language Model Pretraining

Reference 16

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.934456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.577429Z digest=sha256:bbd26efa53a2737a3c6c67fca1c7d798fcf6d8c6973cd94f3786d7af7d91e693

Observation d160b479-63d7-48c9-9ddb-34bcb237ebf9 · outbound

This paper cites Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing for large language models pretraining: A survey and outlook.Data Intelligence, 8, 2026

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.581164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.581164Z digest=sha256:1f56b114150f5f9d5b58eeb83d1f6ee1bd72f525b42f89c1a3e2979e17c22f39

Observation 1e9d02fe-702a-4a6d-9bd9-36f582b86f14 · outbound

This paper cites BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.585204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.585204Z digest=sha256:2a23c0221d65e2410ac627bab76b4058a7e0a09170f0e2f5dfeb4eb235787506

Observation 0027d995-38f6-4114-be5c-b034cb9789c5 · outbound

This paper cites DeepSeek-V3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DeepSeek-V3 Technical Report

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.589022Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.589022Z digest=sha256:17a3c7d2beba11077e3a00044ca397738a17aae1b31ebab6cebff841b1316f38

Observation d17b519e-7057-4453-a0ee-27e1357acfee · outbound

This paper cites Beyond length: Quantifying long-range information for long-context LLM pretraining data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond length: Quantifying long-range information for long-context LLM pretraining data

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.592974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.592974Z digest=sha256:7e388e3d1537b1bbcc762f0b29bf5e13955e2fbf054f309f00750b86fd319e58

Observation dc48d7d6-ec33-42c2-a612-f06bfed0e0b9 · outbound

This paper cites Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Documenting large webtext corpora: A case study on the Colossal Clean Crawled Corpus

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.596787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.596787Z digest=sha256:097b32c57d068e8449b330acb6cf9a5c83da1ca96585f74c39164a76c94f0255

Observation 60dba6c3-a6b3-4fb0-b134-fa4678e33448 · outbound

This paper cites Smith, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Smith, and Jesse Dodge

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.600442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.600442Z digest=sha256:bd96a7dc4a8831c4b4b106484b765d1dfc035c134f3c1fa82fe30ee914d0f6dd

Observation 2f086de1-d48e-434e-9b24-b4b1eb57ce2e · outbound

This paper cites DoGE: Domain Reweighting with Generalization Estimation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DoGE: Domain Reweighting with Generalization Estimation

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.603929Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.603929Z digest=sha256:778db00144695b1aafa222c24c0787e9d8d2dc2f1b6979e876d5adf2c1b146e9

Observation a3e7197c-7b1b-46bc-a46d-1c4d09f3ff21 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 24

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.886029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.607893Z digest=sha256:6e5d274c28714c8d54ed145eebc55a8bbd963544e70c447c61183809ccdb64e9

Observation 3e9aba69-4f7d-463e-95a0-eb3bf5b0e4bf · outbound

This paper cites NExtLong: Toward effective long-context training without long documents.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora NExtLong: Toward effective long-context training without long documents

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.611346Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.611346Z digest=sha256:6a19293bf36b7f452c3e214c35616580e017060cc9dbcdf39fa01d5b081b1657

Observation 780f5689-7f57-44f5-ba34-548b09c5bf5b · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.615026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.615026Z digest=sha256:f1986d2efddac58c2cf2725fc3c42b2b26a945cada2fd493f91d6f10669195e5

Observation 752ff431-3dd6-4c6f-a132-661c6eab5275 · outbound

This paper cites Wichmann.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Wichmann

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.618858Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.618858Z digest=sha256:dee5fd9743b1f2d591d8f938deb70fa281890ce9933adb3375cfc5450e7c5a4b

Observation fbbda0e3-3cdd-4758-98c2-c72dd6e775a1 · outbound

This paper cites Hermann, Hossein Mobahi, Thomas Fel, and Michael C.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Hermann, Hossein Mobahi, Thomas Fel, and Michael C

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.622436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.622436Z digest=sha256:6c03dc766e9ced2369b3067c9ba689d149aa6b74ed877a2b10a0670377416a26

Observation b64d7edb-c0ac-44e5-85ea-1cc7665e7609 · outbound

This paper cites The curious case of neural text degeneration.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The curious case of neural text degeneration

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.626015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.626015Z digest=sha256:119fa90781c6771393f1ac6a5e7babea744610167cc2c1461528348f15c2263b

Observation aa679acf-0007-439e-b231-fad4420d4a08 · outbound

This paper cites FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora FinePDFs dataset card.https://huggingface.co/datasets/HuggingFaceFW/ finepdfs, 2025

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.629298Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.629298Z digest=sha256:ecfb2f9ed53843da5fa31a3efceb95bc4b42644e0a389cd8e859ba3290c4cf17

Observation 3c955657-891e-4f49-84d4-8db2aa5e1140 · outbound

This paper cites SmolLM3: smol, multilingual, long-context reasoner.https://huggingface.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora SmolLM3: smol, multilingual, long-context reasoner.https://huggingface

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.632840Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.632840Z digest=sha256:7be1a28fd72803100319c39b7ff6e7471131ef7e312d84830254c59dada5499b

Observation 862abf38-3a6a-40c5-93b0-a12c7dca6b4e · outbound

This paper cites datatrove: src/datatrove/pipeline/extractors/trafilatura.py.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora datatrove: src/datatrove/pipeline/extractors/trafilatura.py

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.636370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.636370Z digest=sha256:a08c2790492c472cdf2f267b71f057e2074526bee8619e90e6a7f0f5df58b507

Observation 26f2f108-79da-4d13-9933-880d8f48d324 · outbound

This paper cites propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora propella-1: Multi- property document annotation for LLM data curation at scale.arXiv preprint arXiv:2602.12414,

Reference 33

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.797822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.640149Z digest=sha256:e51d988660e26b7ae2e0072c4f8366f192c20cf789667d56ee0df6d15280a121

Observation 8fd8c20a-b9e8-4d63-8eb5-69148ae621eb · outbound

This paper cites ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ISO 32000-1:2008 — document management: Portable document format — part 1: PDF 1.7.https://www.iso.org/standard/51502.html, 2008

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.372740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.648169Z digest=sha256:cd7e515b50b45e036df42301389c05fb3c55ca4cd65821d97074a549e89e966e

Observation 20791109-1ad6-4676-8a88-0b2e79946650 · outbound

This paper cites EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora EntropyLong: Effective long-context training via predictive uncertainty.arXiv preprint arXiv:2510.02330, 2025

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.651907Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.651907Z digest=sha256:59d056eebe7e0ffb866c1621436e32f02b7790493e35f6d1e0b156bdc06384b0

Observation 8d9332d1-f141-423a-b1ca-9e2f33cbea40 · outbound

This paper cites Characterizing Narrative Content in Web-scale LLM Pretraining Data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Characterizing Narrative Content in Web-scale LLM Pretraining Data

Reference 36

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.650579Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.655949Z digest=sha256:c67c5c1d53e3372fe5f54cfe55cb45c5b93da63a827a3476ecf16c9872f018b5

Observation b3db8665-93de-423c-ab03-44d3c2ed960e · outbound

This paper cites The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.659888Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.659888Z digest=sha256:d453d6f4a5e66cb01cd88494a998962c64354e47fc2d5fafaeeb17fc2d52986d

Observation 8770db68-bc35-41c0-a8bd-1816e6f2bbc5 · outbound

This paper cites Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.663478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.663478Z digest=sha256:6c4c6ef18cea414b8a169e0745bd5d4cc83922910b189b703df9dcf18c09a1ca

Observation 063ebcf7-a380-4951-96a6-57115306b83a · outbound

This paper cites Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Is a document educational or just Wikipedia- style? pitfalls of classifier-based quality filtering

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.361337Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.667449Z digest=sha256:cdb598d5282f3d8af34ee429953780a72687a0c1dec004215119668667fda886

Observation 0898c310-284c-4ae5-a459-5fe06675fb02 · outbound

This paper cites Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Quality at a glance: An audit of web-crawled multilingual datasets.Transactions of the Association for Computational Linguistics, 10:50–72, 2022

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.349832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.670936Z digest=sha256:e5135d685599c3ca25ea44140968e82526df5bdbdccccafa13373da02c31d642

Observation f27ed3ec-bb4c-46b4-ae4d-2a9b886c6118 · outbound

This paper cites The Format Tax.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Format Tax

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.674823Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.674823Z digest=sha256:2b3736587be804d4b51315bc512f42c1548dc42f6f86b3c9b69eea12962ee18a

Observation 04a49aa9-d9a4-4fad-9e93-22da0bd35bbf · outbound

This paper cites DataComp-LM: In search of the next generation of training sets for language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora DataComp-LM: In search of the next generation of training sets for language models

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.338832Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.678804Z digest=sha256:f8026e4e077559ea793ec11f515e5af197bf41e3d8940ea0d05c9492492baf88

Observation aa88155a-04b1-45bd-afa0-d5877de7cee9 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.328421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.682276Z digest=sha256:b1cc6990399dee6fa00d396cab763a52cae4dbd10318b501fbb28116d465cdb1

Observation 6aa3bdc4-83d8-4685-9b83-2bf562688710 · outbound

This paper cites Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Narrative Flattening: How Post-Training Compresses Thematic, Affective, and Stylistic Variation in LLM Fiction

Reference 44

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.604854Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.689681Z digest=sha256:e8994e4b0b1df156c4efb475b41fd08a7b4107b2db61bb2fa8979f2dd38a43bf

Observation 401910f7-8ab2-4722-a830-9af0d7ee73e4 · outbound

This paper cites URLhttps://aclanthology.org/2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora URLhttps://aclanthology.org/2026

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.317293Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.685954Z digest=sha256:fea912aa94905c7410b577b8731b81f62d3f313a69b6b251eb215426f39ce073

Observation 961851e4-9ba4-43ca-8d08-4eca71cb8af8 · outbound

This paper cites Improving Cross-Format Robustness in Language Models with Multi-Format Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Improving Cross-Format Robustness in Language Models with Multi-Format Training

Reference 46

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.589660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.697003Z digest=sha256:2895b26eae60c81008f43c5ea5e5cbdeab16c375091413b5f1f92e2b241845fc

Observation 25f795c0-df9c-40f4-9f66-2c55d3361661 · outbound

This paper cites Lin and Max Tegmark.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Lin and Max Tegmark

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.306962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.693474Z digest=sha256:4710bbb3b8883e78b7f1406c2c4f9e818d1e714b77166a59326dc6686b6c3147

Observation 7d56fd29-a374-40ca-90a0-4d17fc40d3bb · outbound

This paper cites RegMix: Data mixture as regression for language model pre-training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RegMix: Data mixture as regression for language model pre-training

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.295866Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.704493Z digest=sha256:72948b84314f03c1be7b338861f819248e7715f2776674f04f05e22312f4ccba

Observation 870ff3b3-931c-4fa5-a01d-ef7c61816860 · outbound

This paper cites Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dripper: Token-efficient main HTML extraction with a lightweight LM.arXiv preprint arXiv:2511.23119, 2026

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.700743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.700743Z digest=sha256:8e3812799b56a43e8b4a5166a6feeaf0c2952a18f532ffaef4e1ef47288ad374

Observation 3ad61780-a039-46e8-8f0e-eb7cfe61e40d · outbound

This paper cites The Llama 3 Herd of Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Llama 3 Herd of Models

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.712036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.712036Z digest=sha256:2a548f07994482c2c086ae477ebfe475837c979b253b47167104e2f24f6a5527

Observation caddb278-c690-4090-852b-6567f647e123 · outbound

This paper cites Sentence-Level Contextual Entrainment in Large Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Sentence-Level Contextual Entrainment in Large Language Models

Reference 51

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.507694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.708161Z digest=sha256:0396b75f9a3bfa374592cd6236e67a805f072a7deaa506d41880aeb3ec724b14

Observation b5137b5c-cf5d-47a5-84ea-9e466309a633 · outbound

This paper cites AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora AICC: Parse HTML finer, make models better — a 7.3T AI-ready corpus built by a model-based HTML parser.arXiv preprint arXiv:2511.16397, 2025

Reference 52

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.481795Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.719503Z digest=sha256:5d44e1ea2be7007bc9ad8788764e3489f5839757c4e9b95934e26d73c4687bdb

Observation 93ae5958-d8be-46eb-85f4-3c175b4b06f0 · outbound

This paper cites Klein, and Jesse Dodge.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Klein, and Jesse Dodge

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.284672Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.715836Z digest=sha256:dce0b32c5dffc6fae90a148cf4de596d620cc4b0639e3c2b73b4632c55e1270c

Observation 10e8715e-bef4-4679-b9da-9eb126cf768c · outbound

This paper cites Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Measuring fingerprints of web-filtered text datasets and fingerprint propagation through training

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.273034Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.726933Z digest=sha256:599dc28796d328a00af1a2078a135674512636e28b2bb4805915b1bc83a5268a

Observation 444cfb4f-cdf9-472d-976a-a057fb97ee46 · outbound

This paper cites Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.722972Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.722972Z digest=sha256:310e4e5147d2eb4890859ad12c7a561bddf453b9d1417691eb5ac5ca3a711893

Observation aa540b93-f654-4ab3-84f3-d1e757d5e802 · outbound

This paper cites Register always matters: Analysis of LLM pretraining data through the lens of language variation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Register always matters: Analysis of LLM pretraining data through the lens of language variation

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.249473Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.734114Z digest=sha256:42012af2e9a80f5868f7575f421b1a199a1f9dc83ea94846195bbe9f3fab2ff8

Observation 97697682-5627-4c5a-a214-f2ee8e11b7c1 · outbound

This paper cites Autocorrelations decay in texts and applicability limits of language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Autocorrelations decay in texts and applicability limits of language models

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.261287Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.730477Z digest=sha256:84b0dbaf24bb9b2c329ed8e5acc910abbe88e89de421e392530356d7985f4ccf

Observation b557be46-2c86-42f9-b7f5-81062df62b81 · outbound

This paper cites OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora OctoLong: Mid-Training On Cross-Repository Code Contexts Enhances Long-Context Modeling

Reference 58

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.381154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.741761Z digest=sha256:5bc875ee4c000c711751485b90e025cee29d109a9e7bd11a0c604cc3ced3c751

Observation 51c0e49c-0dc6-42b7-bf33-b9b0d4c9e571 · outbound

This paper cites How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora How can we synthesize high-quality pretraining data? a systematic study of prompt design, generator model, and source data

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.237160Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.738014Z digest=sha256:71d8e66e238e55ae5b0e4298c7e3bdd27bb2f1ec0af896989983f12f5436a623

Observation c942c904-4efd-4d69-986e-b685988a64f1 · outbound

This paper cites Chapter captor: Text segmentation in novels.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Chapter captor: Text segmentation in novels

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.212033Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.749302Z digest=sha256:f08926291228320d09a56f670b934f5942aba4ba03905f7203befd83614adba7

Observation f850bd65-f37e-43a8-aa69-76b26ee8073d · outbound

This paper cites The FineWeb datasets: Decanting the web for the finest text data at scale.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The FineWeb datasets: Decanting the web for the finest text data at scale

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.224614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.745705Z digest=sha256:c973ec36a3c7f4329fad168c2a3e108fb7ba9943b17e363e514d96e10b871073

Observation 5621d9f2-4963-4970-9a38-b58d6e7f334c · outbound

This paper cites epub2txt-all (the Books3 converter).

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora epub2txt-all (the Books3 converter)

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.199905Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.756470Z digest=sha256:f9a4016513a6606d4d73e65a574b8de46640e609a054147bbdef3041e7d63a26

Observation 4d9838a3-5ba8-4b88-9e4c-f7158e283ada · outbound

This paper cites olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora olmOCR: Unlocking trillions of tokens in PDFs with vision language models.arXiv preprint arXiv:2502.18443, 2025

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.752778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.752778Z digest=sha256:665fdb62e79a125957d31b011a07feadd1bf35f028f18f61621811ebc36aa51c

Observation 446a9c39-3345-49e4-9aef-f56c30b97526 · outbound

This paper cites Compressive Transformers for Long-Range Sequence Modelling.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Compressive Transformers for Long-Range Sequence Modelling

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.767917Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.767917Z digest=sha256:984d2e5881c8ee17123c06e702b7833071333293615f8b3e00067036ddd787c1

Observation a7ceff82-8002-4e0a-be0d-3efb1465cc9e · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.772122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.772122Z digest=sha256:083cf49b95b88b2532f6567f45ec422ad26ef3d561bccaeeb18e2a99c31b417f

Observation a0bb3eb7-1ceb-47b6-bf73-1ed42815cf9c · outbound

This paper cites Qwen3 Technical Report.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Qwen3 Technical Report

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.764228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.764228Z digest=sha256:130f293e79e0b89dca3dea28668e4956f37885b7816a47bc4b82f8adca67770b

Observation 36d60be1-2d4a-48ba-8dda-7d2d8d797a99 · outbound

This paper cites From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From reflection to repair: A scoping review of dataset documentation tools.arXiv preprint arXiv:2602.15968, 2026

Reference 67

Resolution
verified exact
raw_fallback, observed 2026-08-11T23:46:09.276678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.779814Z digest=sha256:074ba3a485192c0d1edcc49a85d96bc44c1b55e90bc6ea9bfe9a56b8b7a5cacc

Observation 750a02df-cc2a-49d0-a0b3-b44af8141697 · outbound

This paper cites Scale-dependent Relationships in Natural Language.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scale-dependent Relationships in Natural Language

Reference 68

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.126130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.783358Z digest=sha256:25bcdd70e71254e641b93d31c82ddd6abca54d0ace72d65a0d987639ce012df5

Observation b128d4cb-385d-4b47-b6b6-327a3051d027 · outbound

This paper cites RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora RolmOCR model card.https://huggingface.co/reducto/RolmOCR, 2025

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.171029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.775948Z digest=sha256:72be2a8f09e44344e791242630bb05e0f1012fd24e4bc9bd702cb47703cc3783

Observation a1587bca-a466-47c0-b32e-464756d736b5 · outbound

This paper cites Dolma: an open corpus of three trillion tokens for language model pretraining research.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Dolma: an open corpus of three trillion tokens for language model pretraining research

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.160064Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.791038Z digest=sha256:db42d8285c0b8351286e637b594759b04cc6b62a22a1a4ab80e83311c4fb867b

Observation 29167a1b-8011-4c3f-900d-5dc057727d6c · outbound

This paper cites Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Nemotron-CC: Transforming Common Crawl into a refined long-horizon pretraining dataset

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.149510Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.794756Z digest=sha256:c845d6cbbb534ffa04a7e39333a17f98890bb1908e21eb8b2acbba50f12ec697

Observation 62b3ba69-8815-4713-bb09-6d9e2ed0ef23 · outbound

This paper cites Mutual Information Scaling and Expressive Power of Sequence Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Mutual Information Scaling and Expressive Power of Sequence Models

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.787163Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.787163Z digest=sha256:a697979f5b82cc5d28b97a4900b2020489f330669319fe8b5075394d61c07ca6

Observation da602af8-0010-4589-8474-d649bc5a0871 · outbound

This paper cites ChapterBreak: A challenge dataset for long-range language models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora ChapterBreak: A challenge dataset for long-range language models

Reference 73

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.126803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.801750Z digest=sha256:be2b48acb202148b19959038ebc4f10bbf7164cb25283e2e57275b2eb4b23e9e

Observation 76e0f288-a66c-47b6-a6e8-09f72bfec00d · outbound

This paper cites Accessed 2026-08-09.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Accessed 2026-08-09

Reference 74

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.115418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.805338Z digest=sha256:6447b846f4587855b0ab8757b3dca1e4b90eb9b808d7146b18f8c21a7b082f45

Observation a4994bef-5a84-4127-a17e-4746bbf90d83 · outbound

This paper cites Zico Kolter, and Zhuang Liu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zico Kolter, and Zhuang Liu

Reference 75

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.137800Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.798336Z digest=sha256:b0cd562d07b5a2567f3998416e5521878fd607930e1d27fbe87edd61fef4767f

Observation 5550b4f1-6a93-4bcb-b9a6-2ca0d227321a · outbound

This paper cites Olmo 3.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Olmo 3

Reference 76

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.812864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.812864Z digest=sha256:bc457f312dd6f938a67d79381a2a4d07f4e4f4adb6ff1327342eef0731c64d2e

Observation 289ede77-7263-4f8d-a5f7-ef76910dc4c5 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LLaMA: Open and Efficient Foundation Language Models

Reference 77

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.816699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.816699Z digest=sha256:724f5e56e76b65167dd0b40396c49c19b94689cd23ca0a2df7c69fcba2ecd3f8

Observation d8d3ea3d-4234-465e-a029-1c2afa2026c7 · outbound

This paper cites Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Beyond Rephrasing: Book-Level Organization Improves Synthetic Textbook Data for Mid-Training

Reference 78

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.099133Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.808708Z digest=sha256:8d14f076dd8c00aaa5bb1bb9cd12ef9423e9304dfb0aea7be9c6bf99bad4ae22

Observation 0e46ee02-9ea8-4e60-90cc-bbb5544db8d6 · outbound

This paper cites MinerU: An Open-Source Solution for Precise Document Content Extraction.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora MinerU: An Open-Source Solution for Precise Document Content Extraction

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.824450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.824450Z digest=sha256:25acfbd1abcb64a7c88da7473e528567ced3a1aad32edb1bbd30325986bfb4e3

Observation ea6d276c-610c-4bd9-a5b5-32e35470cdcd · outbound

This paper cites PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

Reference 80

Resolution
metadata mismatch
local_arxiv, observed 2026-08-11T23:46:09.034640Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.828474Z digest=sha256:22c66d7ccc120ee5933a1e2a464c760181dd957ba0aaae3b1d0fbc3c86f8135d

Observation 919507d1-adee-44a2-83b1-faa97958128e · outbound

This paper cites Right Reset: Chunking by Prefix Removal.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Right Reset: Chunking by Prefix Removal

Reference 81

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:09.062126Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.820342Z digest=sha256:b5a229dc85b4049c8de47fa9546d3515689f752a1af7ca4b2a27be33f7912702

Observation 98108d02-c141-47d1-b782-01ac336a211b · outbound

This paper cites LongAttn: Selecting Long-context Training Data via Token-level Attention.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora LongAttn: Selecting Long-context Training Data via Token-level Attention

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.837385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.837385Z digest=sha256:6ba5451f514d4bfb749592d5e6fbbc548547f7c4bd75d28c6e8f4b7f701ce4a5

Observation bf2ba5af-8693-43c8-be69-52a84b441af7 · outbound

This paper cites Morris, and Lionel Levine.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Morris, and Lionel Levine

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.104141Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.841338Z digest=sha256:93479aa8aadaa6c2efa56ce4ac191dce6ce73c8d92be56dfb7aa9ea769e1e391

Observation f755bad9-c5f7-4fd5-aac2-ad53e0bfc3d9 · outbound

This paper cites Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Datasheets Aren't Enough: DataRubrics for Automated Quality Metrics and Accountability

Reference 84

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.832563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.832563Z digest=sha256:61185183f3af5aa779082fd3131f63b72ed3dd789cdffebac527f9e14601d3b3

Observation 2f060d25-0c30-40be-b921-38c88aca8d45 · outbound

This paper cites Learning to break the loop: Analyzing and mitigating repetitions for neural text generation.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Learning to break the loop: Analyzing and mitigating repetitions for neural text generation

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.081092Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.848523Z digest=sha256:ab056bcda1f965236cd8d9f52bdff16d2edd897244ba2e70d0b09521e2d82923

Observation ab284549-a24a-4633-b8d2-26b4f68c11b5 · outbound

This paper cites Data mixing laws: Optimizing data mixtures by predicting language modeling performance.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Data mixing laws: Optimizing data mixtures by predicting language modeling performance

Reference 86

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.069815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.852100Z digest=sha256:45f788fdef832ec6ecc80e45997109883dceb4a7a7444eba2ad1758b4b9e637b

Observation 3478cf59-34f1-41c0-aec3-6735908add7d · outbound

This paper cites Le, Tengyu Ma, and Adams Wei Yu.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Le, Tengyu Ma, and Adams Wei Yu

Reference 87

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.093107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.844966Z digest=sha256:d0c89f46f53de6739e7a50f8ae07ff4db37089f5b5b5326a3a67b5cc3d5b0e1b

Observation 9f9598ca-fc52-4c51-a957-b418b878adba · outbound

This paper cites Zacks, Nicole K.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zacks, Nicole K

Reference 88

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.058298Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.860828Z digest=sha256:705c482c31c1a697c84a8494f8da4b342628be83d424da0f2deebc2d6be7cfc6

Observation 85c2b94d-26cb-436d-9add-963dc6f821d8 · outbound

This paper cites From lists to emojis: How format bias affects model alignment.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora From lists to emojis: How format bias affects model alignment

Reference 89

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.046021Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.864257Z digest=sha256:e866896b06fe5fe14d5e8cc262674b913aba3071c3ba3bf23199ca4e0d1e5c10

Observation 55707357-ff8e-4d89-a41d-509c1a44cd00 · outbound

This paper cites The Price of Format: Diversity Collapse in LLMs.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Price of Format: Diversity Collapse in LLMs

Reference 90

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.856924Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.856924Z digest=sha256:fa5d0ff1b621f52f65df07537cceb2444a7c25dbb695eb44a1a37ba282e501c7

Observation 6e68ee45-f4ca-422f-b1fa-1e001cbd6add · outbound

This paper cites The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora The Structural Attention Tax: How Retrieval Format Hijacks In-Context Learning Independent of Content

Reference 91

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.971210Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.871727Z digest=sha256:ccf1e9f9e7ac5a2d13aff1684f89fdef274b3a8030ad3f912dd47085cce9452f

Observation 84df4455-b9e6-4dd6-a651-dabc1196f62e · outbound

This paper cites Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Where Does Long-Context Supervision Actually Go? Effective-Context Exposure Balancing

Reference 92

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.954229Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.875599Z digest=sha256:c096ae6ac8326ff7d2165f4bb9ae134843659fa01c3d2bd8c457f90bf2f87efc

Observation 9619982f-93a7-474e-989e-ae8073391783 · outbound

This paper cites Scalable Visual Pretraining for Language Intelligence.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Scalable Visual Pretraining for Language Intelligence

Reference 93

Resolution
verified exact
local_arxiv, observed 2026-08-11T23:46:08.987020Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.868091Z digest=sha256:f16dcb1b419410e66fd876417887b91f1a12ace0e5fe536d9d7f9db9f497a0d3

Observation 58d6a4af-29c9-4e81-8567-412d9a7bc57c · outbound

This paper cites Zwaan and Gabriel A.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Zwaan and Gabriel A

Reference 94

Resolution
verified fuzzy
raw_fallback, observed 2026-08-11T23:46:10.034224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.884591Z digest=sha256:6146c4035766e48cd94602a877ebaa91f05f24bac7f15294658476355fdf8bc2

Observation 075984c6-1b52-438d-be3c-70502615977e · outbound

This paper cites Enhancing LLM Knowledge Learning through Generalization.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Enhancing LLM Knowledge Learning through Generalization

Reference 96

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.879720Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.879720Z digest=sha256:0437bf8af5244ceec034070bc6bce4c5f9996b502fd9cbf25e11187f40bf7879

Observation 812918f9-4bb3-4ae1-b781-fff4d2ae9688 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2020

Resolution
unresolved
raw_fallback, observed 2026-08-11T23:46:10.188682Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-11T23:46:08.760319Z digest=sha256:20749ff9c9b18286ebe23a6cb8f8f5a939fff823424d41d2ee974891a6fde42c

Observation 769428fc-d8fc-4600-8193-4babf0e61a92 · outbound

This paper cites an unresolved cited work.

The Announcement Carries the Cue: Markup, Boundaries, and the Notation of Pre-Training Corpora Unresolved cited work

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-11T23:46:08.644369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T23:46:08.644369Z digest=sha256:21ae095e4d7c8bcf632b566b0415869fe3ef4a0e6b785e1733c401880eed880a

Pith citing papers

No inbound Pith citation observations are available.