Pith. sign in

Paper Citation Record · LEDGER

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

As of 18 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 2 inbound Pith citation observations for arXiv:2506.21263.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.21263 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:40:13.785408Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T04:44:55.885810Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.165598Z

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9f1c84f6-ffa4-4f9d-84b9-0eaef4e66dff · outbound

This paper cites On the Opportunities and Risks of Foundation Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster On the Opportunities and Risks of Foundation Models

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.252709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.252709Z digest=sha256:5a18093db0595202f890458c115240bbb747c2b5c5c85c524c305e39324d2344

Observation 8549cf5b-dd06-4a11-98b6-9f82744c914d · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster DiLoCo: Distributed Low-Communication Training of Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.436255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.436255Z digest=sha256:46a6c972e5d6969d98690ec3c797f07dab0f69140d5c9b06974bf9a1f7343f14

Observation 9528fa99-09b1-4bc9-a50c-3542a360415f · outbound

This paper cites Crafting papers on machine learning.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Crafting papers on machine learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.523444Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.523444Z digest=sha256:f8d245a40900108a2ad024bc5c3217b3a436aceb514c00002453ea8bb90ae2ab

Observation d415e8e9-6869-43ef-a2e7-c0c0f9839eca · outbound

This paper cites PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.682045Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.682045Z digest=sha256:63038c3737db776eb329e6e10b158c759d1c068704b5d89befeb3c97511cffdb

Observation eb6af78d-5f49-40b9-a22b-54d9e8126298 · outbound

This paper cites MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.736781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.736781Z digest=sha256:d903778dbc8faf04c3ed9b70cd42e316b2992f038331cdcdfa43af40f76f1d55

Observation c16f3d0b-5aef-4d2a-bdf0-057f4e63b042 · outbound

This paper cites A Survey of Large Language Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster A Survey of Large Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.785408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.785408Z digest=sha256:ee87a3668653ed92262e49203df3a99308b7dbce806a3bd414ebccc48e7bcb36

Observation de7a93ad-a5ca-4838-8bd9-30373a58e329 · outbound

This paper cites Pointer Sentinel Mixture Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Pointer Sentinel Mixture Models

Reference 2000

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.565214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.565214Z digest=sha256:9fe1f5691e05fe62180f0598979df0a4522e8947d801fff8265cbc8bad645805

Observation eb463f6f-dc62-4044-8e27-e1a66ea2f5e7 · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 2016

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.643058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.643058Z digest=sha256:4ec2def2a51987d652228579299c420383171c81e593e040537eb5f13c7cce24

Observation a9fc2713-726f-4861-b362-8801425a4c50 · outbound

This paper cites QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.136132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.136132Z digest=sha256:142adf4e72156d31064e55de4b7e5d7e21b06308342b46632dc28145d1f10f95

Observation 852583dd-5db7-4651-bb32-9c0f5fc3dbce · outbound

This paper cites The Convergence of Sparsified Gradient Methods.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster The Convergence of Sparsified Gradient Methods

Reference 2018

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:40:14.005772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-06T22:40:13.176409Z digest=sha256:af587ed17a33954aa7183b5827bb457b3a60b10ec02516d9b5db889b203cb390

Observation b427e7c6-2ce3-4342-9304-8d57dd793cc9 · outbound

This paper cites ZeRO: Memory Optimizations Toward Training Trillion Parameter Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.598804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.598804Z digest=sha256:8330bd93466854dc16ee18abf3257f5aefa8f46f93b388bf5cf2582371d13822

Observation d2c398b0-ccde-41b9-9fdb-27c90be31eab · outbound

This paper cites Language Models are Few-Shot Learners.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Language Models are Few-Shot Learners

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.301213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.301213Z digest=sha256:6f5aa4de354b121fccc2f8b6017ea1a92f325024a05b3a3eb6069e74c75797cb

Observation 7db6d8c9-3376-48a1-8d07-981a35e2727e · outbound

This paper cites OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.488227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.488227Z digest=sha256:c4a011ec5025748f5a0bd7c2021695be58f274d0ca4a625bd2e61899e4999c34

Observation 7d3cf74f-3194-43f7-bcfe-54803e81582a · outbound

This paper cites BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.370660Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.370660Z digest=sha256:e039c0a2041ee93758e533f25ca9f826f2b00030b866f28314c173abe5890e2a

Pith citing papers

Observation b0a1f4a5-444f-4928-a0d5-0d7f644bc7cd · inbound

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication cites this paper.

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-03T04:44:55.885810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T04:44:55.885810Z digest=sha256:9438c1903d75baac48c4251aa2b860c7142841ff00f0dc2249cabf0d9f4153c4

Observation fbed2714-ad13-42f6-a330-a1da3b15ba6f · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Reference 131

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.167756Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:a1533cf7699ee182559fee7551a9c3b156a57130939c5d6f4397bd85810a3b45