Pith. sign in

Paper Citation Record · LEDGER

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

As of 7 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 2 inbound Pith citation observations for arXiv:2506.21263.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.21263 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:40:13.785408Z

measured 16 of 16 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-03T04:44:55.885810Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T00:09:15.165598Z

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved13
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9f1c84f6-ffa4-4f9d-84b9-0eaef4e66dff · outbound

This paper cites On the Opportunities and Risks of Foundation Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster On the Opportunities and Risks of Foundation Models

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.252709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.252709Z digest=sha256:2dfe3b3deb3d6b45b48da9424162f754d9b74904db3c8d965752b637b46d4775

Observation 8549cf5b-dd06-4a11-98b6-9f82744c914d · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster DiLoCo: Distributed Low-Communication Training of Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.436255Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.436255Z digest=sha256:744b1cc3887f22da799310063a602622e3b43490f320cdb0751645e0bbf207e3

Observation 9528fa99-09b1-4bc9-a50c-3542a360415f · outbound

This paper cites Crafting papers on machine learning.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Crafting papers on machine learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.523444Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.523444Z digest=sha256:fa76ecf4254a6cee71e91a5cf167624ab0b76f44e618d29040cfb14fdf955508

Observation d415e8e9-6869-43ef-a2e7-c0c0f9839eca · outbound

This paper cites PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.682045Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.682045Z digest=sha256:2ee264d820ef5dab37efece733d5ab4ffb86e59728e22578543bdeebb036477b

Observation eb6af78d-5f49-40b9-a22b-54d9e8126298 · outbound

This paper cites MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster MiCS: Near-linear Scaling for Training Gigantic Model on Public Cloud

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.736781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.736781Z digest=sha256:2bc5c70241a0c8babd8a073498f9932439e5aa6445cb8c5a84fea908f18c8156

Observation c16f3d0b-5aef-4d2a-bdf0-057f4e63b042 · outbound

This paper cites A Survey of Large Language Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster A Survey of Large Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.785408Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.785408Z digest=sha256:0af54707d976e0ca1f63f734d6a80992a8b5d6a8bedd350b9618184b8e905607

Observation de7a93ad-a5ca-4838-8bd9-30373a58e329 · outbound

This paper cites Pointer Sentinel Mixture Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Pointer Sentinel Mixture Models

Reference 2000

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.565214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.565214Z digest=sha256:b3fd40e3f1bbe58dac64d6d8f3758e5fa4aa2ca3f4d69ce6bb356e8a72657c65

Observation eb463f6f-dc62-4044-8e27-e1a66ea2f5e7 · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 2016

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.643058Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.643058Z digest=sha256:92d07122173d5422f8d21e6c3934518d3eaf15456e5de30493cf7109b7919790

Observation a9fc2713-726f-4861-b362-8801425a4c50 · outbound

This paper cites QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.136132Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.136132Z digest=sha256:f51bc3573ef34f85041a8dd89ab1afca5fbb87b10b3e25ec70decddc26fad7b6

Observation 852583dd-5db7-4651-bb32-9c0f5fc3dbce · outbound

This paper cites The Convergence of Sparsified Gradient Methods.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster The Convergence of Sparsified Gradient Methods

Reference 2018

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:40:14.005772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-06T22:40:13.176409Z digest=sha256:e685279fefdf27e459f82e306afac706659eaa3df012c3f76b22c9362a885f46

Observation b427e7c6-2ce3-4342-9304-8d57dd793cc9 · outbound

This paper cites ZeRO: Memory Optimizations Toward Training Trillion Parameter Models.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster ZeRO: Memory Optimizations Toward Training Trillion Parameter Models

Reference 2020

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.598804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.598804Z digest=sha256:dc9b4f372b63848999d241f3561a5e4c21475832b5ead00bb9d339e4e0522162

Observation d2c398b0-ccde-41b9-9fdb-27c90be31eab · outbound

This paper cites Language Models are Few-Shot Learners.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster Language Models are Few-Shot Learners

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.301213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.301213Z digest=sha256:8f0f39e6f47b4ac6205e42275de843c5bc165aa9b763c9bf559ac4fd811a9321

Observation 7db6d8c9-3376-48a1-8d07-981a35e2727e · outbound

This paper cites OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.488227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.488227Z digest=sha256:42af747313ca85799def35526ae82b5402e4de74c2b2fceaa0047e895d4231e7

Observation 7d3cf74f-3194-43f7-bcfe-54803e81582a · outbound

This paper cites BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T22:40:13.370660Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:40:13.370660Z digest=sha256:256a4bcf54bca734ade54d78ab5ca7d1c6583e8c13eda16b8e3b49656baded8f

Pith citing papers

Observation b0a1f4a5-444f-4928-a0d5-0d7f644bc7cd · inbound

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication cites this paper.

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-03T04:44:55.885810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T04:44:55.885810Z digest=sha256:bed1d57cf9c383fc71a02895f4c4934c19828e8636d24b86eeb603ca498e828d

Observation fbed2714-ad13-42f6-a330-a1da3b15ba6f · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster

Reference 131

Resolution
verified exact
arxiv_id, observed 2026-07-04T00:09:15.167756Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=arxiv_source observed=2026-06-26T21:25:15.709652Z digest=sha256:0985b84472346cef10f6a230c6b415a32838f7f075d620ac29cbbef67513b05c