Paper Citation Record · LEDGER

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

As of 10 August 2026, this Paper Citation Record lists 59 of 59 outbound references and 14 inbound Pith citation observations for arXiv:2501.18512.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2501.18512 v1

Coverage vector

measured 59 of 59 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-09T23:17:19.907249Z

measured 73 of 73 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 14 of 14 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:45:00.779845Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

59 of 59 outbound references displayed

verified exact3
verified fuzzy2
unresolved48
parse uncertain0
malformed identifier0
metadata mismatch6

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation 401c4e13-0e47-473f-b68f-e3f758e1a640 · outbound

This paper cites an unresolved cited work.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Unresolved cited work

Reference 2

Resolution: unresolved; raw_fallback, observed 2026-08-09T23:17:20.706722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3e454a22-1367-4e29-b744-63aaa5c87e72 · outbound

This paper cites Note that the latter is made of fragments that were synchronized at different points in time.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Note that the latter is made of fragments that were synchronized at different points in time

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T23:17:20.696703Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8bec0824-2538-4bbb-9fe7-0753fe207d8b · outbound

This paper cites Petals: Collaborative Inference and Fine-tuning of Large Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Petals: Collaborative Inference and Fine-tuning of Large Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.708148Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b455e147-b19e-43b9-bbf8-9ac848a588a6 · outbound

This paper cites Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Towards Federated Foundation Models: Scalable Dataset Pipelines for Group-Structured Learning

Reference 6

Resolution: verified exact; local_arxiv, observed 2026-08-09T23:17:20.626033Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f7132edd-9506-474e-a247-546d6150db42 · outbound

This paper cites DeepSeek-V3 Technical Report.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch DeepSeek-V3 Technical Report

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.720712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 65cdcc5c-7e19-4f7b-9dda-d4b92f008b1a · outbound

This paper cites WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch WASH: Train your Ensemble with Communication-Efficient Weight Shuffling, then Average

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.729014Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7656b641-a56d-4b9b-96e0-b499ae532471 · outbound

This paper cites Linear Mode Connectivity and the Lottery Ticket Hypothesis.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Linear Mode Connectivity and the Lottery Ticket Hypothesis

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.732124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e683400-d4ac-40b5-b006-70da03f0ecb4 · outbound

This paper cites Language models scale reliably with over-training and on downstream tasks.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Language models scale reliably with over-training and on downstream tasks

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.735779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 133bd928-ab26-4ff9-bb6c-56422f6fe590 · outbound

This paper cites The Llama 3 Herd of Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch The Llama 3 Herd of Models

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.739978Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bddb5be2-192f-45f6-9082-a743a3c28cb3 · outbound

This paper cites Query-Key Normalization for Transformers.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Query-Key Normalization for Transformers

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.743941Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1dac2dc-fb54-4bf1-abf4-10eb03963318 · outbound

This paper cites The Hardware Lottery.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch The Hardware Lottery

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.751824Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 500d6d6f-4d0b-4bec-907c-8e21e1e8dd2f · outbound

This paper cites Faster On-Device Training Using New Federated Momentum Algorithm.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Faster On-Device Training Using New Federated Momentum Algorithm

Reference 17

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.515273Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5b58efab-50a0-4ed4-9dda-6b0bbddb1c07 · outbound

This paper cites INTELLECT-1 Technical Report.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch INTELLECT-1 Technical Report

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.760557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0a86c81-019c-4254-b866-969307741780 · outbound

This paper cites Dataless Knowledge Fusion by Merging Weights of Language Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Dataless Knowledge Fusion by Merging Weights of Language Models

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.764080Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2cf4df0c-6fd8-4041-8e9f-f070db74dc15 · outbound

This paper cites REPAIR: REnormalizing Permuted Activations for Interpolation Repair.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch REPAIR: REnormalizing Permuted Activations for Interpolation Repair

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.768117Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d6d189f-14de-4a46-9b69-161ae57c75da · outbound

This paper cites Advances and Open Problems in Federated Learning.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Advances and Open Problems in Federated Learning

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.772079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1d5126a4-dc48-4443-ab70-fbc59490287e · outbound

This paper cites Scaling Laws for Neural Language Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Scaling Laws for Neural Language Models

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.776450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1a6904e-6ec4-49ee-b3d0-09f681773735 · outbound

This paper cites Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.787815Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 88433259-24f3-4189-b35f-0b0ee033e622 · outbound

This paper cites Don't Use Large Mini-Batches, Use Local SGD.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Don't Use Large Mini-Batches, Use Local SGD

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.790450Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 37201c48-22da-4c05-ab9d-9fa16b5750bc · outbound

This paper cites Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.793574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c886530a-34f5-42d2-851a-c0da7e5789fb · outbound

This paper cites Decoupled Weight Decay Regularization.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Decoupled Weight Decay Regularization

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.796277Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e09c153a-ee05-4602-b010-8ebc72c8b329 · outbound

This paper cites Merging Models with Fisher-Weighted Averaging.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Merging Models with Fisher-Weighted Averaging

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.798883Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f86d9dec-c1c8-4ab5-9cf7-e0e2e4a20063 · outbound

This paper cites What is being transferred in transfer learning?.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch What is being transferred in transfer learning?

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.806227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e16022a-3b73-4807-927f-b9fdb8c974d6 · outbound

This paper cites GPT-4 Technical Report.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch GPT-4 Technical Report

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.809862Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67ae4dc0-38de-4726-ae99-8d42c048795c · outbound

This paper cites Shawn Presser.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Shawn Presser

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.814151Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f0aebbcf-4f00-476e-9326-b18ac8c697d4 · outbound

This paper cites Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.817889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1737f821-9abe-4ee6-8101-c0ac2cf22434 · outbound

This paper cites Revisiting adapters with adversarial training.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Revisiting adapters with adversarial training

Reference 35

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.185591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3e041d60-f7c3-4520-b6db-a078b3b4d0dc · outbound

This paper cites Adaptive Federated Optimization.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Adaptive Federated Optimization

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.825499Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a6dc428-69a3-41a7-ae28-e4d91cbacd9f · outbound

This paper cites DrJAX: Scalable and Differentiable MapReduce Primitives in JAX.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch DrJAX: Scalable and Differentiable MapReduce Primitives in JAX

Reference 37

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.159900Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 4e210569-f4ef-4183-adf1-063772177323 · outbound

This paper cites Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.834497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ea9b0865-ce7b-4033-83c9-2988ecfb49ab · outbound

This paper cites SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.837683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0fae8148-89ef-4aaa-856f-72b52fa9ec83 · outbound

This paper cites Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.840308Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 96037dd6-fc0f-4e3a-b3ab-1bce10d1fbc6 · outbound

This paper cites Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelism

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.844271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eed2a3aa-ded5-45db-9bd6-40880c78139e · outbound

This paper cites Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Research

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.848487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e6d0775-f69f-4d66-b51d-20a1e4686452 · outbound

This paper cites Local SGD Converges Fast and Communicates Little.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Local SGD Converges Fast and Communicates Little

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.851728Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1db8bf38-568d-4bed-b977-9aec4aff691b · outbound

This paper cites ZipIt! Merging Models from Different Tasks without Training.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch ZipIt! Merging Models from Different Tasks without Training

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.855416Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6a3c70b0-6926-4709-8114-fd707e07c328 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Gemini: A Family of Highly Capable Multimodal Models

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.859286Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7bc7baf-5db0-4dc9-ab4b-79cb07eab909 · outbound

This paper cites PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.862947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 441ad85b-d50e-420a-bfb7-edec0f3db053 · outbound

This paper cites Why Go Full? Elevating Federated Learning Through Partial Network Updates.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Why Go Full? Elevating Federated Learning Through Partial Network Updates

Reference 47

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.033751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2ede22a5-1332-4b23-a7aa-82f27238e6fe · outbound

This paper cites Federated Dropout -- A Simple Approach for Enabling Federated Learning on Resource Constrained Devices.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Federated Dropout -- A Simple Approach for Enabling Federated Learning on Resource Constrained Devices

Reference 48

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.017221Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f60c246c-e6c8-4685-b8b7-073093888f05 · outbound

This paper cites Learning Neural Network Subspaces.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Learning Neural Network Subspaces

Reference 49

Resolution: verified exact; local_arxiv, observed 2026-08-09T23:17:19.999559Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation f51a50de-6f61-4ca4-a8e8-0578ba7f006f · outbound

This paper cites Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.878711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f117d065-6d16-4a01-869c-24993436bee2 · outbound

This paper cites Small-scale proxies for large-scale Transformer training instabilities.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Small-scale proxies for large-scale Transformer training instabilities

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.881272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5057a9d-19fe-4934-b50a-ddccd1d44001 · outbound

This paper cites TIES-Merging: Resolving Interference When Merging Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch TIES-Merging: Resolving Interference When Merging Models

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.884439Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d22642f-dd03-43f6-83bf-745e9e0e3911 · outbound

This paper cites Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.887706Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a290848f-aebf-48b8-a7e1-855464655fc1 · outbound

This paper cites HellaSwag: Can a Machine Really Finish Your Sentence?.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch HellaSwag: Can a Machine Really Finish Your Sentence?

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.890948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 387d3aa9-8d86-4c34-ad13-0083c4244ca8 · outbound

This paper cites GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.894204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2937bea6-2252-4bee-9bc3-21c5a240be25 · outbound

This paper cites PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallel

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.897463Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3c7ef630-0585-40f9-bb53-c7ff5007d362 · outbound

This paper cites an unresolved cited work.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Unresolved cited work

Reference 59

Resolution: unresolved; raw_fallback, observed 2026-08-09T23:17:20.686470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 80c1008e-c6d2-4297-b2ea-6de4d5a13dfd · outbound

This paper cites Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Margaret Li, Suchin Gururangan, Tim Dettmers, Mike Lewis, Tim Althoff, Noah A

Reference 2012

Resolution: verified fuzzy; raw_fallback, observed 2026-08-09T23:17:20.716585Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation cb2ecbd0-8c53-4845-a2c2-4548263e987c · outbound

This paper cites Adam: A Method for Stochastic Optimization.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Adam: A Method for Stochastic Optimization

Reference 2014

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.779972Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cbac0b38-d82a-4dee-a373-2313444fb62c · outbound

This paper cites Communication-Efficient Learning of Deep Networks from Decentralized Data.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Communication-Efficient Learning of Deep Networks from Decentralized Data

Reference 2017

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.802212Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4775532a-bae6-4ba2-9562-bd202b4de2b7 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 2018

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.717103Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 615b5158-fd5c-4ace-9e69-0acae89da819 · outbound

This paper cites Federated Learning with Personalization Layers.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Federated Learning with Personalization Layers

Reference 2019

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.699908Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 65a6cc3a-3af5-47b2-945f-ba542cf999a1 · outbound

This paper cites PIQA: Reasoning about Physical Commonsense in Natural Language.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch PIQA: Reasoning about Physical Commonsense in Natural Language

Reference 2020

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.703866Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4bf4356e-78da-4302-b160-2d4e852d859f · outbound

This paper cites Distributed Deep Learning in Open Collaborations.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Distributed Deep Learning in Open Collaborations

Reference 2021

Resolution: metadata mismatch; local_arxiv, observed 2026-08-09T23:17:20.593513Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 3bf46dd0-7454-4cf3-9035-b749a2a0a3eb · outbound

This paper cites Training Compute-Optimal Large Language Models.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Training Compute-Optimal Large Language Models

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.748342Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 29c81112-985c-4324-b48d-247a355ccdb3 · outbound

This paper cites Git Re-Basin: Merging Models modulo Permutation Symmetries.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch Git Re-Basin: Merging Models modulo Permutation Symmetries

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-09T23:17:19.695349Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 94590e59-7d61-4c27-8842-c58169cdf219 · outbound

This paper cites eXmY: A Data Type and Technique for Arbitrary Bit Precision Quantization.

Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch eXmY: A Data Type and Technique for Arbitrary Bit Precision Quantization

Reference 2024

Resolution: verified exact; local_arxiv, observed 2026-08-09T23:17:20.677586Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Pith citing papers

Observation a11c862e-2bff-4bcc-be80-c8208c9472dc · inbound

Prime Collective Communications Library -- Technical Report cites this paper.

Prime Collective Communications Library -- Technical Report Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T15:45:00.779845Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 29438e8a-c595-4d6a-8bca-f2f48d77fdb6 · inbound

MuLoCo: Muon is a practical inner optimizer for DiLoCo cites this paper.

MuLoCo: Muon is a practical inner optimizer for DiLoCo Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T12:45:26.663110Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4a428827-eae5-4506-a638-f446f509a956 · inbound

TAH-QUANT: Effective Activation Quantization in Pipeline Parallelism over Slow Network cites this paper.

TAH-QUANT: Effective Activation Quantization in Pipeline Parallelism over Slow Network Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 9

Resolution: verified exact; arxiv_id, observed 2026-05-19T11:27:15.986445Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation ace2d3fa-cbdf-4e6c-8e0b-c1993aaabd33 · inbound

Toward a Global Regime for Compute Governance: Building the Pause Button cites this paper.

Toward a Global Regime for Compute Governance: Building the Pause Button Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-06T22:49:00.135342Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ab401835-8ac1-440c-8bbc-d4c02ea5b755 · inbound

Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape cites this paper.

Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T18:37:45.606687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf83fbc1-cb29-4992-9ca5-f84fba5caaa6 · inbound

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication cites this paper.

LoRDO: Distributed Low-Rank Optimization with Infrequent Communication Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-03T04:44:55.359585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 851fe659-a51b-4742-807f-fe6291a8f1e9 · inbound

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism cites this paper.

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 1

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T08:30:57.351446Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 119c81ad-f977-4eb4-885e-f2258571b531 · inbound

Cosine-Gated Adam-Decay: Drop-In Staleness-Aware Outer Optimization for Decoupled DiLoCo cites this paper.

Cosine-Gated Adam-Decay: Drop-In Staleness-Aware Outer Optimization for Decoupled DiLoCo Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-12T02:31:16.897694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 5a00ae3a-effb-47e9-93e7-68870a3abef5 · inbound

Outer-Momentum Restarting in High-Dimensional Two-Phase Optimization cites this paper.

Outer-Momentum Restarting in High-Dimensional Two-Phase Optimization Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 10

Resolution: metadata mismatch; arxiv_id, observed 2026-06-29T13:33:27.506222Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b8c01f67-84ac-4d4c-8fcb-6bd95a9dfea6 · inbound

HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity cites this paper.

HeLoCo: Efficient asynchronous low-communication training under data and device heterogeneity Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 2

Resolution: metadata mismatch; arxiv_id, observed 2026-06-28T20:52:37.882860Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation fdeef7a5-2f3e-4dc8-a0a8-99e6ad0fee2a · inbound

Echelon: Auditable Aggregate-Only Language-Model Adaptation Across Privacy Boundaries cites this paper.

Echelon: Auditable Aggregate-Only Language-Model Adaptation Across Privacy Boundaries Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-07-02T00:06:23.686887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2aca20ce-0af0-46ad-b231-d012916805cc · inbound

Unifying Local Communications and Local Updates for LLM Pretraining cites this paper.

Unifying Local Communications and Local Updates for LLM Pretraining Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 8

Resolution: verified exact; arxiv_id, observed 2026-07-03T04:07:37.157324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation aa3dc634-6047-4def-b97f-eb8936e24b69 · inbound

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs cites this paper.

FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 99

Resolution: verified exact; arxiv_id, observed 2026-07-04T00:09:15.196731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b5c6973b-cc03-4975-9aac-1057ac57fb9f · inbound

Not Every Sync Is Safe: Calibrated DiLoCo Scheduling for Shared AI Infrastructure cites this paper.

Not Every Sync Is Safe: Calibrated DiLoCo Scheduling for Shared AI Infrastructure Streaming DiLoCo with overlapping communication: Towards a Distributed Free Lunch

Reference 2

Resolution: unresolved; no resolver link, observed 2026-07-12T12:16:10.904456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.