Pith. sign in

Paper Citation Record · LEDGER

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training

As of 18 August 2026, this Paper Citation Record lists 61 of 61 outbound references and 0 inbound Pith citation observations for arXiv:2506.04531.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.04531 v1

Coverage vector

measured 61 of 61 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T10:46:06.685339Z

measured 61 of 61 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

61 of 61 outbound references displayed

  • verified exact1
  • verified fuzzy26
  • unresolved33
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2ac87bf3-fe11-4f5d-8145-440dab3a0dab · outbound

This paper cites write newline.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training write newline

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.420751Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.420751Z digest=sha256:9e50b285bd60c2ec1f0c6fc68d68ca2e13ed2c35c81887e9c904ae8c8a7af025

Observation f8f47d13-e59b-45e4-afae-347526e25eb3 · outbound

This paper cites GPT-4 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training GPT-4 Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.426612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.426612Z digest=sha256:486db863f3ebfd88c0127024e0029eb7cdedbcfbcd862435cae42aa6bbc19fbc

Observation 00f16575-a363-4033-aff5-1b339f2a1de0 · outbound

This paper cites On the choice of learning rate for local sgd.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the choice of learning rate for local sgd

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.560463Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.432013Z digest=sha256:2dd6cb76cc47aa22daa2c14ec30a8476891911ebfddd9b18e99371fd77db3fe4

Observation 26ecb27f-ed11-4482-816d-2a24f0bbebf8 · outbound

This paper cites G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Bradley, H., O’Brien, K., Hallahan, E., Khan, M

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.436385Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.436385Z digest=sha256:d5190fd78a64d9b757d5c211b0180a395fad2ebeb25af907e76c7d4a2cf42ceb

Observation ec89d5cc-1f69-444d-ab7e-2d9f9a34faf3 · outbound

This paper cites L., Gao, J., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Gao, J., and Choi, Y

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.441028Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.441028Z digest=sha256:becb54594d3405124844d87514860b105f3c740073012af0d83314d18ea05e96

Observation 68dc5e3c-4d4b-48ce-9f99-9ee51f8cd146 · outbound

This paper cites LEAF: A Benchmark for Federated Settings.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training LEAF: A Benchmark for Federated Settings

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.445477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.445477Z digest=sha256:74386603452db72e9a50bc2560084ba2f70363f50a64764a78af08027b3b6c18

Observation 90e05d00-5118-4e00-914e-ad30f66d0988 · outbound

This paper cites Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Multi-level local sgd: Distributed sgd for heterogeneous hierarchical networks

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.529418Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.450151Z digest=sha256:fdb2b5570f058b5b8043d2da8d3d6b53748324c6cae09c8815ecc8da890107e3

Observation d9442a6c-000d-48d4-b524-fa4aa748ada1 · outbound

This paper cites Asynchronous online federated learning for edge devices with non-iid data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous online federated learning for edge devices with non-iid data

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.515918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.454938Z digest=sha256:44749aaa6ec62c057abecdc26f88426e1bdc4be2be1ea40f44a9537ab3eef834

Observation e39444a7-3c0f-43aa-ac33-9e6a5203e745 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.459202Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.459202Z digest=sha256:899ce858bd2912831da034e941f90fc10345af4c153d5537c34177eaae3629cf

Observation dad22139-1e59-466c-b8e4-2e8b4ae64195 · outbound

This paper cites Large scale distributed deep networks.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Large scale distributed deep networks

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.502116Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.463751Z digest=sha256:2cf1225cd784d514184987b8ecab1e745aa5bf308bd3ac36494bcbf8355686d4

Observation 416f7470-76d8-4077-8710-3ab49683b68f · outbound

This paper cites DiLoCo: Distributed Low-Communication Training of Language Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training DiLoCo: Distributed Low-Communication Training of Language Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.468296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.468296Z digest=sha256:985aa5f4bd31c8f00587535926e367389813e8dde6b8f24bb8cc0a674a21cd57

Observation b3e578e4-b346-4654-964f-47b0319965b9 · outbound

This paper cites The Llama 3 Herd of Models.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.472885Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.472885Z digest=sha256:238d66b1ab0de19d215e6178a824d188225a62ecebc312e4fce6d85fbe2f5507

Observation 2ecc8cc8-b082-43c9-858f-98285f36c311 · outbound

This paper cites N., et al.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training N., et al

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.477265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.477265Z digest=sha256:9dc970648883a0c47726cb42fb5cdfda5065135d4f05b678ce518ea0b13db4eb

Observation 1926c09d-f5c9-4036-86f2-f3f270ee961d · outbound

This paper cites The Pile: An 800GB Dataset of Diverse Text for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.481712Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.481712Z digest=sha256:2ee43ef828dcb231d96649c2cb382cd227960c0c7ea2808af9b57caa5f71c06e

Observation 2d5fd34e-e590-48dd-950d-11b5d29c8612 · outbound

This paper cites M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training M., B a doiu, V.-A., Agache, A., Dumitru, M.-V., Vasilescu, I., Mantu, R., and Raiciu, C

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.488168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.486456Z digest=sha256:af2d8bbd983348198c3547aca23ae9395beddbdf5aa658d56c4b2b095d689092

Observation e6995cb0-cce3-45e5-98c2-1169e9dbcbe0 · outbound

This paper cites Measuring Massive Multitask Language Understanding.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Measuring Massive Multitask Language Understanding

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.490714Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.490714Z digest=sha256:9b4dd13f72ee520e199916097aa0b0eadff14efd829cbf2097625ff8b758836d

Observation 3eb051e4-c1d3-4861-8b23-c97c2cf39f00 · outbound

This paper cites OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.495371Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.495371Z digest=sha256:3c968a60d7f28088f5abd41c5ebd65907f7cb842170e1e72d99dc19c02c9340b

Observation 43874f70-0f92-41e3-b5b0-df147ae4cf6e · outbound

This paper cites MegaScale : Scaling large language model training to more than 10,000 gpus.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training MegaScale : Scaling large language model training to more than 10,000 gpus

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.474677Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.500093Z digest=sha256:6ea7a1625581a1850c14b11570f2adb0d8798a9e21a489c03bf46e36fa35496b

Observation 1a84a432-08b5-4fb5-be17-de251fa0e80f · outbound

This paper cites Tighter theory for local sgd on identical and heterogeneous data.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Tighter theory for local sgd on identical and heterogeneous data

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.459720Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.505985Z digest=sha256:5a2ab2e6d489c3af04a2cb98cfe3f921bd026adb02f1498ba5c48ecbee113921

Observation 53416eec-8621-40a5-ab27-02d4213d8aac · outbound

This paper cites A unified theory of decentralized sgd with changing topology and local updates.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training A unified theory of decentralized sgd with changing topology and local updates

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.445958Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.510534Z digest=sha256:689515053c43ed90b617fd5f37d946f0d7aa7f102690a9f2cf1aac5ab72d4a69

Observation 26c6b3de-4ba5-4167-8a9d-527cc36910f3 · outbound

This paper cites Slow Learners are Fast.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Slow Learners are Fast

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.514940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.514940Z digest=sha256:fbce48cefa2e9e1253c3b9fcb7d1c8a58b6feda7842257a81ad8fe2e85b3668b

Observation 1b8d4b9e-3e89-4994-974a-f694be776ac0 · outbound

This paper cites Amp: Automatically finding model parallel strategies with heterogeneity awareness.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Amp: Automatically finding model parallel strategies with heterogeneity awareness

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.432174Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.519385Z digest=sha256:65665e7b7d25e2ae8f83c92300153ea4e139d2a2d69bc0e92bc23df5cd213148

Observation 3f21350b-6d89-4e14-80f5-df3d8bdeeb2b · outbound

This paper cites Fednar: Federated optimization with normalized annealing regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Fednar: Federated optimization with normalized annealing regularization

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.417124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.523654Z digest=sha256:59f2b356d6131b5c2cdf3a1afad4107d913ee8c23eb1e3674457fb7cc958278d

Observation 6bffd1a3-e126-4dcb-bd21-007970d65797 · outbound

This paper cites G., Park, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training G., Park, J

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.403430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.527727Z digest=sha256:8b69bf1a04b7264565dc8f216773e5f6c9f892703e6a9d84e66aecd202783ee0

Observation e7736bb6-3255-42e5-9752-152aeb9e5858 · outbound

This paper cites K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training K., Zaheer, M., Sanjabi, M., Talwalkar, A., and Smith, V

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.531887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.531887Z digest=sha256:531e02156e93d1b17c8ed4a27f4320a9a7ad004fd620581361d9bf33f1dadeb4

Observation 3261fdbd-1c8c-41cb-a03c-dd1e27ebf29f · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.382058Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.536204Z digest=sha256:68d106f0fc41d8b5e5fa6cc013ef93bcd2b2c35e1bc9b19f547eebfa3ede96d3

Observation 02ff7cc4-9a31-4000-89e0-e1cd70153de6 · outbound

This paper cites Don't Use Large Mini-Batches, Use Local SGD.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Don't Use Large Mini-Batches, Use Local SGD

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.540979Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.540979Z digest=sha256:3ac2383d4776a8e0da9921aff0ed15128a12407c978db9f555422b3b4a381cb5

Observation 44a85517-bbc4-4de7-9cac-fd334735de04 · outbound

This paper cites Asynchronous Local-SGD Training for Language Modeling.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Local-SGD Training for Language Modeling

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.545546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.545546Z digest=sha256:7acc34f1ba8e5a5d0bcc19d483406acc346130d944b5f786fa247706b755b730

Observation 35639ddb-bc58-40b0-8655-f200645a9705 · outbound

This paper cites An improved analysis of stochastic gradient descent with momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training An improved analysis of stochastic gradient descent with momentum

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.368999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.549864Z digest=sha256:28974010af3b01d9853d24bb58bfe4474845fb95574734963cea91566c5d7e1c

Observation 537bb3ed-9ee9-432f-a11c-abc5475b7593 · outbound

This paper cites Decoupled Weight Decay Regularization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Decoupled Weight Decay Regularization

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.554007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.554007Z digest=sha256:2261dd7dca5cc611e8177db5ea2cf4017da259f5e57b4676f7a3034507014b19

Observation b36412e9-5d56-4c00-a1cc-e0215694c667 · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.558982Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.558982Z digest=sha256:7744368e56098d8eafca712d5e18e7e6abaa0e54f0cb6a28f01c3a01d75e583b

Observation 273bddff-6fb4-44da-a491-669bb0f35e2a · outbound

This paper cites Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.563160Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.563160Z digest=sha256:396bc78827d1a13bae8f887e0a325b705a5e14aff8f37982245702b2420a06d8

Observation 79540e1c-29d9-4026-9a6a-a3c7909ab5ca · outbound

This paper cites Mixed Precision Training.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Mixed Precision Training

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.567529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.567529Z digest=sha256:bf3c528cbe29ee7482af601017be81f63c31241fd6c72b59c820a76d5ff82cb6

Observation d2ec98a8-9bfd-44e3-8968-4096fd4687da · outbound

This paper cites and Ulukus, S.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Ulukus, S

Reference 34

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.345128Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.571738Z digest=sha256:8db37759f950918d5180cbafe157f171b312766d9a91a4c9d862efb79e18347a

Observation 84bc9a37-a73c-41db-9144-c95d768817b3 · outbound

This paper cites Efficient large-scale language model training on gpu clusters using megatron-lm.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Efficient large-scale language model training on gpu clusters using megatron-lm

Reference 35

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.331632Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.575872Z digest=sha256:a4a9fa618f3bac99edf778bcb2673d40acb90b9afe070cd254ca62635d6ef96d

Observation 49d1d773-396d-4101-9f74-a60169bd6857 · outbound

This paper cites Federated learning with buffered asynchronous aggregation.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Federated learning with buffered asynchronous aggregation

Reference 36

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.318396Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.579826Z digest=sha256:d08614f466b693337cf31aabeb6ce9eb6e377e4e0e9db200969a314110451db2

Observation 2525ef75-a894-4941-8cea-9381966464f1 · outbound

This paper cites Trade-offs of Local SGD at Scale: An Empirical Study.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Trade-offs of Local SGD at Scale: An Empirical Study

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.583881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.583881Z digest=sha256:0b01c0882a89f5131dc643b2a771379724ae6f5472efe7fca2e908dcfdbf0be9

Observation afba612f-fdf6-4ea3-8656-6e2eafb7ea23 · outbound

This paper cites Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fern \'a ndez, R

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.304917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.587959Z digest=sha256:e45f90509e402a476ebcb0682c98b05a337b8aac4a93f290fa75d51d0767848a

Observation 6a58490a-c2da-4670-98af-7904d1a49ff1 · outbound

This paper cites Automatic mixed precision package - torch.amp.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Automatic mixed precision package - torch.amp

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.291281Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.591966Z digest=sha256:f57d331a1c6094d90553cd40668490a28ceea4abbabe54b5ddab687606333629

Observation a2717fc3-ac89-4364-9715-7f3359dee362 · outbound

This paper cites L., Bhagavatula, C., and Choi, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training L., Bhagavatula, C., and Choi, Y

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.596049Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.596049Z digest=sha256:eb6dfd5696708a5fd807ace17be02e8237377ee25bfafc9bc71a2faee0092ff5

Observation 699cca50-5590-4211-bf8c-18eb009170d8 · outbound

This paper cites Local SGD Converges Fast and Communicates Little.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Local SGD Converges Fast and Communicates Little

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.600071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.600071Z digest=sha256:9baaaa0a3b964c2b0c12f1a6b4692bfbb9bb63150ccaf93b8764fce35df88eed

Observation 88cfd329-67ed-4856-943e-98279e748666 · outbound

This paper cites Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Ml training with cloud gpu shortages: Is cross-region the answer? In Proceedings of the 4th Workshop on Machine Learning and Systems, pp.\ 107--116, 2024

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.269324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.604480Z digest=sha256:8ad019e5da0d81e4a138f8c9aaebea9dabedcafe9302d9b37b8bc3050b614ee8

Observation 95238f27-483a-4835-9220-b84b38a96561 · outbound

This paper cites CO2: Efficient Distributed Training with Full Communication-Computation Overlap.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training CO2: Efficient Distributed Training with Full Communication-Computation Overlap

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.608870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.608870Z digest=sha256:74a2c651a104d4065b1a14e574926501d4cde91033d6984487124ceeba5ba4e0

Observation a6656838-2a7a-4416-998a-f1a277d48c5e · outbound

This paper cites H., and Zhang, J.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training H., and Zhang, J

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.255841Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.613266Z digest=sha256:670ac249a5a6af2804f128fcf06a1921734cf6a06289b5ec5705164e529769c5

Observation 6189058a-67ed-433a-a0d6-478ce4200ebc · outbound

This paper cites On the importance of initialization and momentum in deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training On the importance of initialization and momentum in deep learning

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.243135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.617316Z digest=sha256:e86ec9d8dede8c840fcf3c7335c930953699ff63f6609493ee52ebf22a644fd5

Observation 6ccdea98-c0bf-4551-ad60-9bbd5aeea7c6 · outbound

This paper cites FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training FusionLLM: A Decentralized LLM Training System on Geo-distributed GPUs with Adaptive Compression

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.621574Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.621574Z digest=sha256:8de5e40035c89beb4e7405f811e993a982e1b0961c4fb522e2846fadd08f72c2

Observation c22ac7c7-f870-4664-a531-3e146bf76c3f · outbound

This paper cites Optimization of collective communication operations in mpich.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Optimization of collective communication operations in mpich

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.229093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.626213Z digest=sha256:306590ac59c17d6225176a6f726293d6f31521be4f874ab7248212923f9fead5

Observation 24384d89-4a6b-40bc-aa21-14b8d738190d · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.214357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.630309Z digest=sha256:c02d4ad5de3476752c8928c5b712b6db0e3f5a1c025bcd64f56e3942b47beb8f

Observation 737e0187-f050-438d-a86b-f7fd9d35a8e6 · outbound

This paper cites and Joshi, G.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training and Joshi, G

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.198660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.634425Z digest=sha256:eaf381c7d2774b777d5275b6ce883d487f42fc514701b6ec6830da12c8511cb3

Observation c79c6f55-67ad-49b6-9528-6e98935ee3bf · outbound

This paper cites SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.638357Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.638357Z digest=sha256:4993274c683b1e70a425d29eab12a9b6b74d7764fb8e68a79dc59c63a74538dc

Observation bf7e4ae6-c427-4c87-8d7c-af088e0b397e · outbound

This paper cites an unresolved cited work.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T10:46:07.184384Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.642753Z digest=sha256:e3a70d4c7057810e50538f9a692ecc4432bfc9ac46a2a0c6dc2177dbbd905e79

Observation 59b52d04-4e0f-4d3d-8a33-4274223034e0 · outbound

This paper cites Asynchronous Hierarchical Federated Learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Hierarchical Federated Learning

Reference 52

Resolution
verified exact
local_arxiv, observed 2026-08-07T10:46:06.784740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.646548Z digest=sha256:3ef78c380ad1aeb9d79e278d5db775f59f913e467f5d790e25ad4b01ecd7fbaa

Observation 2f18f26b-a863-4fdb-9cf0-fe13ed98c8f8 · outbound

This paper cites F., and Gardner, M.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training F., and Gardner, M

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.650844Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.650844Z digest=sha256:ec2c4ba1c961a8311188045abe189b6ac45ba1ba81a01c297c68fc2202e5967d

Observation 1ad8ad91-94f0-43e9-802b-acff48e72d75 · outbound

This paper cites Asynchronous Federated Optimization.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Federated Optimization

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.655253Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.655253Z digest=sha256:ef216254d1cb40b44d2094cac6ca2a794702d145ee1ce53874c8d10dc8ec35bb

Observation a8e3185b-aaa5-463f-8da3-8abff6b47b04 · outbound

This paper cites Hierarchical global asynchronous federated learning across multi-center.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hierarchical global asynchronous federated learning across multi-center

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.169945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.659681Z digest=sha256:456b320800719c8e4fdf20498e39cf7c74257c3c292eb6fe43f23f3900f3e156

Observation b7610af2-5f14-43a9-ae0e-398ceb3d562f · outbound

This paper cites Qwen3 Technical Report.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Qwen3 Technical Report

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.663683Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.663683Z digest=sha256:7d897b192229a4195c16d9170aaf4e6598ae48a74d21ee953709133a54d8eb4e

Observation 51191fdb-9d3e-460c-99eb-0685035090ab · outbound

This paper cites Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Parallel restarted sgd with faster convergence and less communication: Demystifying why model averaging works for deep learning

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.156426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.668243Z digest=sha256:4bedca1aa2b65bf2c5553ca8855e9951dd4112011f51f22c009e8ce128e8a36f

Observation d57a8550-0e7a-48d4-85a1-fdb19a209639 · outbound

This paper cites S., Re, C., and Zhang, C.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training S., Re, C., and Zhang, C

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.143017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.672356Z digest=sha256:edbb5256880bea865676288bc1eef980ebd31093482f66941d603bab398d9a9b

Observation dd7386b0-8461-44c1-9b2e-23a322d8f8aa · outbound

This paper cites Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Hellaswag: Can a machine really finish your sentence? In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T10:46:06.676676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T10:46:06.676676Z digest=sha256:03f505f8e43e7ff2c34bba0cd04fb113e3e811e8869ca1c4e897a5ce3bfb55ff

Observation f73681d9-649b-4e63-b675-484757c415c5 · outbound

This paper cites E., and LeCun, Y.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training E., and LeCun, Y

Reference 60

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T10:46:07.120749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.681158Z digest=sha256:436ce09230d93662930a3fd6385abedd3bad3b41fd7d5b8663d48be8d63e701b

Observation 549790fa-ed03-41d3-b02c-60da6f815395 · outbound

This paper cites Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients.

HALoS: Hierarchical Asynchronous Local SGD over Slow Networks for Geo-Distributed Large Language Model Training Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

Reference 61

Resolution
metadata mismatch
local_arxiv, observed 2026-08-07T10:46:06.737552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-08-07T10:46:06.685339Z digest=sha256:9b77ade600224752c3e3310d93b9c21b67c76ae36d855c49962262f08b9e9f2a

Pith citing papers

No inbound Pith citation observations are available.