Pith. sign in

Paper Citation Record · LEDGER

ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 8 inbound Pith citation observations for arXiv:2104.07857.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2104.07857 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 8 of 8 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:58:05.322950Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

57
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 47c79d72-47c9-41b2-83e8-d4f6d4285e35 · inbound

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model cites this paper.

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 56

Resolution
verified exact
arxiv_id, observed 2026-05-24T12:14:26.603797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-24T12:10:49.690618Z digest=sha256:8809cc358837213b397f7d517fc75e8322eb6be6ecaad4a9568f195130a50cbc

Observation 5b7311e8-64ae-46d4-93bf-d08657db1649 · inbound

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale cites this paper.

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 77

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T13:35:36.112167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-13T13:35:35.972596Z digest=sha256:c5316fd042ca6cb65395536a3812f7d90e9c3cff8de98d1859d61dcf3f52d8dc

Observation eac066d1-55ad-4914-9134-18f059fbd4c8 · inbound

Speeding up Model Loading with fastsafetensors cites this paper.

Speeding up Model Loading with fastsafetensors ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T12:58:05.322950Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:58:05.322950Z digest=sha256:3a5373ab8fddf5c56dfe6f0100e798e082585b82abfcc8f1c2a7c22cc903180f

Observation e2b3638e-38a1-4326-946c-6c6f81a290f7 · inbound

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models cites this paper.

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T22:01:23.734112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:01:23.734112Z digest=sha256:6b14597653c5ec40af863a0c860358d0e349986708975de6cf079af4471ce7a0

Observation c6a546ef-7146-4d16-a77d-769bc003fe8f · inbound

Efficient Training on Multiple Consumer GPUs with RoundPipe cites this paper.

Efficient Training on Multiple Consumer GPUs with RoundPipe ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-12T09:31:26.792934Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-07T10:37:22.251566Z digest=sha256:0c0bec2851135a3b4a8433e0d71f70150b04179f1f52146133b84838c891c762

Observation f9e91246-80d2-4687-afbb-3f511f6ea6a3 · inbound

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training cites this paper.

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 16

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T18:32:42.956504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-19T18:30:24.657592Z digest=sha256:87f164cc17283657418df3230b82496cd0b9f848826c032c962d2e18f6396d37

Observation ed54f167-bd48-4bdf-90c2-ab70536557d3 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
verified exact
arxiv_id, observed 2026-07-04T11:09:46.154734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-06-26T08:09:57.542558Z digest=sha256:51ff83991e0eea7cf6c1660139884aaa3efbad87d67c0319f9b8d6fb8a459d9c

Observation 2ab751d5-1005-4adb-8649-1c5012e0d69b · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
unresolved
no resolver link, observed 2026-08-02T10:27:18.533828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T10:27:18.533828Z digest=sha256:288ab78e9ffda4ef5cd628a441a01a1a8808dbbf427dfcfbce398b5890f4a110