Pith. sign in

Paper Citation Record · LEDGER

ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

As of 8 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 8 inbound Pith citation observations for arXiv:2104.07857.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2104.07857 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 8 of 8 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T12:58:05.322950Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

57
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 47c79d72-47c9-41b2-83e8-d4f6d4285e35 · inbound

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model cites this paper.

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 56

Resolution
verified exact
arxiv_id, observed 2026-05-24T12:14:26.603797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-24T12:10:49.690618Z digest=sha256:5e54359e6a107be99a9b09d6c2863f33f9e7cafb61b40d155b52e6a3c6a00c7a

Observation 5b7311e8-64ae-46d4-93bf-d08657db1649 · inbound

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale cites this paper.

LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 77

Resolution
metadata mismatch
arxiv_id, observed 2026-05-13T13:35:36.112167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-05-13T13:35:35.972596Z digest=sha256:3bb4531f2c159e160e53fa3de7502ec38984214d1e3177b78bbc55a34e470880

Observation eac066d1-55ad-4914-9134-18f059fbd4c8 · inbound

Speeding up Model Loading with fastsafetensors cites this paper.

Speeding up Model Loading with fastsafetensors ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T12:58:05.322950Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T12:58:05.322950Z digest=sha256:c980ab88507382c74bd1625945985cf644e506a2c325384a8f7dbb03f9906f75

Observation e2b3638e-38a1-4326-946c-6c6f81a290f7 · inbound

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models cites this paper.

Infinite Sampling: Efficient and Stable Grouped RL Training for Large Language Models ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T22:01:23.734112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:01:23.734112Z digest=sha256:0933969a7bf42a114a9cd629f27d8a8798d7fc7e34fcd53e138d4d112c5886c7

Observation c6a546ef-7146-4d16-a77d-769bc003fe8f · inbound

Efficient Training on Multiple Consumer GPUs with RoundPipe cites this paper.

Efficient Training on Multiple Consumer GPUs with RoundPipe ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-12T09:31:26.792934Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-07T10:37:22.251566Z digest=sha256:e948708c0c9156f64a273ab919e4ffa934530a2b5a9a6f769faef5dd049f1005

Observation f9e91246-80d2-4687-afbb-3f511f6ea6a3 · inbound

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training cites this paper.

Runtime-Orchestrated Second-Order Optimization for Scalable LLM Training ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 16

Resolution
metadata mismatch
arxiv_id, observed 2026-05-19T18:32:42.956504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-19T18:30:24.657592Z digest=sha256:a6ea76efe48bd9537ae14cf60bbd108f3c0d9a2a439d4b8778ea01300c3f12a1

Observation ed54f167-bd48-4bdf-90c2-ab70536557d3 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
verified exact
arxiv_id, observed 2026-07-04T11:09:46.154734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-26T08:09:57.542558Z digest=sha256:4276c92d4fa8fee2c719471a0ff862ca320409623c77fb4954639c52aa22c8bb

Observation 2ab751d5-1005-4adb-8649-1c5012e0d69b · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning

Reference 234

Resolution
unresolved
no resolver link, observed 2026-08-02T10:27:18.533828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T10:27:18.533828Z digest=sha256:288ab78e9ffda4ef5cd628a441a01a1a8808dbbf427dfcfbce398b5890f4a110