Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM | Paper Citation Record

Observation a4d62a99-e85b-4e0d-86d5-17278d726ffe · inbound

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model cites this paper.

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 43

Resolution: verified exact; arxiv_id, observed 2026-05-24T12:14:26.541851Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 50c00f4f-b34c-4082-acab-2ff8b53dd1d2 · inbound

OPT: Open Pre-trained Transformer Language Models cites this paper.

OPT: Open Pre-trained Transformer Language Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 142

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T20:53:17.533584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 52a26e0c-be81-4f2f-9c4c-ef851eb31be0 · inbound

Multi-matrix Factorization Attention cites this paper.

Multi-matrix Factorization Attention Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T00:55:03.901462Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e815fc39-0ed3-46ec-a5df-920a95bf6b17 · inbound

Automatically Planning Optimal Parallel Strategy for Large Language Models cites this paper.

Automatically Planning Optimal Parallel Strategy for Large Language Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-10T22:59:59.146149Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bcbdff8a-f26d-4bc1-b441-fb0214fe0104 · inbound

Scaling Large Language Model Training on Frontier with Low-Bandwidth Partitioning cites this paper.

Scaling Large Language Model Training on Frontier with Low-Bandwidth Partitioning Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-10T21:42:38.123613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9da226f6-618d-430e-9a3f-1de9a9a1b1f6 · inbound

Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass cites this paper.

Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Pass Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-10T15:31:20.118465Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fb0670d6-8efc-4d2e-b247-9226f418704c · inbound

Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers cites this paper.

Democratizing AI: Open-source Scalable LLM Training on GPU-based Supercomputers Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-08T10:20:02.642128Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38141650-6fcb-4e1f-9623-450cc0ed660b · inbound

Trends in AI Supercomputers cites this paper.

Trends in AI Supercomputers Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-16T11:17:19.030628Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0301b650-4d67-42df-9fa1-fd627987e3a5 · inbound

Taming the Titans: A Survey of Efficient LLM Inference Serving cites this paper.

Taming the Titans: A Survey of Efficient LLM Inference Serving Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 86

Resolution: unresolved; no resolver link, observed 2026-08-16T05:49:10.027522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7dc5a2f3-85a1-4c6f-a8c2-299c257b3ebc · inbound

Hetu v2: A General and Scalable Deep Learning System with Hierarchical and Heterogeneous Single Program Multiple Data Annotations cites this paper.

Hetu v2: A General and Scalable Deep Learning System with Hierarchical and Heterogeneous Single Program Multiple Data Annotations Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-16T05:32:40.828417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b98d2e69-c40f-4c0f-a376-a80a2b2b4410 · inbound

Hardware-Efficient Attention for Fast Decoding cites this paper.

Hardware-Efficient Attention for Fast Decoding Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 46

Resolution: unresolved; no resolver link, observed 2026-08-07T13:32:31.424098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2b1adefe-1e6a-4e8c-8fe1-fb2f309c00e3 · inbound

Speeding up Model Loading with fastsafetensors cites this paper.

Speeding up Model Loading with fastsafetensors Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T12:58:04.791744Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2416c498-850c-4e9e-9e1a-2891e812dea0 · inbound

Technical Report of TeleChat2, TeleChat2.5 and T1 cites this paper.

Technical Report of TeleChat2, TeleChat2.5 and T1 Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-06T14:43:22.531285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 434e3dfa-8e73-4bda-9894-afc73a21f4fb · inbound

Efficient and Scalable Agentic AI with Heterogeneous Systems cites this paper.

Efficient and Scalable Agentic AI with Heterogeneous Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-06T14:16:14.564374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 98915eea-eaf6-4490-9f89-fa2b7b9db928 · inbound

SpikingBrain: Spiking Brain-inspired Large Models cites this paper.

SpikingBrain: Spiking Brain-inspired Large Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-18T18:51:45.811840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation fdb78c4e-ce1a-4b43-aee2-89eaf78d9c06 · inbound

Towards EnergyGPT: A Large Language Model Specialized for the Energy Sector cites this paper.

Towards EnergyGPT: A Large Language Model Specialized for the Energy Sector Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 60

Resolution: verified exact; arxiv_id, observed 2026-05-18T17:42:47.536706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5016bb78-fabd-40f9-90ce-84c305794c98 · inbound

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining cites this paper.

Beyond URLs: Metadata Diversity and Position for Efficient LLM Pretraining Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 15

Resolution: metadata mismatch; arxiv_id, observed 2026-05-17T04:49:03.022290Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 24b707cb-bacc-4ff0-948d-eaa90040a26f · inbound

Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning cites this paper.

Rethinking Expert Trajectory Utilization in LLM Post-training for Mathematical Reasoning Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 27

Resolution: verified exact; arxiv_id, observed 2026-05-16T22:43:37.893546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 19c9e4ea-19e8-4fd7-82ab-82d278e94d87 · inbound

Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency cites this paper.

Revisiting Training Scale: An Empirical Study of Token Count, Power Consumption, and Parameter Efficiency Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-03T11:25:09.562026Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 328733c0-12be-44c1-8352-58b97e7d75af · inbound

Kimi K2.5: Visual Agentic Intelligence cites this paper.

Kimi K2.5: Visual Agentic Intelligence Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 43

Resolution: verified exact; arxiv_id, observed 2026-05-10T16:09:05.345041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 177b40ef-d995-4946-a80f-645b9db7e617 · inbound

Attention Residuals cites this paper.

Attention Residuals Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 34

Resolution: verified exact; arxiv_id, observed 2026-05-21T06:39:04.522153Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation c9817349-2284-48aa-8094-16363d79dabe · inbound

AEGIS: Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems cites this paper.

AEGIS: Scaling Long-Sequence Homomorphic Encrypted Transformer Inference via Hybrid Parallelism on Multi-GPU Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 51

Resolution: verified exact; arxiv_id, observed 2026-05-13T19:23:09.283474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 6a0912e7-1778-41aa-9a95-863b705e390c · inbound

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience cites this paper.

An Engineering Journey Training Large Language Models at Scale on Alps: The Apertus Experience Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-05-10T14:20:30.878284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b02ba0ef-36db-49ff-9907-d9d5d8aa0421 · inbound

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels cites this paper.

Nautilus: An Auto-Scheduling Tensor Compiler for Efficient Tiled GPU Kernels Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 23

Resolution: verified exact; arxiv_id, observed 2026-05-10T10:24:21.492412Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation b98fd996-021b-4bf4-bd1b-e32939204f3b · inbound

GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion cites this paper.

GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 11

Resolution: verified exact; arxiv_id, observed 2026-05-11T11:51:04.200107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation fbf8fc09-41b9-4bdb-b3b7-64885625d174 · inbound

Efficient Training on Multiple Consumer GPUs with RoundPipe cites this paper.

Efficient Training on Multiple Consumer GPUs with RoundPipe Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 35

Resolution: verified exact; arxiv_id, observed 2026-05-12T09:31:26.784462Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 4459bbc7-997e-4ae8-bc91-8ddb8ad82895 · inbound

A Scalable Recipe on SuperMUC-NG Phase 2: Efficient Large-Scale Training of Language Models cites this paper.

A Scalable Recipe on SuperMUC-NG Phase 2: Efficient Large-Scale Training of Language Models Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 16

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T03:45:56.331268Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation d8715644-38f9-4b6f-9f37-30e957cda438 · inbound

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers cites this paper.

Navigating LLM Valley: From AdamW to Memory-Efficient and Matrix-Based Optimizers Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 26

Resolution: verified exact; arxiv_id, observed 2026-05-12T06:41:45.669017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5e29785d-d1b4-451b-88e8-0ea4b476cde0 · inbound

MinT: Managed Infrastructure for Training and Serving Millions of LLMs cites this paper.

MinT: Managed Infrastructure for Training and Serving Millions of LLMs Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 19

Resolution: verified exact; arxiv_id, observed 2026-05-14T19:27:51.896687Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 66d0774e-14e5-4333-ad20-0313dfe62708 · inbound

MinT: Managed Infrastructure for Training and Serving Millions of LLMs cites this paper.

MinT: Managed Infrastructure for Training and Serving Millions of LLMs Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-06-30T22:05:06.246888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 98a325aa-8eea-4233-abb5-1b7f161c9428 · inbound

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference cites this paper.

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 10

Resolution: metadata mismatch; arxiv_id, observed 2026-05-20T14:13:21.202970Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 74ea8c6e-298e-4381-a6e7-301a64b72879 · inbound

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference cites this paper.

Charon: A Unified and Fine-Grained Simulator for Large-Scale LLM Training and Inference Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 16

Resolution: verified exact; arxiv_id, observed 2026-05-21T08:59:55.795270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 79497a54-12f9-423d-aafb-370042858c82 · inbound

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability cites this paper.

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 33

Resolution: verified exact; arxiv_id, observed 2026-05-20T07:38:09.493332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 12c7c42b-e7ee-4c9e-a26f-e5612c9b589e · inbound

Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks cites this paper.

Identifying and Mitigating Systemic Measurement Bias in Production LLM Inference Benchmarks Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-06-30T15:44:48.308088Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 18dd1c7d-1d54-4fb3-b41d-d0ad1f22525a · inbound

Heterogeneous Parallelism for Multimodal Large Language Model Training cites this paper.

Heterogeneous Parallelism for Multimodal Large Language Model Training Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 10

Resolution: verified exact; arxiv_id, observed 2026-06-29T18:43:50.412459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 702f9e44-561d-495f-a5ef-ae30dc9bc281 · inbound

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention cites this paper.

MOSS-Video-Preview: Toward Real-Time Video Understanding via Cross-Attention Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 50

Resolution: verified exact; arxiv_id, observed 2026-07-01T22:26:17.872984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 5c6e3757-cf93-446d-827b-e7eeb1a5facb · inbound

Model Multiplicity for Adversarial Detection in Small Language Model Training on Edge Devices cites this paper.

Model Multiplicity for Adversarial Detection in Small Language Model Training on Edge Devices Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 17

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T19:37:19.322887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 8ac83b28-42d8-4410-8f26-1dd54aa5ebbe · inbound

Piper: A Programmable Distributed Training System cites this paper.

Piper: A Programmable Distributed Training System Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 30

Resolution: verified exact; arxiv_id, observed 2026-07-03T07:57:44.655438Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 132e3e92-7590-4d9e-87c2-8672827fad05 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 225

Resolution: verified exact; arxiv_id, observed 2026-07-04T11:09:46.461495Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation db29d1e9-7eb4-4784-8506-b0ee07621a42 · inbound

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems cites this paper.

The Hitchhiker's Guide to Agentic AI: From Foundations to Systems Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 211

Resolution: unresolved; no resolver link, observed 2026-08-02T10:27:18.508664Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 78b96fde-1b39-415a-b5e3-11a9ee3918da · inbound

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint cites this paper.

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 4

Resolution: verified exact; arxiv_id, observed 2026-07-03T17:28:43.916831Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation e857b2bb-5386-442e-8cc5-6b2d1d92bfee · inbound

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint cites this paper.

PHOENIX: Resilient LLM Training with Hot-Swapping via Zero-Overhead Checkpoint Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 4

Resolution: unresolved; no resolver link, observed 2026-07-12T08:40:29.554554Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e919841b-30d3-4e66-a2d1-e594d06b6753 · inbound

Design-CP: Context Parallelism for Design of Protein Nanoparticles cites this paper.

Design-CP: Context Parallelism for Design of Protein Nanoparticles Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 75

Resolution: unresolved; no resolver link, observed 2026-07-12T02:29:52.764344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7ed52c58-f009-466d-870c-16cd34446578 · inbound

GIFT: Geometry-Informed Low-precision Gradient Communication for LLM Pretraining cites this paper.

GIFT: Geometry-Informed Low-precision Gradient Communication for LLM Pretraining Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 14

Resolution: verified exact; local_arxiv, observed 2026-07-09T09:16:06.525993Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

Observation 00d01956-3547-4166-88a1-c427c5c4440e · inbound

LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget cites this paper.

LongStraw: Long-Context RL Beyond 2M Tokens under a Fixed GPU Budget Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-02T00:41:45.468565Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 73494bae-8a1d-4c9f-a9ac-3a3c3d90d1a0 · inbound

A Training-Memory Regression in MLA Sequence Parallelism: Why Megatron-Core Forbids Absorption, and LAGA -- a Communication-Efficient Fix cites this paper.

A Training-Memory Regression in MLA Sequence Parallelism: Why Megatron-Core Forbids Absorption, and LAGA -- a Communication-Efficient Fix Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 2021

Resolution: unresolved; no resolver link, observed 2026-08-01T17:32:37.511773Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation af076d3f-fb73-4ce8-9211-432cca962ff0 · inbound

MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning cites this paper.

MALT: Lightweight Curvature-Aware Muon via Diagonal Preconditioning Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-06T05:39:25.283911Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e931b501-2f67-4399-aabb-423c49c75522 · inbound

Memory-Efficient Activation Checkpointing with Sliding Window and Hirschberg's Algorithm for 0/1 Knapsack Solving in PyTorch cites this paper.

Memory-Efficient Activation Checkpointing with Sliding Window and Hirschberg's Algorithm for 0/1 Knapsack Solving in PyTorch Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-14T04:31:49.781442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a8ef394-e7e8-4f03-adaf-c0e050621e9d · inbound

Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model cites this paper.

Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-14T14:53:28.934067Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers