Pith. sign in

Paper Citation Record · LEDGER

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO

As of 20 August 2026, this Paper Citation Record lists 100 of 140 outbound references and 2 inbound Pith citation observations for arXiv:2506.09275.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.09275 v1

Coverage vector

measured 100 of 140 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T04:57:52.478813Z

measured 102 of 102 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-19T06:32:44.657259+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T04:49:48.009790Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-10T23:30:51.986121Z

Reference resolution

100 of 140 outbound references displayed

  • verified exact1
  • verified fuzzy19
  • unresolved80
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 06b4fd04-f0a1-40c6-bf64-7ee419fdd3a1 · outbound

This paper cites Carbon explorer: A holistic framework for designing carbon aware datacenters.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Carbon explorer: A holistic framework for designing carbon aware datacenters

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.155358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.155358Z digest=sha256:50a60fe8ead87fb4108ab07c344702ac5a53becf5a9cac829a5eda8196391fdc

Observation cb3b6b2f-b71d-4343-8bf8-0ddd1c08214f · outbound

This paper cites Gar- net: A detailed on-chip network model inside a full-system simulator.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Gar- net: A detailed on-chip network model inside a full-system simulator

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.159428Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.159428Z digest=sha256:30d86c4f94b893c6ed7170d04a525e2c08456e1baa0e140183ba8a5b4c8bc366

Observation 69695c15-392a-4cc9-9e65-08090658826f · outbound

This paper cites A survey of computer architecture simulation techniques and tools.Ieee Access, 7:78120–78145, 2019.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A survey of computer architecture simulation techniques and tools.Ieee Access, 7:78120–78145, 2019

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.162733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.162733Z digest=sha256:3dbf1395e2226a1393d23a0cd8550486e3efc783dd8ad8dbe3f65ef1aba66af4

Observation 8284d8a7-fbd4-4660-8909-8b2d35a12d26 · outbound

This paper cites Partir: Composing spmd partitioning strategies for machine learning.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Partir: Composing spmd partitioning strategies for machine learning

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.166178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.166178Z digest=sha256:992c45fe2ad2205ce1352aa3b4497be0e8eb1630654ecaa070739b3329d713d6

Observation 5e0905bd-b6e6-4252-a701-6d6d33932b99 · outbound

This paper cites Pytorch 2: Faster machine learning through dynamic python bytecode transformation and graph compilation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Pytorch 2: Faster machine learning through dynamic python bytecode transformation and graph compilation

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.169568Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.169568Z digest=sha256:567147107c138e2130b6fad72d8428b8d939393c23ae5d7d1746a646c517ce51

Observation 7e2733f3-9702-423f-b8da-1a9efea7abc5 · outbound

This paper cites Deepflow: A cross-stack pathfinding framework for distributed ai systems.ACM Transactions on Design Automation of Electronic Systems, 29(2):1–20, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Deepflow: A cross-stack pathfinding framework for distributed ai systems.ACM Transactions on Design Automation of Electronic Systems, 29(2):1–20, 2024

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.172845Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.172845Z digest=sha256:9326f2a29592a36cb24390238b72ad5cd8565da02bba6954bfba7a9f3d51fb28

Observation a320d8a0-be26-425e-b3e8-683d7ac95a5d · outbound

This paper cites Efficient Large Scale Language Modeling with Mixtures of Experts.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Efficient Large Scale Language Modeling with Mixtures of Experts

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.178001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.178001Z digest=sha256:78e965a6f21b6419d8cc35892b600657889cde7681114a363c9218fc0d99835d

Observation 61da18ee-e710-46cd-bce9-a157c3fb46a2 · outbound

This paper cites Understanding the future of energy efficiency in multi-module gpus.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Understanding the future of energy efficiency in multi-module gpus

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.182635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.182635Z digest=sha256:dbd36043f02df43db768866a4b6a4da5494fdc66730ffe047d6cf62436bcf624

Observation 2a717df5-faab-4a92-83d5-99ad966fe01f · outbound

This paper cites vtrain: A simulation framework for evaluating cost- effective and compute-optimal large language model training.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO vtrain: A simulation framework for evaluating cost- effective and compute-optimal large language model training

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.185601Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.185601Z digest=sha256:b924c919769e1526818055e7230d2330201380e5b99595fa26c122456641ef46

Observation 12d154df-7007-466b-912d-ff39e4285232 · outbound

This paper cites Dtco including sustainability: Power-performance-area-cost-environmental score (ppace) analysis for logic technologies.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Dtco including sustainability: Power-performance-area-cost-environmental score (ppace) analysis for logic technologies

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.188797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.188797Z digest=sha256:1630bfc2da909aeaabf69945d807a9fea02820488caece39046d206121796557

Observation c2b384ca-e873-4d84-a3d7-b23d2f206969 · outbound

This paper cites The datacenter as a computer: Designing warehouse-scale machines.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO The datacenter as a computer: Designing warehouse-scale machines

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.191642Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.191642Z digest=sha256:9c25c678ce57e451a2347a47c26fc39f573b6ac99d0fd87b040070c2912473f3

Observation 81728c38-877f-4cf8-bb4d-bfcbe3b39a46 · outbound

This paper cites Stco: driving the more than moore era.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Stco: driving the more than moore era

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.194648Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.194648Z digest=sha256:7fa4471c9be7d427321cb6897f00fa308d16bfd8ff04bafaf8dc32aafb222826

Observation 31a1ec10-b15f-4a8a-8736-38f06f28ce7e · outbound

This paper cites A survey of cache simulators.ACM Computing Surveys (CSUR), 53(1):1–32, 2020.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A survey of cache simulators.ACM Computing Surveys (CSUR), 53(1):1–32, 2020

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.197731Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.197731Z digest=sha256:420469803dea8e05f89dcbc68c916c7018090c70fd986e8a7445be915930f198

Observation c0aaf8e7-cffc-40c4-a100-73e51bbeaa8d · outbound

This paper cites Understanding gpu power: A survey of profiling, modeling, and simulation methods.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Understanding gpu power: A survey of profiling, modeling, and simulation methods

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.200901Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.200901Z digest=sha256:69456f881ea20280b32f1d59c534ee827f3012e32726904026660dc3eb06dee2

Observation 8250d61a-f2e9-4ebc-9537-08d8eff3fe09 · outbound

This paper cites Wattch: A framework for architectural-level power analysis and optimizations.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Wattch: A framework for architectural-level power analysis and optimizations

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.204038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.204038Z digest=sha256:636ca2b1041acc359f9438ab40ce6a46feadc8d2f63b67138a54ea9e5e81c0d4

Observation fddf78bc-3abc-42ac-ba1a-b98e993c1fc1 · outbound

This paper cites TVM: An automated End-to-End optimizing compiler for deep learning.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO TVM: An automated End-to-End optimizing compiler for deep learning

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.207088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.207088Z digest=sha256:749e644edb5fa523982b383a7ebdb3f1c24a5e1c8f6afced75a27b3f00f9cfd4

Observation 88dd7ac2-8c6d-4b7b-8438-ac793b86ce5e · outbound

This paper cites cuDNN: Efficient Primitives for Deep Learning.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO cuDNN: Efficient Primitives for Deep Learning

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.210089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.210089Z digest=sha256:8770624f372944c0ef2c5bbd823958c3d0d2e5567ce48b02df766e675efc202c

Observation 4d0adc31-b0f8-4038-abe3-c8b97373299e · outbound

This paper cites LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO LLMServingSim: A HW/SW Co-Simulation Infrastructure for LLM Inference Serving at Scale

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.213733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.213733Z digest=sha256:054c6db08aba1130f89b9bf303c10add2b658d9635a60804494b02fe0524c8d9

Observation ccc59b65-4911-4cc2-8e58-0c9f97c3af1e · outbound

This paper cites CodeCarbon: v2.4.1.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO CodeCarbon: v2.4.1

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.217230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.217230Z digest=sha256:62e06656075c5d089f2e4c4540a1b6bae517ee91a2ebaf82f53b400b20d9b4d4

Observation cf3883cd-bf1b-4f70-a266-462d927b1536 · outbound

This paper cites Gloo100k: Collective communications library with various primitives for multi-machine training.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Gloo100k: Collective communications library with various primitives for multi-machine training

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.220350Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.220350Z digest=sha256:a34bc0808b541a170bdc75f60fd1496d45aa709d88fc592190bd4133fbcbde78

Observation cdfca887-7365-459e-bbd0-b9452a47edcc · outbound

This paper cites Stablehlo: A portable high-level operations set for machine learning models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Stablehlo: A portable high-level operations set for machine learning models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.223422Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.223422Z digest=sha256:5c49fef313a70e7b9afefac7ad350ea17852abda9d7cacec157dda172ccfda14

Observation fa759020-9088-4f59-87f2-f5a06e259fb2 · outbound

This paper cites Torchscript documentation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Torchscript documentation

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.229822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.229822Z digest=sha256:6d8cfbb220562d547cf0fae451862dcde8ae57142caf4cf59ca1eaf7d06bf8e7

Observation 4013fbfa-c7a7-45fa-ac2e-3045f0c2219d · outbound

This paper cites Available at https://docs.nvidia.com/cuda/ parallel-thread-execution/index.html.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Available at https://docs.nvidia.com/cuda/ parallel-thread-execution/index.html

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.232800Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.232800Z digest=sha256:a4269c524b545c5b411ec3abcce0050c06cc47b05dfecf17cdc1a2588b041dbe

Observation 439d6a9c-422a-4080-a5c0-b2564183567a · outbound

This paper cites Nvidia dgx h200, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Nvidia dgx h200, 2024

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.235785Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.235785Z digest=sha256:5cbb88def0ab31a24bc1f118eb0030e5c34fd49c37e356ba859a2f6d83b72ce5

Observation ecfaa338-89ea-4808-b27c-16656cdae504 · outbound

This paper cites The rising costs of training frontier AI models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO The rising costs of training frontier AI models

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.238746Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.238746Z digest=sha256:3bfaa053a04c91d8a76021d92b62306261b80b5cb0869c6601d6050aa12f2313

Observation 7bcf91cb-731f-452f-8dd9-e6d4bbeb439e · outbound

This paper cites Total cost of ownership model for data center technology evaluation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Total cost of ownership model for data center technology evaluation

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.242350Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.242350Z digest=sha256:b0affa591277395a031ff611a5a56856ed6ed9d0027ff4f34e35aa4b7ad45eb6

Observation 40692d6d-4a45-4710-87ff-e49d6f0f114b · outbound

This paper cites Total cost of ownership model for data center technology evaluation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Total cost of ownership model for data center technology evaluation

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.245659Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.245659Z digest=sha256:9d43f43c03672a7513828fd43879cc6ab091bfc5cb4b4999db1b0136aa39092e

Observation e05d0066-8379-4a47-90ec-542c8ff188d2 · outbound

This paper cites Logp: Towards a realistic model of parallel computation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Logp: Towards a realistic model of parallel computation

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.248741Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.248741Z digest=sha256:f1e0edccfb5201f5c3cf62f21c757ae1c4c2eda95ea4a16e75b656a455b542c0

Observation 891531be-5c12-4db8-8b63-d392c458601a · outbound

This paper cites Large scale distributed deep networks.Advances in neural information processing systems, 25, 2012.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Large scale distributed deep networks.Advances in neural information processing systems, 25, 2012

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.251859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.251859Z digest=sha256:862ffa9f2e6f648b32c386f8e2b8655a6474855962e7726cb6a4c5289f1f75c1

Observation 55356466-fa25-45fe-a080-d3921a763848 · outbound

This paper cites Uptime institute global data center survey 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Uptime institute global data center survey 2024

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.254897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.254897Z digest=sha256:a55d4d7f060994db1cbc40bbf48cc0c1e71db12c207e1ded818f601e77f0e089

Observation d66f890b-69d6-4df1-80fe-3b30417286b6 · outbound

This paper cites Proteus: Simulating the performance of distributed dnn training.IEEE Transactions on Parallel and Distributed Systems, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Proteus: Simulating the performance of distributed dnn training.IEEE Transactions on Parallel and Distributed Systems, 2024

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.257927Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.257927Z digest=sha256:0374113ed041a48eb70d2f79465d4bcf5b6e6e1e7eb1a99528ac8e4331f970b7

Observation 4e16c234-e2b5-4a8b-a9c3-7737870bf0d5 · outbound

This paper cites Cordoba: Carbon-efficient optimization framework for computing systems.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Cordoba: Carbon-efficient optimization framework for computing systems

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.260766Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.260766Z digest=sha256:ab13f165093c83ce8097aa138e60ec15e9fe4d67d9670551ed26272341da1969

Observation ff437a87-33d3-43e5-b3cb-bf4972c8b1f2 · outbound

This paper cites Amant, Karthikeyan Sankaralingam, and Doug Burger.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Amant, Karthikeyan Sankaralingam, and Doug Burger

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.264152Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.264152Z digest=sha256:95b975b775eb4a38393e036b8eb901c24de40c6db6e7a0d94e4de12901288220

Observation 86fbad80-ab55-474b-994c-abb8a8076a5e · outbound

This paper cites Llmcarbon: Modeling the end-to-end carbon footprint of large language models, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Llmcarbon: Modeling the end-to-end carbon footprint of large language models, 2024

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.267205Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.267205Z digest=sha256:1a20c428e739820e215337ef33875152a7ecd305eff8ec4843350e2f1f8e5c0e

Observation 48018a51-2778-4d1c-b45a-7798bea4a185 · outbound

This paper cites Echo: Simulating Distributed Training At Scale.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Echo: Simulating Distributed Training At Scale

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.270151Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.270151Z digest=sha256:6ba1bb2093c9f343daa585148fe8de16644135b823f37d6ea0cc14a67819842f

Observation e98b8883-529e-4497-87a9-bed524880779 · outbound

This paper cites Mpi: A message-passing interface standard, 1994.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Mpi: A message-passing interface standard, 1994

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.273670Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.273670Z digest=sha256:89e8a6263e919a8cbccc030fc91d5274b1ee9291292190328314355af08eb1c9

Observation 729c737d-e64d-48e0-887d-c26a1d082b1e · outbound

This paper cites Estimating gpu memory consumption of deep learning models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Estimating gpu memory consumption of deep learning models

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.276735Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.276735Z digest=sha256:8da7534b85224fd1004a163ff30b7f0485e667c814098c1589b4f965b40d0a8c

Observation 0a38169d-6d67-48ad-a246-04813615a9b5 · outbound

This paper cites MIT Press, 2016.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO MIT Press, 2016

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.279670Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.279670Z digest=sha256:33a44d3314f2c923de9202ef10695b1f93adee35198afaf698c2c2b1b544bd53

Observation 6ff25cb0-e011-4ca8-b3de-ae09addb69c1 · outbound

This paper cites Google data centers efficiency, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Google data centers efficiency, 2024

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.282879Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.282879Z digest=sha256:b17e7479481138e62476405a04f74d5e9364888517628b7a93bd811624f7eaae

Observation 01c50d2e-bf89-4da5-a498-e71ee1ba46a7 · outbound

This paper cites Catch: a cost analysis tool for co- optimization of chiplet-based heterogeneous systems, 2025.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Catch: a cost analysis tool for co- optimization of chiplet-based heterogeneous systems, 2025

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.286047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.286047Z digest=sha256:08f301d5b1bd23ed81d32fddd0e39e52dd72aac101239e6b671ce40c4604c0a9

Observation e0f43c34-f34c-4fae-9d38-51537f1d458c · outbound

This paper cites Gpgpu power modeling for multi-domain voltage-frequency scaling.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Gpgpu power modeling for multi-domain voltage-frequency scaling

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.292718Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.292718Z digest=sha256:8603841353156579e9000576dfcca0a0d6fc7de7a179c333d2f1316119a6228b

Observation ff78e0dd-7644-4ace-b5ff-c4fe92447cd1 · outbound

This paper cites Accelerating design space ex- ploration for LLM training systems with multi-experiment parallel simulation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Accelerating design space ex- ploration for LLM training systems with multi-experiment parallel simulation

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.295993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.295993Z digest=sha256:29b8f522f5219e088edd3378c71d3ddb31bea6ead80a034b60f44fae43e3a693

Observation 31715443-f00c-4c3c-b2e7-c194f19950cc · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.299174Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.299174Z digest=sha256:b7c746dab8d472338bf05a37ac319729351b913eb563af7d1ba50c2a7861aa82

Observation f19f4bf1-3303-43a3-970f-449ee935a0e7 · outbound

This paper cites A survey on performance modeling and prediction for distributed dnn training.IEEE Transac- tions on Parallel and Distributed Systems, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A survey on performance modeling and prediction for distributed dnn training.IEEE Transac- tions on Parallel and Distributed Systems, 2024

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.302225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.302225Z digest=sha256:3365c3f3a779b59d321b66296d67326be3bb0cf4a65d77d6094090094fb1be80

Observation d077cdff-9ae7-430f-a0cd-ee2b2a6bd385 · outbound

This paper cites Act: Designing sustainable computer systems with an architectural carbon modeling tool.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Act: Designing sustainable computer systems with an architectural carbon modeling tool

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.305105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.305105Z digest=sha256:f08d022d1bcb792fb3a63bf19e5ac39a5c27f4d76cdfe07adbc08f93448ea9e5

Observation 298e90f1-0444-4a18-93eb-762745ac6ba6 · outbound

This paper cites Chasing car- bon: The elusive environmental footprint of computing.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Chasing car- bon: The elusive environmental footprint of computing

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.308386Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.308386Z digest=sha256:04d32f38a8f1b26b18a44ee6cb85f283f56e07f68de512e6b53a55ff98acbb9d

Observation 89b94b34-6b35-45ad-a8b6-2238d3a46924 · outbound

This paper cites Onnxim: A fast, cycle-level multi-core npu simulator, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Onnxim: A fast, cycle-level multi-core npu simulator, 2024

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.311440Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.311440Z digest=sha256:ac22f24cc92af85ef5857cd5847c5487b86575a48830cd363e8d6d3a96b3770d

Observation 7709cf75-a4e8-4c66-9f77-d0d58857bc14 · outbound

This paper cites An analytical framework for estimating tco and exploring data center design space.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO An analytical framework for estimating tco and exploring data center design space

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.314915Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.314915Z digest=sha256:a730f7d4d7d06417627ee67afe5dc290410858c40132603918c9e716228b5a7f

Observation ce6d56b5-17b3-48b4-9e61-88c0d5847bdb · outbound

This paper cites Ryckaert.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Ryckaert

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.318012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.318012Z digest=sha256:7fe37372929521e3c9004c25021c8c1acef1c7bc959d5bfd06cf564975f1000a

Observation b12418b8-2e43-4cca-a19d-507d1cd019f9 · outbound

This paper cites Towards the systematic reporting of the energy and carbon footprints of machine learning.Journal of Machine Learning Research, 21(248):1–43, 2020.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Towards the systematic reporting of the energy and carbon footprints of machine learning.Journal of Machine Learning Research, 21(248):1–43, 2020

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.321145Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.321145Z digest=sha256:813b431b955cb498c9830bbf34e579eba993463d65cfdb361172491a44862923

Observation aa0917dd-7d2b-465f-9e2d-fd79319a13fc · outbound

This paper cites Towards the systematic reporting of the energy and carbon footprints of machine learning, 2022.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Towards the systematic reporting of the energy and carbon footprints of machine learning, 2022

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.324358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.324358Z digest=sha256:2cc3af0a3fd2685099d6d3232cede7b80d6d1062ebde459c46ef3bcacf3b7837

Observation 870c90f3-f4bc-4fd9-a385-014621ae5e78 · outbound

This paper cites Group operation assembly language-a flexible way to express collective com- munication.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Group operation assembly language-a flexible way to express collective com- munication

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.327506Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.327506Z digest=sha256:973d4eddbbeeba5273edad404634e2a3bf1063ae451eafc1ee214b8aa022c782

Observation 125ee60b-686f-4599-8c16-72dc4c2a7bd8 · outbound

This paper cites An integrated gpu power and performance model.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO An integrated gpu power and performance model

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.330563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.330563Z digest=sha256:e5d35fd18f7df893fc76f78632224f70e2887a2a09ad3cfe3610bce061bfb0bb

Observation 37283fa5-61dd-4de5-a73a-a3649c29d043 · outbound

This paper cites an unresolved cited work.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Unresolved cited work

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.333657Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.333657Z digest=sha256:cf563de6b5b0ff83ab6d75397fdad7269e8aab7971b45e6f34b774144b05407e

Observation d3d924b6-120f-4f7e-af78-0438196405f4 · outbound

This paper cites imec.netzero public, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO imec.netzero public, 2024

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.336695Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.336695Z digest=sha256:a9435ab683158d7575a5aa39b584a50f204eb96b982a37a975c8b4a6defa237c

Observation 5405c30a-c7a0-4311-b747-e981ceea3a9b · outbound

This paper cites Batch normalization: Accelerating deep network training by reducing internal covariate shift.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Batch normalization: Accelerating deep network training by reducing internal covariate shift

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.340228Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.340228Z digest=sha256:cbfc2b45db6106df27c9e574f165ca9aa68b5fcb51270e126e2fdb4c5a2845aa

Observation d016ba27-5c77-411a-bcc5-88595efefc90 · outbound

This paper cites Calculon: a methodology and tool for high-level co-design of systems and large language models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Calculon: a methodology and tool for high-level co-design of systems and large language models

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.343296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.343296Z digest=sha256:b5eb47951f78057411e7177c09bef2f96a085942f9de126bb396d9b97e45068a

Observation fc697b19-932f-498a-bc1e-92cbcf7b64d1 · outbound

This paper cites DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Models

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.346347Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.346347Z digest=sha256:450d6a89865f3b8e162d930a0970cad1386b89a6c2828533b1f7174227028915

Observation b3d6af5a-8e8b-4764-9672-6aa70861b738 · outbound

This paper cites A quantitative evaluation of contemporary gpu simulation methodology.Proceedings of the ACM on Measurement and Analysis of Computing Systems, 2(2):1–28, 2018.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A quantitative evaluation of contemporary gpu simulation methodology.Proceedings of the ACM on Measurement and Analysis of Computing Systems, 2(2):1–28, 2018

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.350083Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.350083Z digest=sha256:e258f7ce5b242475ce8874eea1116425ce2fbd8f4bce803747a81ceaa5631779

Observation 857459fc-767c-471b-804f-01562e51e737 · outbound

This paper cites Scarif: Towards carbon modeling of cloud servers with accelerators.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Scarif: Towards carbon modeling of cloud servers with accelerators

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.353238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.353238Z digest=sha256:1f66627b0cfc74ca0925369f79ec0d9a9928bb246ea09b83755f99da2a90d3c1

Observation 21b109d6-ab52-4c0e-8e5c-6694a30657a3 · outbound

This paper cites Beyond data and model parallelism for deep neural networks.Proceedings of Machine Learning and Systems, 1:1–13, 2019.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Beyond data and model parallelism for deep neural networks.Proceedings of Machine Learning and Systems, 1:1–13, 2019

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.356419Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.356419Z digest=sha256:76e1a94f8339d4dd827830a9a25632670dccbf13ac48f1bb3b7aa59049b7f493

Observation a44eb354-53e7-4716-b25b-20049c922c2b · outbound

This paper cites Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Tpu v4: An optically reconfigurable supercomputer for machine learning with hardware support for embeddings

Reference 63

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.359282Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.359282Z digest=sha256:ba0141ec6b8c5f88fbcb811955e58012495634db38d29182fd747ce054a60ef0

Observation 9f2afaf8-5d0f-49f9-949e-8802fd50788c · outbound

This paper cites In-datacenter performance analysis of a tensor processing unit.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO In-datacenter performance analysis of a tensor processing unit

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.362258Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.362258Z digest=sha256:f63a48647c5b92dbe525e7a5741e27b9bf4db21c28d5844f6eefc007662fd740

Observation 3dbdb77e-381e-4d5a-8839-6bf47e3a7540 · outbound

This paper cites Accelwattch: A power modeling framework for modern gpus.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Accelwattch: A power modeling framework for modern gpus

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.365870Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.365870Z digest=sha256:ad78f0b228bbf7320b1b7fb9565887abca16541d7e8d645c610be231475bed4e

Observation c6dea6d6-cfd9-47e5-a421-1fedca7475e1 · outbound

This paper cites MIOpen: An Open Source Library For Deep Learning Primitives.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO MIOpen: An Open Source Library For Deep Learning Primitives

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.368856Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.368856Z digest=sha256:e4f659d490be021707e32e75c69c73233dd06d6be8b7575ad873dd718856ae4a

Observation 071081d0-8493-42ef-a18b-0e99711d9fc9 · outbound

This paper cites Moonwalk: Nre optimization in asic clouds.SIGARCH Comput.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Moonwalk: Nre optimization in asic clouds.SIGARCH Comput

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.372221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.372221Z digest=sha256:b3db95a2818e8293f1025139cd1f8e946cd539e128178e3b0bdcbaa5cb49eb0f

Observation 73df6e8a-7fa8-4baf-910f-33d09488f446 · outbound

This paper cites LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.375078Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.375078Z digest=sha256:c67073ab7935dcde395a18ebeed19fcfd24a47d9ceca95242c91fe4e042c29f6

Observation 91210b0a-f774-4a55-b34f-007207878237 · outbound

This paper cites Adam: A Method for Stochastic Optimization.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Adam: A Method for Stochastic Optimization

Reference 69

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.378380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.378380Z digest=sha256:47441a930070e54b80da41b797a8f0efb3b1718cfb6ccaa38f7b89a75772a393

Observation ce9ccecf-224d-429f-a0fe-3e658742cba0 · outbound

This paper cites Greenchip: A tool for evaluating holistic sustainability of modern computing systems.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Greenchip: A tool for evaluating holistic sustainability of modern computing systems

Reference 70

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.381307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.381307Z digest=sha256:35b1f4ad7da1a3d03f0ccf22751410921d2fb2a39966c9b710fde4b2ef919c7b

Observation 5e3da598-3bf7-4e8a-8b02-f52055e8c674 · outbound

This paper cites A simple model for determining true total cost of ownership for data centers.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A simple model for determining true total cost of ownership for data centers

Reference 71

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.384400Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.384400Z digest=sha256:2361c6cc73111fa53c877006cb89fc68f469375061f0e1ba3f673bb3afa034c5

Observation d124fa95-9dee-40fc-bd50-ce60eb724ade · outbound

This paper cites Reducing activation recomputation in large transformer models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Reducing activation recomputation in large transformer models

Reference 72

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.974769Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.387416Z digest=sha256:d27494b1ea476db741bcccd907e1532bac4f997e75e20eb67b313255644e4901

Observation 22180df2-748e-4d35-a4b6-11e739f0118c · outbound

This paper cites Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inference

Reference 73

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.390487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.390487Z digest=sha256:432e0d3360b9c032f5186f4b4646e6c47c1a3c2fbd68c1bd93c6ac9c87d01bac

Observation 05e417fa-55ca-4ab1-b93a-0c09c8eb17cb · outbound

This paper cites Quantifying the Carbon Emissions of Machine Learning.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Quantifying the Carbon Emissions of Machine Learning

Reference 74

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.394060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.394060Z digest=sha256:2bee6d0ddfcb4397e1a79f69ffa6d05bd0cdaf4bf3141be1f751992284d91486

Observation ab11d42e-9657-4393-92d2-1509425612b5 · outbound

This paper cites Llvm: A compilation framework for lifelong program analysis & transformation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Llvm: A compilation framework for lifelong program analysis & transformation

Reference 75

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.965486Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.397313Z digest=sha256:9648c8a3715e25bbad3f8b1dce0f66b941c02212faf162e3d844681a6cf6cb3d

Observation 4fb36b0f-25af-430a-8770-e254cea950c8 · outbound

This paper cites Mlir: Scaling compiler infrastructure for domain specific computation.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Mlir: Scaling compiler infrastructure for domain specific computation

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.956115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.400438Z digest=sha256:9bb1a1566e838a75663a46d868225e9ce2f70ccaf080ea11c706bdc8c08a1712

Observation ded2ce9d-69bc-4240-ac79-fdaa2cb71152 · outbound

This paper cites Forecasting GPU Performance for Deep Learning Training and Inference.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Forecasting GPU Performance for Deep Learning Training and Inference

Reference 77

Resolution
verified exact
local_arxiv, observed 2026-08-07T04:57:52.957704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.403708Z digest=sha256:89b0663b73d80be6d89df8afe3b97feaf2ae6159f2e7312a18062de9fcc2253b

Observation 4d6c5cd6-af4c-4b67-bbc9-92b69190c56a · outbound

This paper cites Mcpat: An integrated power, area, and timing modeling framework for multicore and manycore architectures.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Mcpat: An integrated power, area, and timing modeling framework for multicore and manycore architectures

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.946559Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.407066Z digest=sha256:69ae18ab8218f6f563260871a22c23a889ad3a82f38799b208b48ce345af2eb6

Observation bc0a946d-801a-4667-8a9c-a7dd012d37f1 · outbound

This paper cites Towards universal performance modeling for machine learning training on multi-gpu platforms.IEEE Transactions on Parallel and Distributed Systems, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Towards universal performance modeling for machine learning training on multi-gpu platforms.IEEE Transactions on Parallel and Distributed Systems, 2024

Reference 79

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.937144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.410215Z digest=sha256:c9ad59099b68e5034da20569896a06e7c4bfce4dff22740b74560c7fb6f83d96

Observation 25f384dd-3806-494b-bb72-5b1d86181914 · outbound

This paper cites The Llama 3 Herd of Models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO The Llama 3 Herd of Models

Reference 80

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.413074Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.413074Z digest=sha256:757080bf8cb426e06f76def2144dab7d563d633829e9025c3d75b42cbbb9c04e

Observation 454d5b3b-5a9e-4c67-8102-92490af8c6ce · outbound

This paper cites A survey of performance modeling and simulation techniques for accelerator-based computing.IEEE Transactions on Parallel and Distributed Systems, 26(1):272–281, 2014.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO A survey of performance modeling and simulation techniques for accelerator-based computing.IEEE Transactions on Parallel and Distributed Systems, 26(1):272–281, 2014

Reference 81

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.928476Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.416313Z digest=sha256:f1ca582680d15910c0c1c9299cfdca3e5586b3f1930903db59c296d0be93fa71

Observation 92a9f44b-e91c-4e62-8851-337837d78599 · outbound

This paper cites Distsim: A performance model of large-scale hybrid distributed dnn training.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Distsim: A performance model of large-scale hybrid distributed dnn training

Reference 82

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.919207Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.419595Z digest=sha256:26c12427fb288f2d33f74ef52e9df25841968ff716c99f7d7a6df1b826249cbb

Observation 8ca5de48-b907-4c95-8482-0676e6786b65 · outbound

This paper cites Estimating the carbon footprint of bloom, a 176b parameter language model.Journal of Machine Learning Research, 24(253):1–15, 2023.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Estimating the carbon footprint of bloom, a 176b parameter language model.Journal of Machine Learning Research, 24(253):1–15, 2023

Reference 83

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.422480Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.422480Z digest=sha256:731b0c855cc138f9b7bb933f240667bbd0da08b0cb7c3e876006f81d7292b6ff

Observation 1ce70d94-22df-4e45-8077-77004c4301ae · outbound

This paper cites Review of asic accelerators for deep neural network.Microprocessors and Microsystems, 89:104441, 2022.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Review of asic accelerators for deep neural network.Microprocessors and Microsystems, 89:104441, 2022

Reference 84

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.904278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.425429Z digest=sha256:b9f6f892e43ee96230dccb6989031393c299ab1c331829b0c1e6c5d2c9c54192

Observation 90bcfcb3-e79e-4c0e-a164-0c63b1e6f64d · outbound

This paper cites Azure Total Cost of Ownership (TCO) Calcula- tor.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Azure Total Cost of Ownership (TCO) Calcula- tor

Reference 85

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.894761Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.428650Z digest=sha256:389a9f3e0ccb3c1362d2cafccc1811be59957ab7aeb24d847fdce549018d111d

Observation fd20dfbf-0bd3-42ae-bf40-14b3316920f7 · outbound

This paper cites Tensor operator set architecture (tosa) dialect.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Tensor operator set architecture (tosa) dialect

Reference 86

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.885822Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.431871Z digest=sha256:2d0938ee7cb6f7ca5317eb101add14b427992ddf20549f4c1413913cfafa494b

Observation 5fe95af3-1a4a-401f-8bad-08ef7cd95389 · outbound

This paper cites Amped: An analytical model for performance in distributed training of transformers.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Amped: An analytical model for performance in distributed training of transformers

Reference 87

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.876361Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.435082Z digest=sha256:459f64339297e11b44331da28ce042801b5d50567c851c73a5ae984634154923

Observation 63cf2743-9f62-4a71-a5e9-b92cc0dae7c0 · outbound

This paper cites Efficient large-scale language model training on gpu clusters using megatron-lm.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Efficient large-scale language model training on gpu clusters using megatron-lm

Reference 88

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.438443Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.438443Z digest=sha256:36d8567ad4035b1732be51ee0c1c1f4171a46ba99f45ff695211a40e1fe9ad3f

Observation aacfa65a-10d0-4669-8e34-66d0fbec3d95 · outbound

This paper cites Supply chain aware computer architecture.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Supply chain aware computer architecture

Reference 89

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.861782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.441854Z digest=sha256:d391da75eb596d18e8b159961ddd5b6e18683d6143b2d2b83059345960584887

Observation 62cd2ab1-669c-4c24-8ede-49f87980ba00 · outbound

This paper cites Architectural simulators considered harmful.IEEE Micro, 35(6):4–12, 2015.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Architectural simulators considered harmful.IEEE Micro, 35(6):4–12, 2015

Reference 90

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.853278Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.445023Z digest=sha256:00fd3ca18d222d03f71fffe34eaa3f5c1374bfc7cf48a2587a3689d3bdc2c59e

Observation 2ae537e2-1c53-45bd-ae01-e1e487785f02 · outbound

This paper cites Available at https://developer.nvidia.com/nccl.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Available at https://developer.nvidia.com/nccl

Reference 91

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.844648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.448087Z digest=sha256:a6cd6c606f626732e7b56f54537fe8951d6227c0b56efa0246a230a17ff278c8

Observation f42dd465-cb96-4440-8eb9-e210a72bc4bb · outbound

This paper cites Open neural network exchange (onnx).

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Open neural network exchange (onnx)

Reference 92

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.835430Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.451184Z digest=sha256:117631a15d6132ac89ef6762e9f30880c83b83fd121ebd83b6e7b52ebf1f0413

Observation 823d1f6a-0451-4db5-9907-999331e5e05e · outbound

This paper cites Xla architecture and high-level optimizer (hlo).

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Xla architecture and high-level optimizer (hlo)

Reference 93

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.826258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.454230Z digest=sha256:20780cac29d16f23d07aae8e149bee007807fcc256e5897565f09ef65d3dbccd

Observation 536ecd84-208b-4335-a258-d340d672a571 · outbound

This paper cites Survey on network simulators.International Journal of Computer Applications, 182(21):23–30, 2018.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Survey on network simulators.International Journal of Computer Applications, 182(21):23–30, 2018

Reference 94

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.817389Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.457150Z digest=sha256:accaa9a6e962e11cec698c15940665dd2ea7d7fe07b0c47509732abffcb1b71c

Observation d296986e-9feb-4094-9e74-08a3e9645664 · outbound

This paper cites Carbon Emissions and Large Neural Network Training.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Carbon Emissions and Large Neural Network Training

Reference 95

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.460227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.460227Z digest=sha256:1809f213974c3fbd5751c6db6fd77adbc1324c019ad0f3700592b3e5ba520af1

Observation 7f463f9c-46d5-4b72-8016-0264e718bc60 · outbound

This paper cites Chiplet cloud: Building ai supercomputers for serving large generative language models, 2024.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Chiplet cloud: Building ai supercomputers for serving large generative language models, 2024

Reference 96

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.808681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.463592Z digest=sha256:054e68509f0a3ea6bab072747ed320a27d8058fc5b96e2d79cdb8f86401ace76

Observation 972fc42c-d806-448f-b670-27ddb58fbaa6 · outbound

This paper cites Paleo: A performance model for deep neural networks.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Paleo: A performance model for deep neural networks

Reference 97

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T04:57:53.799860Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.466865Z digest=sha256:9a6cc1faa53e6465d149ae275d4bde20cb10e1baa74e4c3dff4d3af738d21821

Observation 67ccacd2-e5e7-48e9-9b58-50109f9d5f57 · outbound

This paper cites Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale

Reference 98

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.469810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.469810Z digest=sha256:e2e132c42a238909790ed0a2bdf5a4aa17ae52076b5b0a0757747700f9dbb5ef

Observation 870d4915-8c1a-4829-9dbb-a77af41af4d5 · outbound

This paper cites Zero: Memory optimizations toward training trillion parameter models.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Zero: Memory optimizations toward training trillion parameter models

Reference 99

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.472779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.472779Z digest=sha256:db2ed6e4897828f79dfcbd295e052dfa9ad5d09fab2e8ff1134653511049ea13

Observation 244a8661-ca23-4a3a-948b-0f62a2ad878a · outbound

This paper cites Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters

Reference 100

Resolution
unresolved
no resolver link, observed 2026-08-07T04:57:52.475695Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T04:57:52.475695Z digest=sha256:de5fdcf15145ff07349878d3ccd32e33ee0db67559c76e61b0fda52f79e73257

Observation 9a817209-a93d-4a42-9939-53b6a7acb138 · outbound

This paper cites an unresolved cited work.

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO Unresolved cited work

Reference 101

Resolution
unresolved
raw_fallback, observed 2026-08-07T04:57:53.775425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-08-07T04:57:52.478813Z digest=sha256:ae10fd9bb7162ac25b968d741c0a07bd01430131dd95d5634734a82c66dab7c9

Pith citing papers

Observation 64dd6270-02b5-4755-852c-0eb6a60fb80a · inbound

DeepStack: Scalable and Accurate Design Space Exploration for Distributed 3D-Stacked AI Accelerators cites this paper.

DeepStack: Scalable and Accurate Design Space Exploration for Distributed 3D-Stacked AI Accelerators A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO

Reference 101

Resolution
verified exact
arxiv_id, observed 2026-05-10T23:30:51.995488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-19T06:32:44.657259+00:00.

source=pdf_text observed=2026-05-10T19:04:17.725111Z digest=sha256:18049641c3e84a628c3f8ebb6c307466b80ee40cd38a848d1fb5b37e8ab6da83

Observation 647f283d-79ea-4de8-bb0a-aa62ba6552c5 · inbound

TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters cites this paper.

TileSight: A First-Principles Tile-Centric Analytical GPU Performance Model from Cores to Clusters A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-01T04:49:48.009790Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T04:49:48.009790Z digest=sha256:088029e7b41d1ae8f8abb511ff2ebfbac8557f47e166cfae65a4e9e78406d2a4