Pith. sign in

Paper Citation Record · LEDGER

EcoServe: Designing Carbon-Aware AI Inference Systems

As of 9 August 2026, this Paper Citation Record lists 90 of 90 outbound references and 14 inbound Pith citation observations for arXiv:2502.05043.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.05043 v2

Coverage vector

measured 90 of 90 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-08T20:31:35.870375Z

measured 104 of 104 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 14 of 14 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T13:00:31.049555Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T02:29:23.910827Z

Reference resolution

90 of 90 outbound references displayed

  • verified exact0
  • verified fuzzy51
  • unresolved38
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b9fc4737-f092-4758-ae2b-a62df3c92291 · outbound

This paper cites https:// lambdalabs.com/service/gpu-cloud.

EcoServe: Designing Carbon-Aware AI Inference Systems https:// lambdalabs.com/service/gpu-cloud

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.568020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.568020Z digest=sha256:fdc7f7c054221e4f10dbccad92315825d7b0d32e822bf9bd5dc5d253b62efb92

Observation 2c2888aa-75a9-44ab-ab57-fc99bfda0c0c · outbound

This paper cites an unresolved cited work.

EcoServe: Designing Carbon-Aware AI Inference Systems Unresolved cited work

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.572073Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.572073Z digest=sha256:67647106b59dfc15f96992fa8227c6254992bb2caf6da3ed15f063e045b3471d

Observation 7f39646b-6e08-497a-9a1c-e20635c7a3ed · outbound

This paper cites https://news.skhynix.com/hbm2e- opens-the-era-of-ultra-speed-memory-semiconductors/.

EcoServe: Designing Carbon-Aware AI Inference Systems https://news.skhynix.com/hbm2e- opens-the-era-of-ultra-speed-memory-semiconductors/

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.575843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.575843Z digest=sha256:19384266f6bcee39ec0375f086d3d29abf9cee38245c3524c21f4bc8342809c8

Observation 3657a43a-1562-4dda-8912-7eea37efdd80 · outbound

This paper cites [Available Online] https://developer.nvidia.com/tensorrt/, 2023.

EcoServe: Designing Carbon-Aware AI Inference Systems [Available Online] https://developer.nvidia.com/tensorrt/, 2023

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.579381Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.579381Z digest=sha256:d71b04d4e1cac30825e864cee0d352ad082d430e811c3b3d64427fdea988f55a

Observation 5dc2b9d4-5324-4475-8bc8-f7f508d5946f · outbound

This paper cites Carbon explorer: A holis- tic framework for designing carbon aware datacenters.

EcoServe: Designing Carbon-Aware AI Inference Systems Carbon explorer: A holis- tic framework for designing carbon aware datacenters

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.582814Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.582814Z digest=sha256:935f79eab82ae3c0321355af71f0e3b4999a27f8f873d7f7b6e666c6f5e1b20e

Observation e7f4eaf5-f73f-49ec-bc5c-55264a0a7e01 · outbound

This paper cites Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve.

EcoServe: Designing Carbon-Aware AI Inference Systems Taming Throughput-Latency Tradeoff in LLM Inference with Sarathi-Serve

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.586278Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.586278Z digest=sha256:40d1437f574190576c7982a77fbdef877eaebd9d25045a640aaa82ac5ca2592b

Observation 3af02b93-21e5-451e-8782-277fa6ee575c · outbound

This paper cites Deepspeed- inference: Enabling efficient inference of trans- former models at unprecedented scale.

EcoServe: Designing Carbon-Aware AI Inference Systems Deepspeed- inference: Enabling efficient inference of trans- former models at unprecedented scale

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.590178Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.590178Z digest=sha256:91c2172329cf4090442d25fe30470f440167202abd6565ca4f5fd1ff6d9662d9

Observation 305c4472-2da1-4e35-872b-f99e6b85bcee · outbound

This paper cites Aws recommended gpu instances, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Aws recommended gpu instances, 2024

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.593951Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.593951Z digest=sha256:72426cad966721acfaa685178546e3ddbb1f1f91995c3d014ff6c5b3a0b4db60

Observation 2227d5ea-65a4-47a1-b9c8-d1ead4542a3e · outbound

This paper cites Azure gpu optimized virtual machine sizes, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Azure gpu optimized virtual machine sizes, 2024

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.597303Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.597303Z digest=sha256:66946d25069466d2d57129e63132a59488693dea56ce7a2bf4de69e4f27a5c50

Observation 5cc6b4d6-a16e-430e-9f7c-9bc52a81b52d · outbound

This paper cites Life cycle assessment – dell r740.

EcoServe: Designing Carbon-Aware AI Inference Systems Life cycle assessment – dell r740

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.600698Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.600698Z digest=sha256:680e87b3f614689f771fe98e2214e7ac356868b9f791c3684302286018857709

Observation 7edb045d-78cb-4fdb-be57-7449823055a1 · outbound

This paper cites Flashdecoding: Accelerating llm inference by paralleling token generation.

EcoServe: Designing Carbon-Aware AI Inference Systems Flashdecoding: Accelerating llm inference by paralleling token generation

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.604161Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.604161Z digest=sha256:1d8f1f77463dc824a935a1344a8fe621378ef0eb2010410cb263acb92128fe29

Observation 95fc0834-bbe9-4e35-8928-bfd93035251e · outbound

This paper cites Palm: Scaling language modeling with pathways.

EcoServe: Designing Carbon-Aware AI Inference Systems Palm: Scaling language modeling with pathways

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.881262Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.607560Z digest=sha256:9c85c1c2cdb3785b1f6b8bfe1b34fccb9cf3040232b01ed29ebaa43deed56308

Observation a2bd32e2-e792-4e93-9b7f-dbc305d67b33 · outbound

This paper cites Sharegpt: A dataset of multi-turn chat interactions with large language models.

EcoServe: Designing Carbon-Aware AI Inference Systems Sharegpt: A dataset of multi-turn chat interactions with large language models

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.870842Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.610947Z digest=sha256:99fba56ff02f3b359d26b504c07d944c0a9466bea767ca0be90a753d8975f1ae

Observation 39171c62-d14f-4745-bd0e-139e45d950ee · outbound

This paper cites Clipper: A{Low-Latency} online prediction serving system.

EcoServe: Designing Carbon-Aware AI Inference Systems Clipper: A{Low-Latency} online prediction serving system

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.860115Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.614178Z digest=sha256:66173a91c2c0f60c289b35ad3b685c7595e53ee801174f89b64446e94650caed

Observation e8dbdfb1-cae4-4f6e-a2cb-3ec77a0e593a · outbound

This paper cites FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning.

EcoServe: Designing Carbon-Aware AI Inference Systems FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.617893Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.617893Z digest=sha256:9c02126be4b898dc302f11bb51d210b605d69a62e4556b981dace03964942ee6

Observation 9adbddd2-4015-40b7-a789-66f92dcb3d06 · outbound

This paper cites Flashattention: Fast and memory-efficient exact attention with io-awareness.

EcoServe: Designing Carbon-Aware AI Inference Systems Flashattention: Fast and memory-efficient exact attention with io-awareness

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.621631Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.621631Z digest=sha256:fe30c5c4ec306217885da4d2cc575b00ff728db3507f51709385377faa8565b3

Observation a46a3bee-fd2c-4805-a4d0-e7df5eb46da6 · outbound

This paper cites Hanebutte, Rahul Khanna, and Chris- tian Le.

EcoServe: Designing Carbon-Aware AI Inference Systems Hanebutte, Rahul Khanna, and Chris- tian Le

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.843727Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.624872Z digest=sha256:a08b7257ae540d6e8ffca95033612021917c4eb6497bdd64b06e92ba45e21544

Observation 3e3f3c86-b515-456e-980c-dd31240fe1e2 · outbound

This paper cites Openblas: An optimized blas library.

EcoServe: Designing Carbon-Aware AI Inference Systems Openblas: An optimized blas library

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.833547Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.628257Z digest=sha256:31f8af6e33edbd539b876410ac9714ab8aa4a80abe71d1e76601cf73e30d2801

Observation 2b573dc4-c098-41e3-9e25-c72e20fc0613 · outbound

This paper cites Cvxpy: A python-embedded modeling language for convex optimization, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Cvxpy: A python-embedded modeling language for convex optimization, 2024

Reference 19

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.823825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.631895Z digest=sha256:35bf995b9df7a2a590e6bfaf554ea6a5c8999077ea502aa4a7833f8627c478de

Observation ab2e0b0b-f223-402b-8100-13aa032e80fe · outbound

This paper cites SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models.

EcoServe: Designing Carbon-Aware AI Inference Systems SiDA-MoE: Sparsity-Inspired Data-Aware Serving for Efficient and Scalable Large Mixture-of-Experts Models

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.635288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.635288Z digest=sha256:bd9c2b8e123d1e722dcac90e20b75f628f75b0ec34a60d2ff79ba13d2b3a6662

Observation ce0702e5-ca18-46b9-9953-46291e4cb772 · outbound

This paper cites Focal: A first-order carbon model to assess processor sustain- ability.

EcoServe: Designing Carbon-Aware AI Inference Systems Focal: A first-order carbon model to assess processor sustain- ability

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.813890Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.639319Z digest=sha256:c7963eadda482e38c6da329471c7c09bfa87302789b2a72a3021b5edf06cd864

Observation e6544a4e-09c1-42c3-9cda-bafa56a25dae · outbound

This paper cites 72-hour hourly map.

EcoServe: Designing Carbon-Aware AI Inference Systems 72-hour hourly map

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.802522Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.642707Z digest=sha256:b37f052a2161757268680ae4d2cf1d6fae880c82742a916866085a1a60740b81

Observation f2242299-863c-4b8f-b325-9094d10aaffa · outbound

This paper cites LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models.

EcoServe: Designing Carbon-Aware AI Inference Systems LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Models

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.646240Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.646240Z digest=sha256:cabac852046804949a012494cec90fa059be3545f0b0a9fce3b1629d2dc01244

Observation adb58592-0801-43ad-b21b-0ea8cd9737ce · outbound

This paper cites Mobius: Fine tuning large-scale models on commodity gpu servers.

EcoServe: Designing Carbon-Aware AI Inference Systems Mobius: Fine tuning large-scale models on commodity gpu servers

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.792093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.649544Z digest=sha256:f787f8866e3ceca2024192ca93fd80111d101ffe3115a49428138b335bf751b1

Observation 73aa6d10-915c-42ec-a706-a0033c33c2f0 · outbound

This paper cites Garcia Bardon, P.

EcoServe: Designing Carbon-Aware AI Inference Systems Garcia Bardon, P

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.781246Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.652459Z digest=sha256:8d7bfbca8eace780dbb1dc45ea8732520fd987499a3f4c46a792acc6f6f703ff

Observation 067bb4a1-6eae-4193-a57f-111198d45674 · outbound

This paper cites Llama.cpp: Inference of llama models in pure c/c++.

EcoServe: Designing Carbon-Aware AI Inference Systems Llama.cpp: Inference of llama models in pure c/c++

Reference 26

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.771087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.655462Z digest=sha256:e62ae3992ad104fd2080e10a2002b44a0a31ba9de3103fd7b752ae877f7581c1

Observation cd79462a-24d6-49cd-a076-e2151a0b4ca9 · outbound

This paper cites Gemma.cpp: Efficient inference for large language models.

EcoServe: Designing Carbon-Aware AI Inference Systems Gemma.cpp: Efficient inference for large language models

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.760539Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.658759Z digest=sha256:aaeec2af2cb03ccaf556f7e0175d0531435ff2678b70c9b73952294850be1995

Observation fde478b0-776f-4412-a3d8-f1815186f09e · outbound

This paper cites Google sustainability report, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Google sustainability report, 2024

Reference 28

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.750135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.661698Z digest=sha256:748d71490cd90cb422b19db6e24b990e5fa11d67ec408af59dc3b6db15be0ed8

Observation 5f6b608b-05ca-4a69-9909-3c2256aa59ec · outbound

This paper cites Mélange: Cost efficient large language model serving by exploiting gpu heterogeneity, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Mélange: Cost efficient large language model serving by exploiting gpu heterogeneity, 2024

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.739587Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.664649Z digest=sha256:51eb59cca9b54136f080e593674d0e015b1106c59fc283754f6d4687d289c338

Observation 00f4c459-a11b-4644-9d74-10e6b42f9d7f · outbound

This paper cites Serving{DNNs} like clockwork: Performance predictability from the bottom up.

EcoServe: Designing Carbon-Aware AI Inference Systems Serving{DNNs} like clockwork: Performance predictability from the bottom up

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.729259Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.667577Z digest=sha256:ae209c26af92be2ac46ace4f15d10e93bb4228c31268b498be62f4fef1293d6b

Observation f8f17fb8-5cdf-40c6-b16e-7c8f868b1976 · outbound

This paper cites Lee, David Brooks, and Carole-Jean Wu.

EcoServe: Designing Carbon-Aware AI Inference Systems Lee, David Brooks, and Carole-Jean Wu

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.718440Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.670252Z digest=sha256:ae0d60349fa29f5e1f79705baa1bf35a36df02e5858b744413dc3fdfebd26eff

Observation 36b74b4d-7542-4ff4-952c-cc0ff41b5fc2 · outbound

This paper cites Chasing carbon: The elusive environmental footprint of computing.

EcoServe: Designing Carbon-Aware AI Inference Systems Chasing carbon: The elusive environmental footprint of computing

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.707146Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.673124Z digest=sha256:0a6d3c9e8876fb5383ae78d24d2618637d891da53dc8186bf8f3a49338632123

Observation 610edb82-c357-4d9a-9513-9c86109dd002 · outbound

This paper cites FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous Pipelines.

EcoServe: Designing Carbon-Aware AI Inference Systems FastDecode: High-Throughput GPU-Efficient LLM Serving using Heterogeneous Pipelines

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.676302Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.676302Z digest=sha256:fc47ab7c4c622d90f79e9fdc96fd5bc5b8c37248cdb68c0f6c3b008f0e181bd1

Observation 751b4ea8-832f-4923-9adf-d3417765cea8 · outbound

This paper cites FlashDecoding++: Faster Large Language Model Inference on GPUs.

EcoServe: Designing Carbon-Aware AI Inference Systems FlashDecoding++: Faster Large Language Model Inference on GPUs

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.679828Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.679828Z digest=sha256:80283ccca8396bfd176046bf21976d3721820c45ed28c42029f56f7cbcb2c03f

Observation 0025a02f-5df8-4de8-9066-4e569bdd6a9d · outbound

This paper cites Towards MoE Deployment: Mitigating Inefficiencies in Mixture-of-Expert (MoE) Inference.

EcoServe: Designing Carbon-Aware AI Inference Systems Towards MoE Deployment: Mitigating Inefficiencies in Mixture-of-Expert (MoE) Inference

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.683723Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.683723Z digest=sha256:17f1b722ee44e1788a1142f4e10f2fec3b4dd5adcdf415fcd22b1d40af0f4da8

Observation fbe5a570-dd2a-448a-b83b-1ae4e935f5ec · outbound

This paper cites Advancing Environmental Sustainability in Data Centers via Carbon Depreciation Models.

EcoServe: Designing Carbon-Aware AI Inference Systems Advancing Environmental Sustainability in Data Centers via Carbon Depreciation Models

Reference 36

Resolution
metadata mismatch
local_arxiv, observed 2026-08-08T20:31:36.225397Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.687251Z digest=sha256:2e3c5a58709d5c6cf61c2d5846538226ec3ea88ef3309f3a91d9abe8a4a6480b

Observation b9597ea9-18a4-4ec5-b006-86d5a145ddc2 · outbound

This paper cites Neo: Saving gpu memory crisis with cpu offloading for online llm inference, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Neo: Saving gpu memory crisis with cpu offloading for online llm inference, 2024

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.696254Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.690723Z digest=sha256:5fbbf314b4bf768ae272bf8e6ea59e991d5fa5674ac764c3791fc1507df140bc

Observation 5776d0c1-1295-4286-a96e-2d956b559ecb · outbound

This paper cites an unresolved cited work.

EcoServe: Designing Carbon-Aware AI Inference Systems Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-08T20:31:36.686179Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.693726Z digest=sha256:208eac2e1cc73e8d7513897c34b507599db34492cc47c787b1d0fd41b29e4bcb

Observation 6eda6d94-b0bf-4a8d-87fd-0bc9d75d1e12 · outbound

This paper cites Profiling a warehouse-scale computer.

EcoServe: Designing Carbon-Aware AI Inference Systems Profiling a warehouse-scale computer

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.676275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.697328Z digest=sha256:3a72358d44826d487403eafa301fec1ff4dd207e27496280623128ddad4a7d6b

Observation 40e33f3d-bfc6-475e-9e54-5f7fcd879ed8 · outbound

This paper cites Backblaze hard drive stats for q2 2021, 2021.

EcoServe: Designing Carbon-Aware AI Inference Systems Backblaze hard drive stats for q2 2021, 2021

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.665706Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.700665Z digest=sha256:1b0dfe7eb4385a5867936c6ed8d03bb7eb45f116233a05f57e1bb2ffb3096640

Observation 019e539f-2c11-4e2e-9ee7-ebebf948bffa · outbound

This paper cites SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget.

EcoServe: Designing Carbon-Aware AI Inference Systems SwapMoE: Serving Off-the-shelf MoE-based Large Language Models with Tunable Memory Budget

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.704164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.704164Z digest=sha256:5fd6486bd08cf2f460495360296bafdfdfb6e50431a50c6c8a66843f3a1d399d

Observation 295bcb9b-a876-4604-a33f-6bf74895da59 · outbound

This paper cites Gonzalez, Hao Zhang, and Ion Stoica.

EcoServe: Designing Carbon-Aware AI Inference Systems Gonzalez, Hao Zhang, and Ion Stoica

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.707748Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.707748Z digest=sha256:21bcaa8aaab07cfbce0ce9dd5bc9eda8c9a2d6c48ecc98ffb62063cca13faba5

Observation 468dabca-80cc-4328-b0bf-230cd1c1809a · outbound

This paper cites Amp: Automatically finding model parallel strategies with heterogeneity awareness.

EcoServe: Designing Carbon-Aware AI Inference Systems Amp: Automatically finding model parallel strategies with heterogeneity awareness

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.649233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.711365Z digest=sha256:d6effd28835b0141411c5162043fcf6f580289201dfa30d078ba07dce989c024

Observation a92e2b86-aa29-4a67-8967-2a0a95295477 · outbound

This paper cites In 17th USENIX Symposium on Operating Systems Design and Implementation (OSDI 23) , pages 663–679, 2023.

EcoServe: Designing Carbon-Aware AI Inference Systems In 17th USENIX Symposium on Operating Systems Design and Implementation (OSDI 23) , pages 663–679, 2023

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.639086Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.714761Z digest=sha256:698e4ab0db07398fdb3d4d0e6ace0b74fc02c127b6b9646a81fc472754e37093

Observation 8628e28a-10eb-4f35-80b7-dd3367e0d92a · outbound

This paper cites Gonzalez, and Ion Stoica.

EcoServe: Designing Carbon-Aware AI Inference Systems Gonzalez, and Ion Stoica

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.628983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.717932Z digest=sha256:edc0430cd7b2bf41169929379114307136b41ebdb22bd96701a20704af048f83

Observation 240064bb-ea63-46c5-8375-1b6fd1c28a61 · outbound

This paper cites New insight into the aging induced retention time degraded of advanced dram technology.

EcoServe: Designing Carbon-Aware AI Inference Systems New insight into the aging induced retention time degraded of advanced dram technology

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.618564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.721410Z digest=sha256:b0ada0692870558b09a3a1eb3d70815b8f7b13f76ec70faac4ac7a341682032c

Observation 07360025-7e79-45e6-b153-e9bbcfe121c3 · outbound

This paper cites Cachegen: Kv cache compression and streaming for fast large language model serving.

EcoServe: Designing Carbon-Aware AI Inference Systems Cachegen: Kv cache compression and streaming for fast large language model serving

Reference 47

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.608388Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.724681Z digest=sha256:33e9e9c25608eb29f7b478b56393d2834d73f1a8b718849182e74e76ac8dac1d

Observation 9e9ab4bf-a637-421e-990e-bdd2d023e5a3 · outbound

This paper cites Longbench: A bilingual long-context benchmark for large language models.

EcoServe: Designing Carbon-Aware AI Inference Systems Longbench: A bilingual long-context benchmark for large language models

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.598434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.727931Z digest=sha256:56b075077302f2de06858baa7a91b5f0cdf33e409d87db037e77f16c6c3639a6

Observation e344bcf9-7758-42e3-90f1-0144a1f91a3f · outbound

This paper cites Deja vu: Contextual sparsity for efficient LLMs at inference time.

EcoServe: Designing Carbon-Aware AI Inference Systems Deja vu: Contextual sparsity for efficient LLMs at inference time

Reference 49

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.588828Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.731177Z digest=sha256:93f784a380a8b0dc8b923a43b3967d98d8c54f26a655653a424ceec3bd9678b6

Observation 1eef6046-f17d-4944-96b7-23e7c6643792 · outbound

This paper cites Power hungry processing: Watts driving the cost of ai deployment? In The 2024 ACM Conference on Fairness, Accountability, and Transparency, pages 85–99, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Power hungry processing: Watts driving the cost of ai deployment? In The 2024 ACM Conference on Fairness, Accountability, and Transparency, pages 85–99, 2024

Reference 50

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.579223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.734673Z digest=sha256:49b512c45d80228e35da9055badd188b3bbbe1cb85a8f33200402548ee462bb0

Observation e90f9fba-9644-48d7-95b4-e75fe7430ea5 · outbound

This paper cites Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow.

EcoServe: Designing Carbon-Aware AI Inference Systems Helix: Serving Large Language Models over Heterogeneous GPUs and Network via Max-Flow

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.738204Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.738204Z digest=sha256:dc9803d9e4e30d7e3a0f05bbe15f041e2e7d0c5fe8a9a54d067ed7a304c4ae7f

Observation 86ed8b63-980f-4fcd-8758-39f0b6f20705 · outbound

This paper cites A large-scale study of flash memory failures in the field.

EcoServe: Designing Carbon-Aware AI Inference Systems A large-scale study of flash memory failures in the field

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.568895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.741655Z digest=sha256:cc54b2179b8339dec0221efcdb2c7f6d3ba6ee7f8e7f7ea64d2c9014379ae835

Observation 2c5958a6-6bfd-415b-b8a3-32a6ef6603f0 · outbound

This paper cites Microsoft sustainability report, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Microsoft sustainability report, 2024

Reference 53

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.558568Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.744784Z digest=sha256:42c4aa2eea1b4517424a34f877eab3ab4ecb228f6e2cc958528141a19f871349

Observation 2e173302-8bdf-483c-aeeb-ed9988967a96 · outbound

This paper cites Azure public dataset.

EcoServe: Designing Carbon-Aware AI Inference Systems Azure public dataset

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.548906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.748127Z digest=sha256:4803cb6b20c11ba539f5ca4275d91a96ac8ab357a27f74e51c6cb840e048460b

Observation 326b835c-122a-4966-9fe3-68fe2b7a08a0 · outbound

This paper cites Roofline Performance Model - NERSC Documentation — docs.nersc.gov.

EcoServe: Designing Carbon-Aware AI Inference Systems Roofline Performance Model - NERSC Documentation — docs.nersc.gov

Reference 55

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.538998Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.751493Z digest=sha256:ade012e94f088d54d803e291d53238e199dc03665548797c1163d7968847bf1a

Observation 766bd0cc-675a-44ba-8f72-9d96cc0dfba9 · outbound

This paper cites Nvml api reference, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Nvml api reference, 2024

Reference 56

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.529052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.754685Z digest=sha256:69c06be821e5186bcc2f7fe7ab207ee12b5cf1d037a8ef78a3520fa589f8d6fa

Observation 83cf973d-a198-4d38-98e2-1542321fb3be · outbound

This paper cites Deep learning performance guide: Matrix multiplication (gemm).

EcoServe: Designing Carbon-Aware AI Inference Systems Deep learning performance guide: Matrix multiplication (gemm)

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.518833Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.758064Z digest=sha256:a7635e6bbe2e0b696d3553eb2e60232d4ce721b061dc16cec95ed258986ee6cf

Observation 8b74c7f6-5b99-4fbf-8864-1449e822c105 · outbound

This paper cites onednn: Deep neural network library.

EcoServe: Designing Carbon-Aware AI Inference Systems onednn: Deep neural network library

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.508252Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.761455Z digest=sha256:9a49c8bc16314331886b13f97c76f8afa7ac34f677426cee267f8fe23e9572c0

Observation 940d4e1a-e674-4ce5-98c6-13fe7583d90b · outbound

This paper cites InstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference.

EcoServe: Designing Carbon-Aware AI Inference Systems InstInfer: In-Storage Attention Offloading for Cost-Effective Long-Context LLM Inference

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.764869Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.764869Z digest=sha256:ac79754e3af174291b7be4f96cf185cc4e1b24de823e31a3c211658146ddaf87

Observation 31dba348-38de-492c-90d9-29648527d876 · outbound

This paper cites Splitwise: Efficient generative LLM inference using phase splitting.

EcoServe: Designing Carbon-Aware AI Inference Systems Splitwise: Efficient generative LLM inference using phase splitting

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.768398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.768398Z digest=sha256:eeb4f9c31105e47d0b6d32d49dcf34e914e3d45e9b8fd01e6bba70752df0ef45

Observation 9ab383a2-8481-4eed-8da1-07fc6111e0be · outbound

This paper cites an unresolved cited work.

EcoServe: Designing Carbon-Aware AI Inference Systems Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-08T20:31:36.498296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.771591Z digest=sha256:f05fd4d3c7da781e2d568c5d2bfe8923e6f3e10c6cf2621ce4254cd948913d8d

Observation 89ba1b1c-7f17-4e2c-a4ef-7fc51a53acba · outbound

This paper cites Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters.

EcoServe: Designing Carbon-Aware AI Inference Systems Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters

Reference 62

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.488537Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.774470Z digest=sha256:0dd9e50575459a04ce58c26fcd04539f71cba27da2aa63d133edffe78b7cb792

Observation 7448a11e-d57d-4c2d-b208-fb77891febff · outbound

This paper cites Xnnpack: High-performance neural network inference frame- work.

EcoServe: Designing Carbon-Aware AI Inference Systems Xnnpack: High-performance neural network inference frame- work

Reference 63

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.478285Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.777723Z digest=sha256:0e006878d6d756b19692259a314a38da13d0ff2f01e174a76e3cf8121f6f23e0

Observation 326522fc-a0a5-4117-8891-c16707078f12 · outbound

This paper cites {INFaaS}: Automated model-less inference serving.

EcoServe: Designing Carbon-Aware AI Inference Systems {INFaaS}: Automated model-less inference serving

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.468500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.780817Z digest=sha256:31dc4bc2355b75a9dda41899c2db5fafbc1a22d3457bc287dff8859e83b127c0

Observation 1497fdb9-8396-45d2-a854-6379701e9b70 · outbound

This paper cites BLOOM: A 176B-Parameter Open-Access Multilingual Language Model.

EcoServe: Designing Carbon-Aware AI Inference Systems BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.783763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.783763Z digest=sha256:9da179c7a7976f16a35a026b44bb6410ab27fcd13ee36847717e69b340f3fc20

Observation 3d29ce01-5d38-4f99-aed5-f4e5d6c8ce6a · outbound

This paper cites Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends.

EcoServe: Designing Carbon-Aware AI Inference Systems Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.787230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.787230Z digest=sha256:d07743fb82bda2c90ccb6f9be26c737afdad648d0be330910a103f732ae69f2f

Observation 46c1cab4-3d80-42a1-8296-c12421d4113c · outbound

This paper cites Data center lifecycle co2e calculator, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Data center lifecycle co2e calculator, 2024

Reference 67

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.458228Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.791094Z digest=sha256:02fe97c4eeb0766d06aee6dd03f36fed5410e5585f96372bc823301c52059b4e

Observation aa6744af-cfdd-4370-a6a3-b54261dee034 · outbound

This paper cites an unresolved cited work.

EcoServe: Designing Carbon-Aware AI Inference Systems Unresolved cited work

Reference 68

Resolution
unresolved
raw_fallback, observed 2026-08-08T20:31:36.448776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.794338Z digest=sha256:49ef8af659e9eea11a631e2cb6d48854a92a3f144d793aa980f8439959b77bcf

Observation 2ddbbc4e-a50a-4c94-8f22-baab846210a6 · outbound

This paper cites Flash reliability in production: The expected and the unexpected.

EcoServe: Designing Carbon-Aware AI Inference Systems Flash reliability in production: The expected and the unexpected

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.439324Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.797459Z digest=sha256:85e0a7237911915a22dc7d330c8f88677210ef63f91bd9a591286efd8922f4cf

Observation d44a77b1-4324-4a47-a29a-fb4912d300d1 · outbound

This paper cites FlexGen: High- Throughput Generative Inference of Large Language Models with a Single GPU.

EcoServe: Designing Carbon-Aware AI Inference Systems FlexGen: High- Throughput Generative Inference of Large Language Models with a Single GPU

Reference 70

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.429312Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.800638Z digest=sha256:2749ca47c1c6117ed31b36d2de0875b172c7b7358e93ef0446d6eea97ed749f6

Observation f8872713-1d1d-4a1c-9467-526027e0dc18 · outbound

This paper cites Lifetime memory reliability data from the field, 2017.

EcoServe: Designing Carbon-Aware AI Inference Systems Lifetime memory reliability data from the field, 2017

Reference 71

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.418678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.803889Z digest=sha256:653e84dc393e70ad921d0f14ecea8385c0dbd05551d7fb3743836bbc1ce8f8e8

Observation c8978d1f-3d8f-4ff8-b6ed-06c6ef73bddf · outbound

This paper cites PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU.

EcoServe: Designing Carbon-Aware AI Inference Systems PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU

Reference 72

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.806995Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.806995Z digest=sha256:982568c96a814b8bffcd4c5fe8f8b68ea0387efa0b5bcaa023e788a913b8cfd0

Observation 3f343e95-64d1-48d3-abdf-eb73d1a31f69 · outbound

This paper cites Dynamollm: Designing llm inference clusters for performance and energy effi- ciency.

EcoServe: Designing Carbon-Aware AI Inference Systems Dynamollm: Designing llm inference clusters for performance and energy effi- ciency

Reference 73

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.810526Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.810526Z digest=sha256:c12f53b9ec1eabde69ae246caa4318fe5956e8cb13f5f1bea6ac788484ac300f

Observation c0a4efb5-8304-4941-a5bb-21f0f7ed3305 · outbound

This paper cites Summarizing CPU and GPU Design Trends with Product Data.

EcoServe: Designing Carbon-Aware AI Inference Systems Summarizing CPU and GPU Design Trends with Product Data

Reference 74

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.813779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.813779Z digest=sha256:aa6607ff7c7c0f9206205f0f9d4b28fd6a17bb4528f4115ffefcf085ab3db69e

Observation cd438645-4cef-474d-9dd5-6d29c42177f0 · outbound

This paper cites an unresolved cited work.

EcoServe: Designing Carbon-Aware AI Inference Systems Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-08T20:31:36.408125Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.817527Z digest=sha256:a2723314efcf3a745d14df4caa1398a1351c487298790564a0aad957704313ad

Observation ae9d4eb2-618a-49c5-af8f-c318fbc6f526 · outbound

This paper cites Accelerating self-attentions for llm serving with flashinfer, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Accelerating self-attentions for llm serving with flashinfer, 2024

Reference 76

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.396403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.820950Z digest=sha256:6457b00a2ca112c6d59fae0b3449b82b3c0328b0d07eb035dc1cacdbf16dcb32

Observation 01203ee5-511f-4a7b-86c4-4be4f6576701 · outbound

This paper cites Micron 1𝛼 dram technology, Nov 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems Micron 1𝛼 dram technology, Nov 2024

Reference 77

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.385251Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.824208Z digest=sha256:127f1036ef8e6a4ca2d56a1e51add87135e5758708a4cb8b6df6ffdcb8f12537

Observation 51ea54c0-3b57-44f7-9511-bfd34df8ddcd · outbound

This paper cites MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI.

EcoServe: Designing Carbon-Aware AI Inference Systems MLPerf Power: Benchmarking the Energy Efficiency of Machine Learning Systems from Microwatts to Megawatts for Sustainable AI

Reference 78

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.827403Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.827403Z digest=sha256:2bf28abb126e941842e4d0fe6b3228308241d6371c7db3f3637d08b40045581a

Observation d3c9782a-5cbc-4116-abe1-c1341b4f5def · outbound

This paper cites vllm v0.6.0: 2.7x throughput improvement and 5x latency reduction, September 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems vllm v0.6.0: 2.7x throughput improvement and 5x latency reduction, September 2024

Reference 79

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.374458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.831195Z digest=sha256:bd82d78fcc638164cd8f747f17cac868d0a93a9f821b577fb58772c484508c97

Observation 02341d40-c7d6-432c-a6b2-b55baab3415e · outbound

This paper cites Designing cloud servers for lower carbon.

EcoServe: Designing Carbon-Aware AI Inference Systems Designing cloud servers for lower carbon

Reference 80

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.364131Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.834787Z digest=sha256:232ada28b4eea62cd1b00bdec72ca3cf2d3cf7510ef94d079028c54a2d34beea

Observation e763be3d-bea8-49f9-bcc6-7c81d6a8f9d7 · outbound

This paper cites Coverage map.

EcoServe: Designing Carbon-Aware AI Inference Systems Coverage map

Reference 81

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.353608Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.838207Z digest=sha256:60e84d9304105a91110e16c3972b32820628980d63c110aca43d37a2768f8b64

Observation ec1cc89c-0474-4ab7-b452-5cd043f29342 · outbound

This paper cites Roofline: an insightful visual performance model for multicore architectures.

EcoServe: Designing Carbon-Aware AI Inference Systems Roofline: an insightful visual performance model for multicore architectures

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.841692Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.841692Z digest=sha256:ad27eb624246e2a50131554515fa5ee34a3ab789758655c2826f4bec8480f309

Observation 212090d2-98a2-4f54-ad25-186d776a6d53 · outbound

This paper cites TwinPilots: A New Computing Paradigm for GPU-CPU Parallel LLM Inference.

EcoServe: Designing Carbon-Aware AI Inference Systems TwinPilots: A New Computing Paradigm for GPU-CPU Parallel LLM Inference

Reference 83

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.336235Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.845405Z digest=sha256:c30ccedaa00128f24d162639c7a0ba7ad1877e5990e7b5daa55eb251c3552ccb

Observation b8426116-bd26-4bef-a19e-3fb5af3b2c1f · outbound

This paper cites Decentralized training of foundation models in heterogeneous environments, 2022.

EcoServe: Designing Carbon-Aware AI Inference Systems Decentralized training of foundation models in heterogeneous environments, 2022

Reference 84

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.326026Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.848656Z digest=sha256:76a2085d200b8e26fba7022f3b67ef27055317277478b52f902c8d268b827938

Observation 2164ac5a-ad2a-4c46-afae-d0fb53ae3d2d · outbound

This paper cites LLM Inference Unveiled: Survey and Roofline Model Insights.

EcoServe: Designing Carbon-Aware AI Inference Systems LLM Inference Unveiled: Survey and Roofline Model Insights

Reference 85

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.852245Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.852245Z digest=sha256:511cdcc93f86640c8ca118c15befc19b8a1fd0f2f33837966aa71b2ff85c0e68

Observation 68fc2333-0dd1-4f00-9df2-3087818363af · outbound

This paper cites In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) , pages 787–808, 2023.

EcoServe: Designing Carbon-Aware AI Inference Systems In 20th USENIX Symposium on Networked Systems Design and Implementation (NSDI 23) , pages 787–808, 2023

Reference 86

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.315196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.855955Z digest=sha256:5e07276aeea282377363fe081e558ecf8552c7cf54f78dfad847b2b25560f451

Observation 56e64a44-7d99-4188-a2f3-9c4907af8489 · outbound

This paper cites H2o: Heavy- hitter oracle for efficient generative inference of large language models.Advances in Neural Information Processing Systems , 36, 2024.

EcoServe: Designing Carbon-Aware AI Inference Systems H2o: Heavy- hitter oracle for efficient generative inference of large language models.Advances in Neural Information Processing Systems , 36, 2024

Reference 87

Resolution
verified fuzzy
raw_fallback, observed 2026-08-08T20:31:36.304471Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-08T20:31:35.859556Z digest=sha256:1f2912e1a2a68b6d55ae1e98e3b8acecf7bec2b1dd7c0626f643882322e2124e

Observation d679780a-a501-4a46-9f38-09526025853d · outbound

This paper cites HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices.

EcoServe: Designing Carbon-Aware AI Inference Systems HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices

Reference 88

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.863029Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.863029Z digest=sha256:d0f26a7cff41d14c75d1abe73e0617e6f8c14e4aefa677305d40d29b62a492ee

Observation 7934aee2-db3f-49ce-9647-c7611e41c361 · outbound

This paper cites SGLang: Efficient Execution of Structured Language Model Programs.

EcoServe: Designing Carbon-Aware AI Inference Systems SGLang: Efficient Execution of Structured Language Model Programs

Reference 89

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.866624Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.866624Z digest=sha256:9ab700f8317a9b4c3df76c9cc65f0a663fef7f94ad03d19ba06ca2a88d232a76

Observation 3c1328f7-20fd-4acd-9987-3864e5efbb80 · outbound

This paper cites DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving.

EcoServe: Designing Carbon-Aware AI Inference Systems DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving

Reference 90

Resolution
unresolved
no resolver link, observed 2026-08-08T20:31:35.870375Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-08T20:31:35.870375Z digest=sha256:18b01888369a75b23049c707f7acb928730d2ada7d571e7b9491501759cc27bc

Pith citing papers

Observation a221b0bb-7cbd-4dd3-a0c6-6230172bd29c · inbound

Cache Your Prompt When It's Green: Carbon-Aware Caching for Large Language Model Serving cites this paper.

Cache Your Prompt When It's Green: Carbon-Aware Caching for Large Language Model Serving EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 40

Resolution
verified exact
arxiv_id, observed 2026-05-19T13:17:18.481714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-19T13:14:26.628447Z digest=sha256:9fd843e8d36ff07706ecd6648389e1130eeb39fdd6d43c08142a563c54a2d214

Observation b30c03c7-b037-462b-9eb6-cf84d54574c4 · inbound

A Vertical Approach to Designing and Managing Sustainable Heterogeneous Edge Data Centers cites this paper.

A Vertical Approach to Designing and Managing Sustainable Heterogeneous Edge Data Centers EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-07T11:39:51.789183Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T11:39:51.789183Z digest=sha256:76f83fb255e73b61daad6b24f2feea78128ff5a02c72d116050d8dbf6fe1d63a

Observation 82f19ffe-d45d-4e31-85bd-68f6e37ec33f · inbound

Quantifying the Energy Consumption and Carbon Emissions of LLM Inference via Simulations cites this paper.

Quantifying the Energy Consumption and Carbon Emissions of LLM Inference via Simulations EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-06T17:14:19.340515Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T17:14:19.340515Z digest=sha256:8d6523cfcafae56ad197a560711de0606874ed89eb401753b12f532ad46e43ab

Observation 4d059cc4-2e94-4531-99cd-cdd635e7bd5a · inbound

Energy-Aware Routing to Large Reasoning Models cites this paper.

Energy-Aware Routing to Large Reasoning Models EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 13

Resolution
verified exact
arxiv_id, observed 2026-05-16T20:33:24.067155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-16T20:32:49.030941Z digest=sha256:7d0a875de8e41340170f0ba99aee587b7880b40f6c39cb0e3f5b22441b13e574

Observation 17772232-0efe-498c-bbca-73b5f9903dc5 · inbound

Determinism-Preserving GPU Spatial Sharing with Vitamin-E cites this paper.

Determinism-Preserving GPU Spatial Sharing with Vitamin-E EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 41

Resolution
verified exact
arxiv_id, observed 2026-05-15T10:35:27.451461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-15T10:34:16.525398Z digest=sha256:2b2b430c6903123ad54331128bd5951213621d05cbb7dfb082ad34c0ece22ac9

Observation 4b3fa359-f733-408f-a592-3a99a681350a · inbound

KAIROS: Stateful, Context-Aware Power-Efficient Agentic Inference Serving cites this paper.

KAIROS: Stateful, Context-Aware Power-Efficient Agentic Inference Serving EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 35

Resolution
metadata mismatch
arxiv_id, observed 2026-05-10T07:01:49.268219Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-10T06:58:36.525442Z digest=sha256:238e2ecabc2b1cd4506b2792f6d0a419c611002e9cd3aa373134bc0302a90851

Observation 56a3eec0-b810-486d-a4d0-121555eb1b26 · inbound

AI Inference as Relocatable Electricity Demand: A Latency-Constrained Energy-Geography Framework cites this paper.

AI Inference as Relocatable Electricity Demand: A Latency-Constrained Energy-Geography Framework EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 2

Resolution
verified exact
arxiv_id, observed 2026-05-12T10:16:27.539416Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-07T06:58:01.164783Z digest=sha256:dfcee3ad20b64e39acfd2ba0c8e5b49e891bebc79b95b2e2003d18b51cbcc488

Observation 3a610215-e230-4df3-94fb-89a2abfccace · inbound

GAR: Carbon-Aware Routing for LLM Inference via Constrained Optimization cites this paper.

GAR: Carbon-Aware Routing for LLM Inference via Constrained Optimization EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 10

Resolution
verified exact
arxiv_id, observed 2026-05-13T01:42:03.824803Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-05-13T01:39:49.694445Z digest=sha256:cb95eb990201e77c17a06b7bbdf69f3c260dd76bfe50988a3733b96f4d8d5949

Observation 7add184a-0b97-44e2-a689-9a212e1b5ab1 · inbound

Greening AI Inference with Accuracy and Latency-aware User Incentives cites this paper.

Greening AI Inference with Accuracy and Latency-aware User Incentives EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 7

Resolution
verified exact
arxiv_id, observed 2026-06-29T19:03:51.120052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-29T19:03:19.681396Z digest=sha256:a8e112423dd2e52d2a972c5cd360f2f8ac5830cb260f1f48985f75938f81b832

Observation 0e97ce1d-504d-45a5-a563-baa7ac002d77 · inbound

Evaluation of ML Resource Utilization Requires Model Life Cycle Assessment cites this paper.

Evaluation of ML Resource Utilization Requires Model Life Cycle Assessment EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 67

Resolution
metadata mismatch
arxiv_id, observed 2026-07-01T21:06:14.616536Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-06-28T17:27:19.467192Z digest=sha256:c8290a9efbf180b38b05b2135da85ec752ae217f9fc96ef93ad3606a25970079

Observation 1e29a8b2-ef1e-477e-bdff-e3c98be45dd3 · inbound

From Tokens to Energy Flexibility: Quantization-Enabled Demand Response for Data Centers with LLM Inference Workloads cites this paper.

From Tokens to Energy Flexibility: Quantization-Enabled Demand Response for Data Centers with LLM Inference Workloads EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 29

Resolution
verified exact
arxiv_id, observed 2026-07-04T02:29:23.912557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-06-26T19:40:57.370452Z digest=sha256:f217052b537475f98f87316d96f7876cc43b9576b2a39f860ea34b2f71e9dac9

Observation 3df9d850-6d9c-429a-bdf5-608747014a6b · inbound

Enabling Spatially Fine-Grained DVFS in Neural Processing Units for Energy-Efficient LLM Serving cites this paper.

Enabling Spatially Fine-Grained DVFS in Neural Processing Units for Energy-Efficient LLM Serving EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-01T20:57:21.540286Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T20:57:21.540286Z digest=sha256:a585d838fb037028461459747bde01e2ea39dbc641d94a0f61ba2cd892071c7f

Observation c58e9d3b-f534-4daf-afa9-1372a189abb5 · inbound

Routing LLM Inference to the Cleanest Grid in Real Time cites this paper.

Routing LLM Inference to the Cleanest Grid in Real Time EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T13:00:30.958563Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:00:30.958563Z digest=sha256:183a67659aa6e0e1c782d3123045250580461298dab5ea5cf2ef58fe42535316

Observation bb7ba158-1ba9-450c-8a7b-44929659aa1d · inbound

Routing LLM Inference to the Cleanest Grid in Real Time cites this paper.

Routing LLM Inference to the Cleanest Grid in Real Time EcoServe: Designing Carbon-Aware AI Inference Systems

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-07T13:00:31.049555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T13:00:31.049555Z digest=sha256:9c042523d362627023a359075cd7ea0f68766418259f3f9ad44493ad6fa6042b