Life-Cycle Emissions of AI Hardware: A Cradle-To-Grave Approach and Generational Trends
pith:3LTU3ED4open to challenge →
read the original abstract
Specialized hardware accelerators aid the rapid advancement of artificial intelligence (AI), and their efficiency impacts AI's environmental sustainability. This study presents the first publication of a comprehensive AI accelerator life-cycle assessment (LCA) of greenhouse gas emissions, including the first publication of manufacturing emissions of an AI accelerator. Our analysis of five Tensor Processing Units (TPUs) encompasses all stages of the hardware lifespan - from raw material extraction, manufacturing, and disposal, to energy consumption during development, deployment, and serving of AI models. Using first-party data, it offers the most comprehensive evaluation to date of AI hardware's environmental impact. We include detailed descriptions of our LCA to act as a tutorial, road map, and inspiration for other computer engineers to perform similar LCAs to help us all understand the environmental impacts of our chips and of AI. A byproduct of this study is the new metric compute carbon intensity (CCI) that is helpful in evaluating AI hardware sustainability and in estimating the carbon footprint of training and inference. This study shows that CCI improves 3x from TPU v4i to TPU v6e. Moreover, while this paper's focus is on hardware, software advancements leverage and amplify these gains.
This paper has not been read by Pith yet.
Forward citations
Cited by 8 Pith papers
-
Memory as a Wasting Asset: Pricing Flash Endurance for Embodied Agents, and the Limits of Doing So
Flash endurance is priced via shadow price η making placement cost-optimal for any sign of value-write correlation χ, with χ positive only in recurrent long-horizon manipulation and the budget binding only on low-endu...
-
Evaluating Computing Platforms for Sustainability: A Comparative Analysis of FPGAs against ASICs, GPUs, and CPUs
GreenFPGA modeling indicates FPGAs can achieve lower total carbon footprints than ASICs, GPUs, and CPUs for low-volume applications with frequently changing and diverse workloads under iso-performance assumptions.
-
The data heat island effect: quantifying the impact of AI data centers in a warming world
AI data centers raise surrounding land surface temperatures by 2°C on average, potentially affecting over 340 million people via local climate changes.
-
All LCA models are wrong. Are some of them useful? Towards open computational LCA in ICT
ICT LCAs form error-prone model systems requiring explicit dependency graphs and open versioned repositories for credible assessments.
-
Evaluation of ML Resource Utilization Requires Model Life Cycle Assessment
The paper calls for life cycle assessment to capture embodied hardware costs and full pipeline operational costs in AI development and deployment.
-
From Cradle to Cloud: A Life Cycle Review of AI's Environmental Footprint
A review of AI sustainability studies finds inconsistent life cycle definitions and predominant reliance on coarse CO2e proxies, with limited coverage of water, materials, and multi-impact assessments.
-
Taxing Artificial Intelligence
Taxation of AI activities can correct externalities, redistribute costs and gains, and support regulation, though instruments like corporate taxes, consumption taxes, and excises vary in feasibility, measurement chall...
-
LLM Harms: A Taxonomy and Discussion
This paper proposes a taxonomy of LLM harms in five categories and suggests mitigation strategies plus a dynamic auditing system for responsible development.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.