Pith. sign in

REVIEW 4 cited by

Trends in AI Supercomputers

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2504.16026 v2 pith:YE64KHJZ submitted 2025-04-22 cs.CY cs.AI

classification cs.CYcs.AI
keywords supercomputerscosthardwareperformancepowertrendsneedssupercomputer
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

Frontier AI development relies on powerful AI supercomputers, yet analysis of these systems is limited. We create a dataset of 500 AI supercomputers from 2019 to 2025 and analyze key trends in performance, power needs, hardware cost, ownership, and global distribution. We find that the computational performance of AI supercomputers has doubled every nine months, while hardware acquisition cost and power needs both doubled every year. The leading system in March 2025, xAI's Colossus, used 200,000 AI chips, had a hardware cost of \$7B, and required 300 MW of power, as much as 250,000 households. As AI supercomputers evolved from tools for science to industrial machines, companies rapidly expanded their share of total AI supercomputer performance, while the share of governments and academia diminished. Globally, the United States accounts for about 75% of total performance in our dataset, with China in second place at 15%. If the observed trends continue, the leading AI supercomputer in 2030 will achieve $2\times10^{22}$ 16-bit FLOP/s, use two million AI chips, have a hardware cost of \$200 billion, and require 9 GW of power. Our analysis provides visibility into the AI supercomputer landscape, allowing policymakers to assess key AI trends like resource needs, ownership, and national competitiveness.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. New Number Formats for FFT IP Cores in Optical OFDM Transceivers

    cs.AR 2026-07 conditional novelty 6.0 of 10

    Custom 11-12 bit floating-point FFT cores in a 128 Gbit/s optical OFDM transceiver match 16-bit fixed-point accuracy at lower power and area for moderate QAM orders, with degradation at 4096-QAM.

  2. Technical Requirements for Halting Dangerous AI Activities

    cs.AI 2025-07 conditional novelty 5.0 of 10

    A taxonomy of compute-centric technical interventions, graded by readiness and mapped to five AI governance plans, argues that halting dangerous AI requires substantial control over AI compute.

  3. Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape

    cs.CY 2025-07 conditional novelty 5.0 of 10

    A policy analysis distinguishing distributed and decentralised AI training, arguing decentralised training may erode detectability and shutdownability while compute controls remain relevant.

  4. TriADA: Massively Parallel Trilinear Matrix-by-Tensor Multiply-Add Algorithm and Device Architecture for the Acceleration of 3D Discrete Transformations

    cs.DC 2025-06 conditional novelty 4.0 of 10

    The paper proposes a triple-stage outer-product algorithm and an isomorphic 3D mesh architecture that computes separable 3D orthogonal transforms in N1+N2+N3 time steps.

Pith tools