Bit Market · Sourced milestones

Racks and Rows

SI clusters, as a record of progress: how many accelerators one cluster holds, the flash and storage behind them, and the gigawatt campuses still on paper. 17 milestones from 2020 to 2026, each linked to the release it comes from.

20202025220000Colossus 1 at 220k GPUs, 5/2026

Chart of accelerators, storage, memory and compute in one SI cluster by year

Accelerators in one cluster went from 10,000 in 2020 to over 220,000 in 2026

Storage in one cluster went from 231,000TB in 2022 to over 500,000TB in 2025

Measure
Lanes
Lane

Accelerators runs from 6080 (2022) to 500000 (2025) across 8 clusters. A planned campus is drawn hollow and cannot set a record. AWS gives Project Rainier as nearly half a million chips, an upper limit, so it is drawn hollow and does not set a record either.
Storage runs from 231000TB (2022) to 500000TB (2025) across 2 clusters. A planned campus is drawn hollow and cannot set a record.
200000500000Storage the owner prints for one cluster, TB, log scale2022202320242025Meta Research SuperCluster: 231000TB, 1/2022Doubled to 200K GPUs: ≥500000TB, 2/2025
  • Record: the most in one running cluster by then
  • Hollow: a plan, not yet running

5 records, oldest first. Each cluster ran more accelerators than any running cluster before it.

  1. 10,000

    Microsoft supercomputer for OpenAI

    Who
    Microsoft
    Stage
    Operating
  2. 16,000

    Meta RSC phase 2

    Who
    Meta
    Stage
    Operating
  3. 24,576

    Meta 24k-GPU clusters

    Who
    Meta
    Stage
    Operating
  4. 200,000

    Doubled to 200K GPUs

    Who
    xAI
    Stage
    Operating
  5. over 220,000

    Colossus 1 at 220k GPUs

    Who
    SpaceX (xAI)
    Stage
    Operating

2 records, oldest first. Each cluster ran more storage than any running cluster before it.

  1. 231,000TB

    Meta Research SuperCluster

    Who
    Meta
    Stage
    Operating
  2. over 500,000TB

    Doubled to 200K GPUs

    Who
    xAI
    Stage
    Operating

How to read it

Each row is a milestone: a cluster its owner says is running, a planned campus, or a hardware or supply deal. The page holds 17 milestones from 17 public sources, 8 of them plans. A row sits at the date its own source prints, to the month at least.

The Accelerators chart counts the accelerators in one cluster, on a log scale where each gridline step multiplies the value. Most are NVIDIA GPUs; AWS’s Project Rainier counts Trainium2 chips, which its source gives as nearly half a million. A cluster sets a record only once its owner says it runs. A planned campus, such as a Stargate site, is a plan for power and chips, not a running cluster, so it is drawn hollow and never sets a record; its gigawatts are in the table.

Storage is the figure the owner prints for the cluster, in terabytes: Meta’s 2022 Research SuperCluster added up 231 PB across three tiers, and xAI gives at least 500 PB for Colossus. Sources are the companies themselves; news sites and trade press can point to a milestone, but the row cites the primary page.

Every milestone and its source

Newest first. The Lane chips above filter this table and the chart together.

  • means the source does not state this figure.
  • Derived: worked out from what the source states (a unit change, or one figure divided by another), not printed by it.

MilestoneWhoLaneStageDateGPUsStorageComputePowerSourceNote
New Compute Partnership with AnthropicSpaceX (xAI)SI clustersOperating5/2026≥220,000not publishednot publishednot publishedSpaceXSI 2026 releaseColossus 1 has over 220,000 NVIDIA GPUs. Anthropic signed for access to it and said it is interested in developing multiple gigawatts of orbital compute with SpaceX.
AWS activates Project Rainier: One of the world’s largest AI compute clusters comes onlineAWSSI clustersOperating10/2025≤500,000not publishednot publishednot publishedAmazon 2025 releaseNearly half a million Trainium2 accelerators in use less than a year after the project was announced, with Anthropic running workloads.
AMD and OpenAI Announce Strategic Partnership to Deploy 6 Gigawatts of AMD GPUsAMD and OpenAIHardware and supply dealsForecast10/2025not publishednot publishednot published6GWAMD 2025 releaseThe first 1GW of AMD Instinct MI450 GPUs starts in the second half of 2026.
Meta’s Infrastructure Evolution and the Advent of AIMetaSI clustersForecast9/2025not publishednot publishednot published5GWMeta 2025 releaseExpected to come online from 2028 and scale to 5 gigawatts. A plan, drawn faint.
Meta’s Infrastructure Evolution and the Advent of AIMetaSI clustersForecast9/2025not publishednot publishednot published1GWMeta 2025 releaseA 1 gigawatt cluster spanning several data center buildings, under construction when Meta wrote. A plan, drawn faint.
OpenAI, Oracle, and SoftBank expand Stargate with five new AI data center sitesOpenAI, Oracle and SoftBankSI clustersForecast9/2025not publishednot publishednot published≤7GWOpenAI 2025 releaseThe new sites bring Stargate to nearly 7GW of planned capacity, counting Abilene and the CoreWeave projects.
OpenAI and NVIDIA Announce Strategic Partnership to Deploy 10 Gigawatts of NVIDIA SystemsNVIDIA and OpenAIHardware and supply dealsForecast9/2025not publishednot publishednot published≥10GWNVIDIA 2025 releaseAt least 10GW; the first gigawatt is on Vera Rubin in the second half of 2026, and NVIDIA intends to invest up to $100 billion.
Inside the world’s most powerful AI datacenterMicrosoftSI clustersOperating9/2025not publishednot publishednot published3.3GWMicrosoft 2025 releaseEpoch AI 2025Fairwater in Wisconsin: one cluster of NVIDIA GB200 servers with exabytes of storage, on a 315 acre site. Microsoft prints no power figure; the 3.3GW is Epoch AI’s projection for late 2027.
Introducing Stargate NorwayOpenAISI clustersForecast7/2025100,000not publishednot published0.23GWOpenAI 2025 release230MW planned, with ambitions for 290MW more; the target is 100,000 NVIDIA GPUs by the end of 2026.
Stargate Advances with 4.5 GW Partnership with OracleOpenAI and OracleSI clustersForecast7/2025not publishednot publishednot published4.5GWOpenAI 2025 release
Introducing Stargate UAEOpenAISI clustersForecast5/2025not publishednot publishednot published1GWOpenAI 2025 releaseA 1GW cluster in Abu Dhabi, with 200MW expected to go live in 2026.
Doubled to 200K GPUsxAISI clustersOperating2/2025200,000≥500,000TBnot publishednot publishedxAI 2026 releaseThe Colossus page dates full scale to February 2025 and lists more than 0.5EB of storage for training data and checkpoints.
NVIDIA Blackwell Platform Arrives to Power a New Era of ComputingNVIDIAHardware and supply dealsAnnounced3/202472not publishednot publishednot publishedNVIDIA 2024 releaseOne GB200 NVL72 rack joins 72 Blackwell GPUs and 36 Grace CPUs over fifth-generation NVLink.
Building Meta’s GenAI InfrastructureMetaSI clustersOperating3/202424,576not publishednot publishednot publishedMeta 2024 releaseTwo clusters of 24,576 H100 GPUs each, used to train Llama 3, with storage on high-capacity E1.S SSDs.
Pursuing groundbreaking scale and accelerating research using Meta’s Research SuperClusterMetaSI clustersOperating5/202316,000not published≤5,000,000TFLOPSnot publishedMeta 2023 releaseThe second phase complete: 2,000 DGX A100 systems, 16,000 A100 GPUs and almost 5 exaflops.
Introducing the AI Research SuperClusterMetaSI clustersOperating1/20226,080231,000TB, derivednot publishednot publishedMeta 2022 releasePhase one: 6,080 A100 GPUs, with a storage tier of 175 PB of FlashArray from Pure Storage (renamed Everpure on February 23, 2026), 46 PB of cache storage and 10 PB of FlashBlade.
Microsoft announces new supercomputer, lays out vision for future AI workMicrosoftSI clustersOperating5/202010,000not publishednot publishednot publishedMicrosoft 2020 releaseOne system with more than 285,000 CPU cores, 10,000 GPUs and 400 Gb/s of network per GPU server, among the top five publicly disclosed supercomputers.
  • SI clusters. Clusters their owners say are running, with the accelerators and storage they print, and the planned campuses that are not yet built.
  • Hardware and supply deals. Accelerator platforms and the supply deals behind the build-out. Memory per accelerator is on the HBM timeline.

What it will not tell you

This is a record of clusters with a dated public source, not a list of every data center. Many owners never print how many accelerators a cluster holds, and Microsoft gives no count for Fairwater, so it sits in the table without a point. A gigawatt in an announcement is a plan for capacity, not power drawn today, and an investment pledge with no capacity behind it is left off.

The memory on each accelerator is on the HBM Timeline, and what one gigawatt takes in wafers and EUV scanners is in What a Gigawatt Takes. For memory and compute in space, see Signals; for optics for memory, Photon Fabric; and for the makers’ results each quarter, the Earnings Desk.