The full picture:
🏗️ Today: zero operational 1+ GW campuses. Largest are 300–600 MW. Hopefully in 2027–28.
🏭 15–20 giant campuses (1–5 GW) needed for frontier training by 2030. Already under construction. So the other 600GW should stop chasing.
🏢 50–100 regional hubs (100–500 MW) for frontier inference. Also non-negotiable — model weights are simply too large for anything smaller. The are also data centers that have been identified.
📡 100 kW telco towers — real value for voice AI, AR/VR, autonomous vehicles. Not a general solution. Throughput vs user density is structurally broken for frontier workloads.
🏠 Residential nodes — viable only for on-device 7B models. Not part of the frontier inference stack at all.
The distributed inference dream is real. It lives at Tier 4 (on-device) and Tier 3 (latency-critical edge). Frontier training and agentic workloads will remain centralized — not because of ideology, but because physics and model size demand it.