WHY AI NEEDS SO MUCH ELECTRICITY
AI's power appetite starts at the chip and multiplies upward: hotter processors, denser racks, running nonstop. It's physics, not inefficiency.
Here’s the claim: AI doesn’t use enormous amounts of electricity because anyone is being careless. It uses enormous amounts of electricity because of how the machines are built. The power draw is decided at the chip, and every layer above the chip multiplies it.
The Numbers
Start with one chip. The chips that do AI math are called GPUs graphics processing units. According to the Congressional Research Service, an advanced data-center GPU is rated to draw between 350 and 700 watts. For comparison, that is about what a microwave oven pulls while it is running. One chip, one microwave.
Now stack them. Chips sit inside servers, and servers get bolted into tall metal cabinets called racks. Lawrence Berkeley National Laboratory, the US government lab that tracks data center energy reported in its 2025 update that a rack of ordinary servers draws about 3 to 5 kilowatts. A rack built for AI can draw up to 100 kilowatts. Same size cabinet, twenty to thirty times the power. NVIDIA’s current flagship AI rack packs 72 GPUs into one cabinet and draws roughly 120 kilowatts, according to NVIDIA’s own technical documentation. That is more heat than fans can push out of a metal box, which is why these racks are cooled with liquid pumped past the chips, the way a car engine is.
Now zoom out to the building. The International Energy Agency (IEA) breaks down where a modern data center’s electricity actually goes: about 60% is used by the servers themselves. Cooling takes anywhere from about 7% in the most efficient large facilities to more than 30% in older, smaller ones. This is the part we miss. Every watt that goes into a chip comes back out as heat and removing that heat costs electricity too. You pay once for the computing, then you pay again to un-heat the room.
Stack the buildings, and the numbers start showing up in national statistics. Berkeley Lab found that AI servers in the US used about 2 terawatt-hours of electricity in 2017 and about 40 terawatt-hours by 2023 — twenty times more in six years. (One terawatt-hour is roughly enough electricity to power a mid-sized city for a year.) The IEA projects that electricity used by AI-style servers will keep growing about 30% per year through 2030, compared with about 9% for ordinary servers. And the facilities themselves keep scaling: the IEA estimates a typical AI-focused data center already uses about as much electricity as 100,000 households, while the largest ones under construction will use twenty times that.
What This Means
Here is where we move from fact to inference, what the numbers suggest, not what they prove. If the power draw is set by the hardware itself, then AI’s electricity demand is structural. You cannot fix it with tidier software alone, because the multiplication happens in physical objects: chip times rack, rack times building, building times campus. Each layer inherits the layer below it.
There is a second, quieter implication. The IEA notes that an AI data center is about ten times more capital-intensive than an aluminum smelter — the classic example of a power-hungry factory. When the machines are that expensive, letting them sit idle burns money. So, operators run them as close to around-the-clock as they can. That may make AI load not just large, but unusually steady and inflexible: it does not switch off at night, and it is costly to power down when the grid is tight.
Big, concentrated, and always-on, that specific combination, more than the raw size, is what utilities and grid operators are now working through.
The Honest Pushback
The strongest objection is efficiency. Every chip generation does more math per watt than the one before. Software is improving too, newer models can often do the same work with less computing. The IEA has run this scenario: if efficiency improves faster than expected, global data-center electricity demand in 2035 comes in about 20% below its base projection. And that cooling range: 7% to 30% shows how much room the buildings themselves still have to improve. This is a real, fair objection, and it is why every serious forecast is a range, not a single number.
But notice what has happened at the chip level. Even as each generation got more efficient per calculation, the power rating per chip went up, not down. Designers spent the efficiency gains on more speed instead of less power. And in past computing booms, making computing cheaper mostly made people buy much more of it.
So, the fair conclusion is that efficiency will likely decide how much AI we get per watt, not how many watts get used.
If the draw is set at the chip, the thing worth watching is not the next benchmark score. It’s the power rating on the next generation of chips. If that number climbs again, the electricity question climbs with it — rack by rack, building by building. So far, the draw isn’t an accident of young technology. It’s the design.
Sources
1. GPU power draw: 350–700 W per chip — Congressional Research Service, Data Centers and Their Energy Consumption (Primary, Tier 1 gov), updated May 2026 — congress.gov
2. Rack density: ~3–5 kW conventional vs. up to ~100 kW AI racks — LBNL / DOE, US Data Center Energy Usage Report: 2025 Update (Primary, Tier 1 gov), Jun 2026 — eta.lbl.gov
3. NVIDIA GB200 NVL72: 72 GPUs, ~120 kW per rack, liquid-cooled — NVIDIA technical documentation (Primary, corporate), 2025 — docs.nvidia.com
4. Servers ≈60% of data-center electricity; cooling ~7% (hyperscale) to >30% (enterprise) — IEA, Energy and AI (Primary, Tier 1), Apr 2025 — iea.org
5. US AI (accelerated) server electricity: 2 TWh (2017) → 40 TWh (2023) — LBNL / DOE, 2024 US Data Center Energy Usage Report (Primary, Tier 1 gov), Dec 2024 — report PDF
6. Accelerated servers growing ~30%/yr vs. ~9%/yr conventional, to 2030 — IEA, Energy and AI (Primary, Tier 1), Apr 2025 — iea.org
7. Typical AI data center ≈100,000 households; largest under construction ≈20× that — IEA, Energy and AI (Primary, Tier 1), Apr 2025 — iea.org
8. AI data center ~10× more capital-intensive than an aluminum smelter — IEA, Energy and AI (Primary, Tier 1), Apr 2025 — iea.org
9. High Efficiency Case: 2035 data-center demand ~20% below Base Case — IEA, Energy and AI (Primary, Tier 1), Apr 2025 — iea.org