Nvidia wants to cut data center water use, but that’s not the same as fixing AI’s water problem

Nvidia conscionable announced a warm-water cooling strategy that it says tin dramatically trim the magnitude of h2o a information halfway uses — eliminating “pretty overmuch each h2o usage” wrong the information halfway itself, according to an Nvidia enforcement successful a press release.  

“The h2o depletion situation for information centers is mostly solved,” Josh Parker, main sustainability serviceman astatine Nvidia, precocious told Axios.

But that’s lone portion of the h2o story. As agelong arsenic AI information centers tally connected fossil fuels — a prime tech companies are increasingly making — the savings halt astatine the information center’s walls.

The halfway contented is however Nvidia measures information halfway h2o use. According to its blog post, the institution fundamentally draws a enactment astir the information center. Anything wrong gets counted, thing extracurricular gets ignored.

To beryllium fair, Nvidia’s strategy does look to present connected its facility-level committedness — the coolant runs successful a closed loop, filled erstwhile and recirculated for the beingness of the facility, meaning nary caller h2o is consumed to chill the chips. In favorable climates, the institution says, that tin magnitude to a 100% simplification successful on-site h2o use.

TechCrunch has asked Nvidia to clarify the matter, and we’ll update this nonfiction if we person a reply.

The occupation is, h2o usage extracurricular of the information halfway — chiefly successful energy procreation and spot manufacturing — tin double oregon triple the full h2o footprint of a facility. That means Nvidia’s solution addresses astir a 4th to a 3rd of AI information centers’ full h2o consumption. 

The caller strategy is clever, pumping coolant into racks astatine 45˚ C (113˚ F). That’s blistery for humans but not for machine chips. After passing done a server, the coolant emerges astatine 55˚ C (131˚ F), Nvidia said, bringing a important magnitude of vigor distant from the hardware. 

At that temperature, the extracurricular aerial successful astir climates tin gully vigor disconnected passive radiators without evaporative cooling or, successful immoderate cases, fans. A information halfway without fans oregon chillers would not lone usage little water, it would beryllium much businesslike and quieter. 

But nary information halfway tin run without an energy supply, and galore types of powerfulness plants are themselves large h2o consumers.

Fossil substance powerfulness plants are 1 of the largest h2o users successful the U.S., consuming 2.7 cardinal gallons per day, according to the U.S. Geological Survey — astir of it for evaporative cooling. Natural state powerfulness plants usage 1.17 liters of h2o for each kilowatt-hour of energy they generate, according to a recent study. Coal plants are adjacent much water-intensive, utilizing 2.2 liters per kilowatt-hour. Fossil substance powerfulness plants collectively make astir fractional of each information halfway powerfulness today, according to the IEA.

Hydropower dams, which proviso astir 10% of information halfway power, don’t devour h2o successful the aforesaid nonstop way, but evaporation from their reservoirs into 6.8 liters mislaid per kilowatt-hour generated. Geothermal, a root tech companies are starting to explore, varies wide — it tin beryllium higher oregon little depending connected the circumstantial technology. Some enhanced geothermal startups, similar Fervo, person pledged to usage mostly “degraded” h2o that would different spell unused.

Wind and star power, connected the different hand, usage vanishingly tiny amounts of water, astir 0.01 liters and 0.03 liters per kilowatt-hour, respectively — figures that see the h2o needed for manufacturing and cleaning star panels. 

While renewables are providing a increasing stock of caller energy capacity, earthy state and ember are expected to supply much than 40% of caller energy needed to conscionable information halfway request done 2030, the IEA projects. Without large changes to that trajectory, information centers volition inactive devour ample amounts of water, careless of what Nvidia does wrong its walls.