Liquid Cooling vs. DLC: ROI Analysis for Blackwell
With rack densities hitting 120kW+ for B200 clusters, air cooling is obsolete. A financial breakdown of Direct-to-Chip vs Immersion cooling for next-gen deployments.
Global Scale Research
The laws of thermodynamics have finally caught up with the data center. For two decades, we moved air to cool chips. It was simple, understood, and standard. But the NVIDIA Blackwell (B200) announcement was the inflection point. With rack densities exceeding 100kW (and reaching 120kW for the NVL72), air cooling is not just inefficient — it is physically impossible at scale.
The Thermal Wall
Air has a low specific heat capacity. To cool a 100kW rack with air, you would need hurricane-force fans, creating deafening noise and vibrating the sensitive equipment to failure. The industry must pivot to liquid. The debate now is not "Air vs. Liquid," but "Direct-to-Chip (DLC) vs. Immersion."
Direct-to-Chip (DLC / Cold Plate)
DLC involves circulating liquid (water or dielectric fluid) through cold plates mounted directly on the hottest components (GPU, CPU, Switch ASICs).
- Pros: High compatibility with standard 19-inch racks. Serviceability remains similar to air-cooled (slide out servers). Supported officially by NVIDIA's reference architectures.
- Cons: Complexity of plumbing (manifolds, quick disconnects) inside the rack. Risk of leaks (mitigated by negative pressure loops). Often requires a hybrid approach (air still needed for RAM/VRMs).
- ROI: High upfront CapEx for manifolds/CDUs, but lower facility build cost than air at high densities.
Immersion Cooling (Single & Two-Phase)
Submerging the entire server in a bath of non-conductive dielectric fluid.
- Pros: The ultimate efficiency (PUE < 1.05). Zero fan noise. Zero dust. Thermal stability is unmatched.
- Cons: Operational friction. Servicing a server requires a crane and a "drip off" area. Floor loading is immense (tanks are heavy). Proprietary fluid costs.
- ROI: Best long-term OpEx, but significant operational change management required.
The Verdict for 2025
For the vast majority of enterprise and colocation deployments, DLC is winning. It offers the path of least resistance. It fits into existing hall layouts (with plumbing retrofits) and doesn't require retraining the entire operations staff to handle fluids.
Immersion is carving out a niche in specific high-performance computing (HPC) centers and crypto mining, but for the Blackwell generation, DLC is the standard. At Global Scale, we are advising clients to ensure any new facility lease includes explicit provisions for "Water-to-the-Rack" and CDU floor space.