What Is a CDU? The Box That Decides Whether Your Liquid-Cooled AI Rack Works
When people picture a liquid-cooled AI rack, they picture the rack. The piece they forget is the one that makes it work: the coolant distribution unit, or CDU. It is rarely on the first quote, it has its own power and floor-space needs, and without it a multi-million-dollar rack cannot be switched on.
The slightly provocative claim of this guide: for a first liquid-cooled deployment, choosing the CDU arrangement deserves as much attention as choosing the GPUs.
What a CDU does, in one picture
| 🔥 Chips | ➡️ | 💧 Rack loop | ➡️ | 📦 CDU | ➡️ | 🏢 Building water or room air |
|---|---|---|---|---|---|---|
| GPUs and CPUs make heat | Clean coolant carries it away through cold plates | Pumps, heat exchanger, filters, sensors | Heat leaves the data hall |
The CDU sits between two loops. On one side is the building's facility water. On the other is a separate, closed loop of treated coolant that runs through the servers. The CDU moves heat from one to the other without the two liquids ever mixing.
That separation is the point. According to Vertiv, a major CDU maker, the unit creates an isolated secondary loop so that the coolant's temperature, pressure and flow can be controlled precisely, and most units include leak detection and flow monitoring.
Source: Vertiv: Understanding coolant distribution units
Two types: where does the heat go?
| What | 💧➡️💧 Liquid-to-liquid | 💧➡️💨 Liquid-to-air |
|---|---|---|
| Heat ends up in | The building's water loop | The room's air |
| Needs facility water piping | ✅ Yes | ❌ No |
| Cooling performance | 🟢 Best |
🟡 Limited by the room's air cooling |
| Ease of installation | 🟡 Plumbing project |
🟢 Simpler |
| Good for | Rack-scale AI such as NVL72 | A few liquid-cooled servers in an air-cooled hall |
Bars are illustrative, based on Vertiv's qualitative comparison, not measured values.
The trap is the right-hand column. A liquid-to-air CDU does not remove heat from the room. It moves heat from the chips into the room's air more efficiently. The hall's air conditioning still has to deal with all of it. For a 140 kW rack, that is not a realistic plan. For two or three liquid-cooled servers, it can be a sensible bridge.
In-rack or in-row?
| What | 🗄️ In-rack CDU | 🚪 In-row CDU |
|---|---|---|
| Where it sits | Inside the compute rack | Its own cabinet in the row |
| Serves | One rack | Several racks |
| Extra floor space | 🟢 None | 🟡 One more cabinet position |
| Best when | You are deploying one or two racks | You are deploying a row and expect to grow |
| If the CDU fails | One rack is affected | Every rack it serves is affected, unless there is redundancy |
HPE states that it offers both in-row and rack-mounted liquid cooling validated for the GB300 NVL72, including a newly validated in-rack unit. Supermicro's version of the same rack lists an in-rack CDU of up to 250 kW capacity with redundant pumps. HPE's Cray Supercomputing EX2500 is another example of the in-rack approach.
Sources: HPE GB300 NVL72 product page, Supermicro SRS-GB300-NVL72
Why this matters more in Singapore
Cold pipes in humid air sweat. In a data hall, condensation near electronics is a serious hazard. One of a CDU's jobs is to keep the coolant supply temperature above the room's dew point, so that nothing in the rack is cold enough for moisture to form on it.
In a dry, temperate climate that is a comfortable margin. In Singapore's humidity, it is a number someone has to watch. It is one reason the country now has its own liquid cooling standard, which we explain in SS 726:2026 in Plain English.
Five questions to ask before the CDU is ordered
| 1️⃣ | Liquid-to-liquid or liquid-to-air? If liquid-to-liquid, is facility water already at the rack position? |
| 2️⃣ | What capacity, with what headroom? Size for peak rack load, and ask what happens when the next generation draws more. |
| 3️⃣ | What is redundant? Pumps, power supplies, the whole unit? |
| 4️⃣ | Who owns coolant quality? Treated coolant needs testing and topping up on a schedule. |
| 5️⃣ | Who commissions and maintains it? The hardware vendor, the data centre, or a third party, and is that in the contract? |
If a quotation for a liquid-cooled rack does not mention the CDU at all, that is not a saving. It is a line item that has not been found yet.
Related on SourceIT
SourceIT Approved
Researched and verified by the SourceIT team for Singapore buyers.




