LITEON Shows NVIDIA GB200 NVL72 Rack at OCP Summit 2024

The CDU has its own management interface showing the dual pumps, fan speeds, rpms, pressures, temperatures and more.

The liquid cooling information and power monitoring information can be brought into monitoring tools and is used for things like monitoring battery power levels.

On that front, LITEON also had its 33kW ORv3 power shelf as well as the 33kW ORv3 battery backup system. These are 48V units, but folks are looking to higher voltages liquid cooled bus bars, and more in the future. Some data centers prefer to have huge batteries outside the facility or in data halls. Others prefer to have localized battery backup in the rack. While battery backup is optional, the power shelf is a key ORv3 design point.

In the above photo, an ORv3 power supply may not look much different from those in a standard server. When these power supplies are removed from the shelves, they are massive.

These are 12kW 80Plus Titanium power supplies.

They deliver 12kW each.

Here is the connector side.

Just for some sense of scale, here is Patrick for scale.

While that may seem huge, there are two points to remember. First, the power shelf removes the need for dozens of power supplies at the individual server level. It also removes the need for traditional PDUs and tons of cables. Second, while those power supplies may look big, today’s 120kW+ NVIDIA GB200 NVL72 rack is going to look like a lower power rack as we move into 2025.

Final Words

Power and cooling are topics that we have been pushing our readers to look into since 2020/ 2021. Hopefully folks are starting to understand why. Large data center operators and hyper-scalers are looking at SMR technology, lighting old reactors, and generally trying to find as much power as possible. The series that we have been doing on liquid cooling over the past few years should make sense in the context of saving perhaps 20kW+ per rack on the cooling side, or even more when it comes to density. We have traditionally seen LITEON power supplies in servers we have reviewed over the years. At OCP Summit 2024, the message was clear. The company wants to be much more than a power company. Instead, it wants to sell the rack infrastructure beyond which is a big step up.

We are showing the main AI rack here, but LITEON had some other neat hardware in their booth, like a half-megawatt and potentially megawatt rack power solution. Something I learned was that we might see a solution where there is a 1MW power supply in a rack that is then distributed to other compute racks.