Aivres KR6288 NVIDIA HGX H200 Server Review

3

Aivres KR6288 Internal Overview NVIDIA HGX H200 8 GPU

To many, this will look like a server. Instead, this houses the NVIDIA assembly inside the KR6288 on a slide-out subsystem.

Aivres KR6288 NVIDIA HGX H200 8 GPU Tray
Aivres KR6288 NVIDIA HGX H200 8 GPU Tray

For part number aficionados, here is the NVIDIA HGX 8 GPU SXM5 141GB HBM3e AC (air-cooled) label.

Aivres KR6288 NVIDIA HGX H200 8 GPU Connector Side Label
Aivres KR6288 NVIDIA HGX H200 8 GPU Connector Side Label

On the system-facing side, we see the high-density power and data connectors and a dense jungle of heatsinks.

Aivres KR6288 NVIDIA HGX H200 8 GPU Connector Side 1
Aivres KR6288 NVIDIA HGX H200 8 GPU Connector Side 1

On the front side, we can see the huge heatsinks, which are free to accept cool airflow from the cold aisle.

Aivres KR6288 NVIDIA HGX H200 8 GPU Tray Front
Aivres KR6288 NVIDIA HGX H200 8 GPU Tray Front

Taking off the metal top cover, there is an airflow guide.

Aivres KR6288 NVIDIA HGX H200 8 GPU With Airflow Guide
Aivres KR6288 NVIDIA HGX H200 8 GPU With Airflow Guide

Once we take that off, we can see the eight NVIDIA GPUs.

Aivres KR6288 NVIDIA HGX H200 8 GPU
Aivres KR6288 NVIDIA HGX H200 8 GPU

If you are wondering about those four heatsinks that are not marked, they are for each of the NVLink Switches onboard. In this and previous generations of NVLink Switch HGX baseboards, the switches are on one side of the baseboard. With the NVIDIA HGX B200 generation, the number will reduce from four to two, and the switches will move to the center of the GPUs. That helps shorten the high-speed traces through the baseboard.

Aivres KR6288 NVIDIA HGX H200 8 GPU NVLink Switches
Aivres KR6288 NVIDIA HGX H200 8 GPU NVLink Switches

There are some other heatsinks on the connector side. These are usually for things like the Astera Labs PCIe retimers used on the board.

Aivres KR6288 Astera Labs PCIe Retimer Side
Aivres KR6288 Astera Labs PCIe Retimer Side

Next, let us get inside the system to see how it works.

3 COMMENTS

  1. “designed to house two processors, 32 DIMMs, nine or more 400G NICs, and eight GPUs with over 1.1GB of combined HBM3e memory.” Minor typo at the beginning, I think that you mean tb ;)

  2. Inspur was forced to exit since if they owned a company they couldn’t have a server with H200’s. Kaytus was the one who went to Singapore? Aivres was spun out as the US operations and sales as its own OEM. If they were a Chinese brand owned by Inspur they couldn’t get the H200’s for this server. I’m seeing a H200 server from them, and their business addresses are all in CA, so I don’t think it’s Inspur

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.