NVIDIA ConnectX-7 Shown at ISC 2022

1
NVIDIA ConnectX 7 400Gbps At ISC 2022 Front
NVIDIA ConnectX 7 400Gbps At ISC 2022 Front

At ISC 2022 perhaps the biggest news from NVIDIA is that they have a customer for next year’s Grace and Grace Hopper processors. Still, since there is at least SC22 between now and when those chips are slated to be sold, our sense is that we will hear more about the system later this year. Beyond that though, we actually saw something different on the show floor. Specifically, we saw the NVIDIA ConnectX-7 (formerly Mellanox) at several booths through NVIDIA’s seeding efforts.

NVIDIA ConnectX-7 Shown at ISC 2022

NVIDIA has a number of announced ConnectX-7 SKUs, including PCIe, OCP NIC 3.0, and IC form factors. On the show floor, we saw a single port PCIe version.

NVIDIA ConnectX 7 SKUs April 2022
NVIDIA ConnectX 7 SKUs April 2022

Here is the port view in a full-height bracket using a Supermicro SuperBlade as perhaps the most expensive display stand we could find:

NVIDIA ConnectX 7 400Gbps At ISC 2022 Port Side 2
NVIDIA ConnectX 7 400Gbps At ISC 2022 Port Side 2

We also had this on the blade server switch modules.

NVIDIA ConnectX 7 400Gbps At ISC 2022 Port Side
NVIDIA ConnectX 7 400Gbps At ISC 2022 Port Side

Here is the top of the unit. One item to note here is just how big the heatsink is on the optical cage to handle the dissipation from 200Gbpe/ 400Gbps class optics.

NVIDIA ConnectX 7 400Gbps At ISC 2022 Front
NVIDIA ConnectX 7 400Gbps At ISC 2022 Front

Looking at the rear of the unit, we can see a very interestingly shaped backplate. This is the NDR200 MCX75210AAS-HEAT model from the table above.

NVIDIA ConnectX 7 400Gbps At ISC 2022 Back Side
NVIDIA ConnectX 7 400Gbps At ISC 2022 Back Side

These CX75210AA modules were built on 5/15/2022 meaning they were at ISC 2022 about two weeks after they were made. Infiniband cards in general have been in tight supply in the industry over the past few quarters.

If you saw our NVIDIA Cedar Fever 1.6Tbps Modules Used in the DGX H100 these take four of the ConnectX-7 controllers and place them on a single assembly. There are then two of these assemblies in the DGX H100 system.

NVIDIA GTC 2022 H100 In DGX H100 Two ConnectX 7 Custom Modules With Stats
NVIDIA GTC 2022 H100 In DGX H100 Two ConnectX 7 Custom Modules With Stats

Still, it was the first show where we have seen the ConnectX-7 cards live and there were a few at the show.

Bonus: NVIDIA H100 Pictures

While we have already had time to check out the NVIDIA H100 in Our First Look at Hopper, the A100’s we have seen have all been mounted in Delta or Redstone assemblies. This is an example:

Inspur NF5488A5 NVIDIA HGX A100 8 GPU Assembly 8x A100 2
Inspur NF5488A5 NVIDIA HGX A100 8 GPU Assembly 8x A100 2

On the show floor, it seems as though NVIDIA sprinkled A100 SXM modules with their heatsinks throughout. Here is the side view of one:

NVIDIA A100 SXM At ISC 2022 Side
NVIDIA A100 SXM At ISC 2022 Side

Here is the underside view of the A100:

NVIDIA A100 SXM At ISC 2022 Bottom
NVIDIA A100 SXM At ISC 2022 Bottom

For some reference, this bottom view is a big difference between the A100 (above) and new H100 (below) in terms of connections.

Patrick With The NVIDIA H100 At NVIDIA HQ April 2022 Backside
Patrick With The NVIDIA H100 At NVIDIA HQ April 2022 Backside

There is also a different density of components on the H100’s board versus the A100. We also did not see H100’s on the show floor at ISC 2022.

Final Words

This was one of the fun items we saw on the ISC 2022 show floor. Most of the new hardware will be out in force at SC22 later this year, so we are just on the cusp of the PCIe Gen5 generation with new chips and devices. Still getting to see the new cards is always fun. We are going to expect to see them in the market in higher volumes later this year as the partner companies at ISC all seemed to think volume shipments were still a few months away on the ConnectX-7 side.

1 COMMENT

  1. I hope this release means ConnectX 4 will be dropping to Home prices like CX3 on the used market as 400Gb upgrades dump 100Gb on the market.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.