Meta Announces AMD Instinct MI300X for AI Inference and NVIDIA GB200 Catalina

0
Meta AMD MI300X Grand Teton
Meta AMD MI300X Grand Teton

At OCP Summit 2024, Microsoft announced new AI hardware platforms. Meta has been a force in AI for years, and increasingly so with Llama and its massive data sets. We have a number of announcements and these are coming rapid fire. Since we are doing them live, please excuse typos.

AMD Instinct MI300X at Meta for AI Inference

Meta announced that it brought the AMD Instinct MI300X to its Grand Teton platform for eight accelerators.

Meta AMD MI300X Grand Teton
Meta AMD MI300X Grand Teton

The company also said it is already using these platforms.

NVIDIA GB200 Catalina at Meta

For its next generation, Meta has the NVIDIA GB200 rack that is being contributed to OCP called “Catalina”.

Meta NVIDIA GB200 Catalina
Meta NVIDIA GB200 Catalina

Meta says this is a 140kW rack. NVIDIA’s Ian Buck is up next announcing that the GB200 is in full production. NVIDIA is also announcing that it is contributing its NVIDIA GB200 NVL72 platform to OCP to enable projects like Catalina.

Meta FBNIC with Marvell

Hopefully we can find these on the show floor, but Meta has its own NIC, dubbed the FBNIC.

Meta FBNIC Marvell OCP
Meta FBNIC Marvell OCP

This is a network card built with Marvell. It can do things like splitting into 4x PCIe Gen5 connections for a multi-host setup. It is a big deal that Facebook is designing its own NICs.

Minipack3 and Cisco 8501 Switches

There are two new 51.2T switches. The new Minipack3 is built by Celestica and based on the Broadcom Tomahawk 5.

Meta 51.2T Switches Celestica MiniPack3 Cisco
Meta 51.2T Switches Celestica MiniPack3 Cisco

Cisco is here with the Cisco 8501. This is a Cisco G200 51.2T switch platform.

Fairly notable here is that Meta is using Marvell for its NIC, but it is not announcing a Marvell Teralynx 10 51.2T Switch platform.

Meta Arista DSF Broadcom Switches

Meta also has two Arista platforms. There is a Jerico3 switch, the Arista 7700R4C-38PE.

Meta Ethernet To The GPU Broadcom Switch Platforms
Meta Ethernet To The GPU Broadcom Switch Platforms

There is another switch, the Arista 7720R4-128PE as the 128 port model. Key on this slide is also that Meta is saying it is bringing Ethernet to GPUs.

Final Words

How cool! Meta brought a lot of new hardware into the AI space. Notably absent, however, was non-AI compute from the keynote. Still, this is a big deal for NVIDIA, AMD, Broadcom, Marvell, Arista, Cisco, and others. Meta buys a lot of hardware, so this type of roster ends up moving the needle in the industry.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.