At OCP Summit 2024, Microsoft announced new AI hardware platforms. Meta has been a force in AI for years, and increasingly so with Llama and its massive data sets. We have a number of announcements and these are coming rapid fire. Since we are doing them live, please excuse typos.
AMD Instinct MI300X at Meta for AI Inference
Meta announced that it brought the AMD Instinct MI300X to its Grand Teton platform for eight accelerators.
The company also said it is already using these platforms.
NVIDIA GB200 Catalina at Meta
For its next generation, Meta has the NVIDIA GB200 rack that is being contributed to OCP called “Catalina”.
Meta says this is a 140kW rack. NVIDIA’s Ian Buck is up next announcing that the GB200 is in full production. NVIDIA is also announcing that it is contributing its NVIDIA GB200 NVL72 platform to OCP to enable projects like Catalina.
Meta FBNIC with Marvell
Hopefully we can find these on the show floor, but Meta has its own NIC, dubbed the FBNIC.
This is a network card built with Marvell. It can do things like splitting into 4x PCIe Gen5 connections for a multi-host setup. It is a big deal that Facebook is designing its own NICs.
Minipack3 and Cisco 8501 Switches
There are two new 51.2T switches. The new Minipack3 is built by Celestica and based on the Broadcom Tomahawk 5.
Cisco is here with the Cisco 8501. This is a Cisco G200 51.2T switch platform.
Fairly notable here is that Meta is using Marvell for its NIC, but it is not announcing a Marvell Teralynx 10 51.2T Switch platform.
Meta Arista CSF Broadcom Switches
Meta also has two Arista platforms. There is a Jerico3 switch, the Arista 7700R4C-38PE.
There is another switch, the Arista 7720R4-128PE as the 128 port model. Key on this slide is also that Meta is saying it is bringing Ethernet to GPUs.
Final Words
How cool! Meta brought a lot of new hardware into the AI space. Notably absent, however, was non-AI compute from the keynote. Still, this is a big deal for NVIDIA, AMD, Broadcom, Marvell, Arista, Cisco, and others. Meta buys a lot of hardware, so this type of roster ends up moving the needle in the industry.
