ASUS AI Servers at Computex 2024

2
ASUS ESC NM2 E1 6
ASUS ESC NM2 E1 6

At Computex 2024, we saw a number of AI servers from ASUS. That included the new NVIDIA Blackwell servers ranging from B100, B200, and GB200 servers and servers for the AMD MI300X. There were even Intel Xeon 6 servers as well as AMD EPYC Turin servers boasting up to 500W CPU TDP.

NVIDIA Blackwell AI Servers from ASUS

ASUS had a number of NVIDIA MGX platforms available. That included an entire rack of MGX platforms.

ASUS MGX Full AI Rack 3
ASUS MGX Full AI Rack 3

The big one, however, was the ASUS ESC AI POD, which is the company’s version of the NVIDIA GB200 NVL72.

ASUS NVIDIA GB200 NVL72 4
ASUS NVIDIA GB200 NVL72 4

ASUS also showed what one of the nodes will look like. We can see the bus bar power and dual liquid cooled GB200 nodes in the 1U chassis.

ASUS ESC AI POD Compute Tray Design 3
ASUS ESC AI POD Compute Tray Design 3

For those who want lower-cost Arm compute and NVIDIA GPUs, there is a dual NVIDIA Grace Hopper GH200 platform, the ASUS ESC NM2-E1. That puts two Grace Hopper CPU and GPU combo units into a single system.

ASUS ESC NM2 E1 6
ASUS ESC NM2 E1 6

ASUS also has the ESC NM1-E1 which is a single node 2U NVIDIA GH200 server.

ASUS ARM Based ESC NM1 E1 1
ASUS ARM Based ESC NM1 E1 1

For more traditional 8-way GPU compute, we have the ASUS ESC N8-E11. That platform has two variants the NVIDIA H200 version as well as the upcoming B100 variant.

ASUS ESC N8 E11 With H200_ESC N8 E11 With B100 2
ASUS ESC N8 E11 With H200 ESC N8 E11 With B100 2

We took this apart at the ASUS SC23 Booth and ASUS has one of the more serviceable designs in the industry.

ASUS ESC N8 E11 With H200_ESC N8 E11 With B100 13
ASUS ESC N8 E11 With H200_ESC N8 E11 With B100 13

For the NVIDIA B200, the power consumption grows, and therefore we need bigger heatsinks. Hence the larger ASUS ESC N8A-E13 for the 8x B200 generation.

ASUS ESC N8A E13 With NVIDIA HGX B200 2
ASUS ESC N8A E13 With NVIDIA HGX B200 2

Here is how big this looks. Even the CPUs are getting more powerful as this system is listed with DDR5-6400 support and AMD EPYC 500W TDP CPUs.

ASUS ESC N8A E13 With NVIDIA HGX B200 6
ASUS ESC N8A E13 With NVIDIA HGX B200 6

ASUS also has an 8-way AMD Instinct MI300X version called the ESC A8A-E12.

AMD Instinct Infinity 8x MI300X OAM UBB Platform 1
AMD Instinct Infinity 8x MI300X OAM UBB Platform 1

That offers a similar chassis design and the ability to use NVIDIA or AMD GPUs.

Next-Gen Intel Xeon 6 and AMD EPYC 500W Servers Shown

On the traditional CPU compute side we saw a new ASUS RS700-E12-RS12U 1U 12-bay platform. This has dual Intel Xeon 6 sockets with 8 channels of DDR5 per socket and 32 DIMMs capacity total.

ASUS RS700 E12 RS12U 3
ASUS RS700 E12 RS12U 3

We also saw the 2U version, the ASUS RS720-E12-RS24U.

ASUS RS720 E12 RS24U 2
ASUS RS720 E12 RS24U 2

AMD has touched on a few Turin details, but platforms like the ASUS RS700A-E13-RS4U support next-gen 500W AMD EPYC socket SP5 parts.

ASUS RS700A E13 RS4U 4
ASUS RS700A E13 RS4U 4

There is also a 2U version of the server in the ASUS RS720A-E13-RS24U as well.

ASUS RS720A E13 RS24U 3
ASUS RS720A E13 RS24U 3

So we know that AMD Turin will be using the SP5 socket and raise TDPs up to 500W in the next generation.

Final Words

Overall, the team saw a lot of cool servers at the Computex 2024 booth. Like many of the booth tours we are doing, AI is a huge focus. At the same time, not only will NVIDIA bring forth its new B100, B200, and GB200 platforms this year, but both Intel and AMD are going to be launching new CPUs as well, with Intel having two different new classes of servers.

We saw so many there that we have a short video for this one.

 

2 COMMENTS

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.