At Hot Chips 2024, we have a talk about the AMD Versal AI Edge Series Gen 2. We first covered the Xilinx Versal AI Edge in 2021, and now we have a product Gen 2.
Please note that we are doing these articles live during the presentations. Please excuse typos. I did two weeks of STH content just yesterday!
AMD Versal AI Edge Series Gen 2 for Vision and Autos
A big part of the AMD FPGA/ SoC value proposition is the ability to do a full workflow from preprocessing the data, to doing inference, to postprocessing of the result and do so at low latency.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_03](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_03-800x450.jpg)
Versal AI Edge Series Gen 2 has a similar value proposition to the previous generation, which is to replace multiple chips with a single chip.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_04](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_04-800x450.jpg)
Here is the block diagram. AMD is upgrading the Xilinx-derived AI Engines to provide better performance per watt.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_05](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_05-800x450.jpg)
Here is the product table for the AI embedded systems. Some of the SKUs have more Arm Cortex-A78AE cores and video/ image processing tiles.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_06](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_06-800x450.jpg)
AMD has a new generation of AI engines, the AIE-ML v2 in this generation.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_07](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_07-800x450.jpg)
Here is the compute upgrade of the AI Engine. For formats like INT8 and bfloat16 AMD is doubling the performance, but it is also supporting new memory formats.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_08](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_08-800x450.jpg)
AMD also has MX9 and MX6 datatypes.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_09](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_09-800x450.jpg)
On the processing side, AMD has higher-power CPU cores, real-time cores, and an Arm GPU. If you hear people say AMD does not produce Arm CPUs, remember this slide. AMD sells Arm CPUs for embedded markets.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_10](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_10-800x450.jpg)
The new processing system provides more performance.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_11](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_11-800x450.jpg)
On embedded devices, lifespans are long, and they are often deployed in places less secure than a data center, so embedded system security is a big deal.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_12](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_12-800x450.jpg)
Here is the new video processing IP. These are important, for example, if you have camera feeds that you are trying to do edge inference on.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_13](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_13-800x450.jpg)
Functional safety is needed in some embedded applications, such as automotive, where chips cannot fail, or at least fail in certain ways.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_14](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_14-800x450.jpg)
While folks often focus on automotive AI for exterior functions like autonomous driving, some newer vehicles also have internal cabin cameras that are running AI inference to see the state of passengers.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_15](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_15-800x450.jpg)
AMD has an AI and vision processing pipeline that starts with obtaining sensor data and preprocessing that data.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_16](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_16-800x450.jpg)
Next in the pipeline is AI inference.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_17](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_17-800x450.jpg)
Once the sensor data has been fed through the AI models, the output is then used to do something. For example, a cabin camera sees the driver, the AI inference determines that the video feed is showing the driver falling asleep, and the decision is made prompting the driver to take a break.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_18](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_18-800x450.jpg)
Since this is also FPGA-based, one can create a custom sensor preprocessing pipeline.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_19](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_19-800x450.jpg)
AMD also says that you can run multiple modules on its AI Engines at the same time.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_20](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_20-800x450.jpg)
Alternatively, the entire array can context switch between models.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_21](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_21-800x450.jpg)
Post-processing can happen, using the CPU cores as well.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_22](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_22-800x450.jpg)
An example of making this work is the automated parking.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_23](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_23-800x450.jpg)
Here is the summary slide.
![AMD Versal AI Edge Gen 2 Hot Chips 2024_Page_24](https://www.servethehome.com/wp-content/uploads/2024/08/AMD-Versal-AI-Edge-Gen-2-Hot-Chips-2024_Page_24-800x450.jpg)
For those thinking of applications in other areas, AMD also has other Versal lines.
Final Words
Overall, it is cool to see this advance. The edge is perhaps the place most up for grabs in the AI race. There are so many applications and use cases that the likely outcome is a much more heterogeneous mix of chips than in the data center, PC space, and phones combined.