This week, we covered something on the STH YouTube channel about the NVIDIA Jetson Orin developer’s kits. We have been using Jetson kits for many years. Rohit even did a NVIDIA Jetson TX2 Development Kit: Seven Tips for Getting Started piece back in 2017. The current generation is the NVIDIA Jetson Orin that combines Arm v8.2 cores with LPDDR5 memory and NVIDIA Ampere generation graphics. These were the topics of this weekend’s video.
NVIDIA Jetson Orin is the AI Raspberry Pi Upgrade
Here is a video on the NVIDIA Jetson Orin Nano and Jetson AGX Orin.
We just wanted to provide some context on the NVIDIA Jetson Orin developer kits. NVIDIA has been pushing the idea of a combined Arm CPU plus NVIDIA GPU on a module. Here is a picture of the NVIDIA Grace Hopper on a QCT carrier board.
When you look at the $500 NVIDIA Jetson Orin Nano developer kit, there is a module with the Arm CPU, GPU, and memory. There is then a carrier board that handles the I/O.
It is really interesting that NVIDIA is scaling the same sort of deployment model from the ~10W embedded platform up to the ~1000W data center platform. We are now starting to see NVIDIA’s Arm strategy even after the merger was canned. The company now has lines of Arm products for the embedded edge and robotics up to high-end data center parts.
Final Words
We have covered these kits on the STH main site previously, but not on the YouTube channel. Of course, NVIDIA GTC 2024 is next week and we will be covering that as well. We expect many new announcements from the company around new products and services as this will be the first in-person GTC since the pandemic era. Stay tuned to STH for that.
I own a Jetson Nano, it never held up to the competing TPUs in speed, and having to convert to TensorRT made it complex.
I’ve yet to find a use case for it to work.
Can’t even use it as a home assistant speaker/mic with local Wyoming inference, an esp does it better with more community support and cheaper.
The Nano got me off the whole Jetson ecosystem and the TX didn’t show me that they are going to change besides throwing more hardware at it.
Anyone have a good use case working with a Jetson that other solutions don’t deliver cheaper?
Functionality testbed maybe? To gauge the power/performance requirements before committing to a higher tier Jetson. POC is another.
What is this, an advertisement?
The original Jetson Nano is ancient compared to the Orin Nano. The original Jetson Nano is like what’s in the Nintendo Switch and the Nvidia Shield TV. The Orin Nano has tensor cores and 40 times the TOPs performance in a similar power budget as the original. It uses a 2020-era Ampere-based architecture and 2020 era A-78 Arm cores compared with the 2014 era Maxwell architecture and 2012 era A-57 Arm cores of the original Nano.
I think this was done in anticipation of GTC this week. I’ve seen STH do that before
@hoohoo No.