NVIDIA continues it evolve the Jetson edge computing platform with newer additions. At the recently held GTC conference, the company has announced the availability of Jetson AGX Orin, a power-packed edge computing platform meant for running AI solutions.
AGX Orin Module and Developer Kit
The NVIDIA Orin System-on-Chip (SoC) is based on the NVIDIA Ampere GPU architecture with 2048 CUDA cores, 64 Tensor Cores, and 2 Deep Learning Accelerator (DLA) engines that deliver up to 275 trillion operations per second (TOPS) of AI performance.
NVIDIA claims that Jetson AGX Orin is 8x faster and 2X the energy efficiency of Jetson AGX Xavier, an SoC launched in 2018 to run advanced AI solutions at the edge. With the same pinout configuration as AGX Xavier, customers can easily port their existing edge AI applications to AGX Orin.
With 8X better performance over the 32 TOPS delivered by Jetson AGX Xavier, AGX Orin also delivers up to 9X the deep learning accelerator (DLA) performance, 1.5X higher CPU performance and up to 1.5X higher DRAM bandwidth.
AGX Xavier vs AGX Orin
MORE FOR YOU
The Jetson AGX Orin SoC significantly accelerates the inference of computer vision and conversational AI models. The below table from NVIDIA compares the inference performance of Jetson AGX Xavier and Jetson AGX Orin.
AGX Xavier vs AGX Orin Inference
Similar to other products of the Jetson family, the AGX Orin hardware platform comes in two flavours – a developer kit and a production module. The developer kit is meant for prototyping AI solutions that can be easily moved to the production environment based on the production-ready SoC modules.
The Jetson AGX Orin developer kit is available today for $1999, while the production modules are expected later this year. The developer kit is based on a Jetson AGX Orin module with a heat sink and a reference carrier board that comes with 802.11ac/abgn WiFi controller, an RJ45 (up to 10 GbE) port, a 16 lane MIPI CSI-2 connector, an M.2 Key E and M.2 Key M that support multiple PCIe slots and also 2X USB A and USB C ports for connecting peripherals.
Since the device is a part of the Jetson family, it runs the same software stack powered by JetPack, Riva, DeepStream, Isaac and TAO.
Jetpack Software
The Jetson AGX Orin developer kit ships with the pre-release version of JetPack 5.0, which runs on Ubuntu 20.04 based on Linux Kernel 5.10. It also includes security features such as hardware root of trust, secureboot, disk encryption and secure storage.
The NVIDIA Jetson family is the most comprehensive Edge AI platform. Makers and developers can get started with the most affordable Jetson Nano, a $99 board, while enterprises running advanced AI solutions can go for high-end Jetson AGX Orin. The spectrum of Jetson devices targets a wide range of AI use cases and scenarios spanning from hobby projects to mission-critical healthcare applications.
As organizations move AI workloads to the edge, they need higher processing power and hardware-driven acceleration. With Jetson AGX Orin, NVIDIA promises server-class AI performance at the edge, making it the best-in-class edge platform.
NVIDIA innovates on both the cloud/data center and the edge environments to deliver accelerated computing platforms for AI workloads.
This UrIoTNews article is syndicated fromGoogle News
About Post Author
