NVIDIA® Jetson AGX Orin™ is already taking the market by storm with its unmatched performance and ability to power new-age embedded vision systems. It is said to be 8X more powerful than its predecessor Jetson AGX Xavier. In today’s blog post, we do a deep dive into some of the most popular embedded vision uses of NVIDIA Jetson AGX Orin.
What is NVIDIA® Jetson AGX Orin™?
NVIDIA® Jetson AGX Orin™ is the latest release in the ever-popular NVIDIA® Jetson™ series of processors that have been helping embedded camera applications perform better than before. The newest Jetson AGX Orin modules are packed with enough AI processing power to ensure maximum performance, no matter the complexity of the application use case. Driven by the same AI software and cloud-native workflows of other NVIDIA platforms, NVIDIA® Jetson AGX Orin™ also comes with pre-trained models to conduct tasks like object detection and classification.
Building blocks of NVIDIA® Jetson AGX Orin™
- GPU (Graphics Processing Unit): NVIDIA GPU architecture – almost 3.7 times the performance of the GPU on Jetson AGX Xavier™.
- DLA (Deep Learning Accelerator): NVDLA 2.0 – nine times the performance of NVDLA 1.0 while running complex networks and dynamic tasks.
- CPU (Central Processing Unit): Cortex-A78AE – almost 1.9 times the performance of the 8-core NVIDIA Carmel CPU integrated on Jetson AGX Xavier.
To learn more about Jetson AGX Orin and its building blocks, please visit the following article:
What is the NVIDIA Orin Series? What are the building blocks of NVIDIA Orin?
Why NVIDIA® Jetson AGX Orin™ is suitable for AI applications
One of Jetson AGX Orin’s biggest advantages is that it comes with a performance of up to 275 TOPS (Tera/Trillion Operations Per Second). Undoubtedly, it is suitable for AI-based applications requiring a lot of processing power to carry out complex and data-heavy tasks that leave little room for inaccuracies.
The best part is that a single Orin board can process as much power as multiple NVIDIA Jetson AGX Xavier or NVIDIA Jetson Xavier NX boards. This means it’s a physically more compact and operationally leaner option for running AI-based camera applications.
Key camera application use cases of NVIDIA Jetson AGX Orin™
Clearly, NVIDIA Jetson AGX Orin would be an overkill for embedded vision applications that do not require heavy edge-based processing. It is most suitable for systems that need to take real-time decisions using processing at the edge such as autonomous vehicles. In this section, let us look at some of the most popular embedded vision use cases where Jetson AGX Orin is a perfect fit.
Autonomous Mobile Robots
Autonomous Mobile Robots (AMR) are future-proofed systems that rely on heavy processing power. It helps them carry out intelligent tasks like autonomous navigation and obstacle detection, which requires the system to observe, think and act fast. For certain advanced AMR use cases, Orin’s predecessors in the NVIDIA Jetson series like AGX Xavier or Xavier NX might not suffice. However, NVIDIA Jetson AGX Orin™ is designed to enhance the performance of next-generation edge AI-powered Autonomous Mobile Robots – delivering up to 275 TOPS and with power configurable between 152W and 60W.
Learn how e-con Systems helped a leading Autonomous Mobile Robot manufacturer enhance warehouse automation by integrating cameras to enable accurate object detection and error-free barcode reading.
Autonomous Tractors
Autonomous tractors, similar to AMRs, can perform better when backed by Jetson AGX Orin’s superior processing power. But as importantly, another advantage is that this processor caters to the extensive multi-camera requirements of these modern auto-farming systems. Considering that an autonomous tractor’s embedded vision system can have up to 50 cameras connected to the host, the more the processing power of the processor, the better it is. By leveraging Jetson AGX Orin’s high-performance and power-efficient features, compactness can also be achieved reducing the number of processing units required.
People Detection Systems
With the advancements in neural networks, it has become easier to train people detection systems to extract and understand large datasets without compromising accuracy levels. However, given the complexity of algorithms used in these detection systems, their integrated camera solutions must be powered by advanced processing. Hence, Jetson AGX Orin™ is recommended for its unprecedented computing power.
Crowd Analytics Systems
Like people detection systems, crowd analytics applications heavily depend on Deep Learning Accelerators, traditionally seen as a hindrance in deep learning operations. But with Jetson AGX Orin’s capability to support NVDLA 2.0 (offering nine times the performance of NVDLA 1.0!), the crowd analytics system’s GPU can effortlessly run more complex networks and dynamic tasks.
Telehealth Devices
Telehealth devices, such as telemedicine robots, are dependent on heavy processing to autonomously carry out critical tasks like navigation, detection, etc. So, Jetson AGX Orin’s high-end computing power comes into play – accelerating the end-to-end AI capabilities of telehealth applications and helping transform how key healthcare processes are carried out.
Cutting-edge cameras developed by e-con Systems for NVIDIA Jetson AGX Orin™
As an NVIDIA Elite partner, e-con Systems™ offers complete camera solutions for NVIDIA Jetson AGX Orin™ and other Jetson modules (AGX Xavier, Xavier NX, TX2 NX, and Nano developer kits). As a result, your product developers will find it tremendously easy to build gen-next camera-enabled applications with superior autonomous capabilities. One of our key differentiators is that we offer specialized GMSL2 cameras for autonomous vehicles to enable very low latency transmission up to a distance of 15 meters from the host processor.
Some of our camera solutions for NVIDIA Jetson AGX Orin™ are:
- e-CAM82_CUOAGX – a 4K Sony STARVIS IMX485-based multicamera for NVIDIA® Jetson AGX Orin™ with a 1/1.2″ sensor and a pixel size of 2.9µm to improve sensitivity and ensure superior image clarity.
- e-CAM80_CUOAGX – a 4K Sony STARVIS IMX415-based camera for NVIDIA® Jetson AGX Orin™ capable of streaming 4K at 44 fps with great image quality in visible/low-light conditions.
- e-CAM20_CUOAGX – a Full HD MIPI CSI-2 color global shutter multicamera solution for NVIDIA® Jetson AGX Orin™ to connect and synchronize up to 6 cameras
If you are interested in integrating the right cameras with new-age processors like NVIDIA® Jetson AGX Orin™, please write to us at camerasolutions@e-consystems.com.
Visit our NVIDIA cameras page to check out the other cameras developed by e-con Systems for NVIDIA Jetson modules. See our Camera Selector page to check out our full camera portfolio.
Gomathi Sankar is a camera expert with 15+ years of experience in embedded product design, camera solutioning, and product development. In e-con Systems, he has built numerous camera solutions for robots, industrial handhelds, quality inspection systems, smart city applications, industrial safety systems, and more. He has played an integral part in helping hundreds of customers build their dream products by integrating the right vision technology into them.