Abstract:This paper presents a benchmark analysis of NVIDIA Jetson platforms when operating deep learning-based 3D object detection frameworks. Three-dimensional (3D) object detection could be highly beneficial for the autonomous navigation of robotic platforms, such as autonomous vehicles, robots, and drones. Since the function provides one-shot inference that extracts 3D positions with depth information and the heading direction of neighboring objects, robots can generate a reliable path to navigate without collision. To enable the smooth functioning of 3D object detection, several approaches have been developed to build detectors using deep learning for fast and accurate inference. In this paper, we investigate 3D object detectors and analyze their performance on the NVIDIA Jetson series that contain an onboard graphical processing unit (GPU) for deep learning computation. Since robotic platforms often require real-time control to avoid dynamic obstacles, onboard processing with a built-in computer is an emerging trend. The Jetson series satisfies such requirements with a compact board size and suitable computational performance for autonomous navigation. However, a proper benchmark that analyzes the Jetson for a computationally expensive task, such as point cloud processing, has not yet been extensively studied. In order to examine the Jetson series for such expensive tasks, we tested the performance of all commercially available boards (i.e., Nano, TX2, NX, and AGX) with state-of-the-art 3D object detectors. We also evaluated the effect of the TensorRT library to optimize a deep learning model for faster inference and lower resource utilization on the Jetson platforms. We present benchmark results in terms of three metrics, including detection accuracy, frame per second (FPS), and resource usage with power consumption. From the experiments, we observe that all Jetson boards, on average, consume over 80% of GPU resources. Moreover, TensorRT could remarkably increase inference speed (i.e., four times faster) and reduce the central processing unit (CPU) and memory consumption in half. By analyzing such metrics in detail, we establish research foundations on edge device-based 3D object detection for the efficient operation of various robotic applications.

Nvidia makes it easy to embed AI: The Jetson nano packs a lot of machine-learning power into DIY projects - [Hands on]

Project Rocket platform—designed for easy, customizable live video analytics—is open source

Challengers are Coming for Nvidia's Crown: In AI's Game of Thrones, Don't Count Out the Upstarts

DaDianNao: A Machine-Learning Supercomputer

NVIDIA at the Center of the Generative AI Ecosystem---For Now

Device JNEEG to convert Jetson Nano to brain-Computer interfaces. Short report

Pushing the AI Envelope: Merging Deep Networks to Accelerate Edge Artificial Intelligence in Consumer Electronics Devices and Systems

JNEEG shield for Jetson Nano for real-time EEG signal processing with deep learning

How to Train an All-Purpose Robot: DeepMind is Tackling one of the Hardest Problems for AI

Benchmarking Deep Learning Models on NVIDIA Jetson Nano for Real-Time Systems: An Empirical Investigation

Accelerating AI: the cutting-edge chips powering the computing revolution

How to Reach Real-Time AI on Consumer Devices? Solutions for Programmable and Custom Architectures

Tricking AI chips into Simulating the Human Brain: A Detailed Performance Analysis

CoCoPIE: Making Mobile AI Sweet As PIE --Compression-Compilation Co-Design Goes a Long Way

Bringing Robots Home: The Rise of AI Robots in Consumer Electronics

Analysing Edge Computing Devices for the Deployment of Embedded AI

The Genesis of AIbyAI Integrated Circuit: Where AI Creates AI

CNN architecture extraction on edge GPU

Run Your 3D Object Detector on NVIDIA Jetson Platforms:A Benchmark Analysis

Face Detection and Recognition, Face Emotion Recognition Through NVIDIA Jetson Nano

Bring Your Own Codegen to Deep Learning Compiler