Abstract:Advanced driver assistance systems (ADASs) and autonomous vehicles rely on different types of sensors, such as camera, radar, ultrasonic, and LiDAR, to sense the surrounding environment. Compared with the other types of sensors, millimeter-wave automotive radar has advantages in terms of cost and reliability under bad weather conditions (e.g., snow, rain, and fog) and does not suffer from light condition variations (e.g., darkness). Typical radar devices used in today's commercial vehicles with ADAS features produce sparse point clouds in low angular resolution with a limited number of antennas. In this article, we present a machine-learning-aided signal processing chain to suppress the radar imaging blur effect introduced by the phase migration in time-division multiplexing multiple-input multiple-output radar, to generate low-level high-resolution radar bird's-eye view (BEV) spectra with rich object's features. Compared with radar point clouds, there is no information loss in radar BEV spectra. We then propose a temporal-fusion distance-tolerant single-stage object detection network, termed as TDRadarNet, and an enhanced version, TDRadarNet+, to robustly detect vehicles in both long and short ranges on radar BEVs. We introduce a first-of-its-kind multimodel dataset, containing 14 800 frames of high-resolution low-level radar BEV spectra with synchronized stereo camera RGB images and 3-D LiDAR point clouds. Our dataset achieves 0.39-m range resolution and 1.2 degrees degree azimuth angular resolution with 100-m maximum detectable range. Moreover, we create a subdataset, the Doppler Unfolding dataset, containing 244 140 beam vectors extracted from the 3-D radar data cube. With extensive testing and evaluation, we demonstrate that our Doppler unfolding network achieves 93.46% Doppler unfolding accuracy. Compared to YOLOv7, a state-of-the-art image-based object detection network, TDRadarNet, achieves a 70.3% average precision (AP) for vehicle detection, demonstrating a 21.0% improvement; TDRadarNet+ achieves a 73.9% AP, showing a 24.6% improvement in performance.

ROD2021 Challenge

Radar Object Detection Using Data Merging, Enhancement and Fusion.

RADAR: Road Obstacle Identification for Disaster Response Leveraging Cross-Domain Urban Data

RODNet: A Real-Time Radar Object Detection Network Cross-Supervised by Camera-Radar Fused Object 3D Localization

RODNet: Radar Object Detection Using Cross-Modal Supervision

Scene-aware Learning Network for Radar Object Detection

Rethinking of Radar's Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment

ROFusion: Efficient Object Detection using Hybrid Point-wise Radar-Optical Fusion

Robust Radar Inertial Odometry in Dynamic 3D Environments

Research of Target Detection and Classification Techniques Using Millimeter-Wave Radar and Vision Sensors

RaDICaL: A Synchronized FMCW Radar, Depth, IMU and RGB Camera Data Dataset With Low-Level FMCW Radar Signals

Radar Object Detection Using 3D-2D Encoder-Decoder Network

CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar

RADDet: Range-Azimuth-Doppler based Radar Object Detection for Dynamic Road Users

Beyond Point Clouds: A Knowledge-Aided High Resolution Imaging Radar Deep Detector for Autonomous Driving

V2X-R: Cooperative LiDAR-4D Radar Fusion for 3D Object Detection with Denoising Diffusion

The Human Activity Radar Challenge: benchmarking based on the 'Radar signatures of human activities' dataset from Glasgow University

Deep-Neural-Network-Enabled Vehicle Detection Using High-Resolution Automotive Radar Imaging

Vision meets mmWave Radar: 3D Object Perception Benchmark for Autonomous Driving

K-Radar: 4D Radar Object Detection for Autonomous Driving in Various Weather Conditions