Abstract:Advanced driver assistance systems (ADASs) and autonomous vehicles rely on different types of sensors, such as camera, radar, ultrasonic, and LiDAR, to sense the surrounding environment. Compared with the other types of sensors, millimeter-wave automotive radar has advantages in terms of cost and reliability under bad weather conditions (e.g., snow, rain, and fog) and does not suffer from light condition variations (e.g., darkness). Typical radar devices used in today's commercial vehicles with ADAS features produce sparse point clouds in low angular resolution with a limited number of antennas. In this article, we present a machine-learning-aided signal processing chain to suppress the radar imaging blur effect introduced by the phase migration in time-division multiplexing multiple-input multiple-output radar, to generate low-level high-resolution radar bird's-eye view (BEV) spectra with rich object's features. Compared with radar point clouds, there is no information loss in radar BEV spectra. We then propose a temporal-fusion distance-tolerant single-stage object detection network, termed as TDRadarNet, and an enhanced version, TDRadarNet+, to robustly detect vehicles in both long and short ranges on radar BEVs. We introduce a first-of-its-kind multimodel dataset, containing 14 800 frames of high-resolution low-level radar BEV spectra with synchronized stereo camera RGB images and 3-D LiDAR point clouds. Our dataset achieves 0.39-m range resolution and 1.2 degrees degree azimuth angular resolution with 100-m maximum detectable range. Moreover, we create a subdataset, the Doppler Unfolding dataset, containing 244 140 beam vectors extracted from the 3-D radar data cube. With extensive testing and evaluation, we demonstrate that our Doppler unfolding network achieves 93.46% Doppler unfolding accuracy. Compared to YOLOv7, a state-of-the-art image-based object detection network, TDRadarNet, achieves a 70.3% average precision (AP) for vehicle detection, demonstrating a 21.0% improvement; TDRadarNet+ achieves a 73.9% AP, showing a 24.6% improvement in performance.

Spatial and Temporal Awareness Network for Semantic Segmentation on Automotive Radar Point Cloud

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

Deep Instance Segmentation with Automotive Radar Detection Points

A Neural Network Based System for Efficient Semantic Segmentation of Radar Point Clouds

ERASE-Net: Efficient Segmentation Networks for Automotive Radar Signals

Semantic Segmentation of Radar Detections using Convolutions on Point Clouds

Simultaneous Clutter Detection and Semantic Segmentation of Moving Objects for Automotive Radar Data

Spectranet: A High Resolution Imaging Radar Deep Neural Network for Autonomous Vehicles.

Human Semantic Segmentation using Millimeter-Wave Radar Sparse Point Clouds

PCGNet: Point Cloud Generation Network for 3D Perception using Monocular Images and Radar

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

Radar Instance Transformer: Reliable Moving Instance Segmentation in Sparse Radar Point Clouds

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

TransRadar: Adaptive-Directional Transformer for Real-Time Multi-View Radar Semantic Segmentation

MUFASA: Multi-View Fusion and Adaptation Network with Spatial Awareness for Radar Object Detection

RadarNet: Exploiting Radar for Robust Perception of Dynamic Objects

Scene-aware Learning Network for Radar Object Detection

RGB and LiDAR Fusion-based 3D Semantic Segmentation for Autonomous Driving

Deep-Neural-Network-Enabled Vehicle Detection Using High-Resolution Automotive Radar Imaging

SVQNet: Sparse Voxel-Adjacent Query Network for 4D Spatio-Temporal LiDAR Semantic Segmentation