Abstract:Advanced driver assistance systems (ADASs) and autonomous vehicles rely on different types of sensors, such as camera, radar, ultrasonic, and LiDAR, to sense the surrounding environment. Compared with the other types of sensors, millimeter-wave automotive radar has advantages in terms of cost and reliability under bad weather conditions (e.g., snow, rain, and fog) and does not suffer from light condition variations (e.g., darkness). Typical radar devices used in today's commercial vehicles with ADAS features produce sparse point clouds in low angular resolution with a limited number of antennas. In this article, we present a machine-learning-aided signal processing chain to suppress the radar imaging blur effect introduced by the phase migration in time-division multiplexing multiple-input multiple-output radar, to generate low-level high-resolution radar bird's-eye view (BEV) spectra with rich object's features. Compared with radar point clouds, there is no information loss in radar BEV spectra. We then propose a temporal-fusion distance-tolerant single-stage object detection network, termed as TDRadarNet, and an enhanced version, TDRadarNet+, to robustly detect vehicles in both long and short ranges on radar BEVs. We introduce a first-of-its-kind multimodel dataset, containing 14 800 frames of high-resolution low-level radar BEV spectra with synchronized stereo camera RGB images and 3-D LiDAR point clouds. Our dataset achieves 0.39-m range resolution and 1.2 degrees degree azimuth angular resolution with 100-m maximum detectable range. Moreover, we create a subdataset, the Doppler Unfolding dataset, containing 244 140 beam vectors extracted from the 3-D radar data cube. With extensive testing and evaluation, we demonstrate that our Doppler unfolding network achieves 93.46% Doppler unfolding accuracy. Compared to YOLOv7, a state-of-the-art image-based object detection network, TDRadarNet, achieves a 70.3% average precision (AP) for vehicle detection, demonstrating a 21.0% improvement; TDRadarNet+ achieves a 73.9% AP, showing a 24.6% improvement in performance.

A Deep Learning Approach for Doppler Unfolding in Automotive TDM MIMO Radar

People Flow Detection Algorithm Based on a Multiencoder-Classifier Cotraining Architecture for FMCW Radar.

A Sidelobe Suppression Algorithm for 77 GHz MIMO Radars

3-D Motion Imaging in a Multipath Coordinate Space Based on a TDM-MIMO Radar Sensor

Phase Difference based Doppler Disambiguation Method for TDM-MIMOFMCW Radars

Joint Doppler Frequency and Direction of Arrival Estimation for TDM MIMO Automotive Radars

Transmit Beamspace DDMA Based Automotive MIMO Radar

Beyond Point Clouds: A Knowledge-Aided High Resolution Imaging Radar Deep Detector for Autonomous Driving

Random Time Division Multiplexing Based MIMO Radar Processing with Tensor Completion Approach

MIMO Radar Waveform Design for Multipath Exploitation Using Deep Learning

Multi-Radar Inertial Odometry for 3D State Estimation using mmWave Imaging Radar

Deep-Neural-Network-Enabled Vehicle Detection Using High-Resolution Automotive Radar Imaging

Deep Learning-Based Link Configuration for Radar-Aided Multiuser Mmwave Vehicle-to-Infrastructure Communication

Deep-Learning-Based Velocity Estimation for FMCW Radar With Random Pulse Position Modulation

TDM-MIMO Automotive Radar Point-Cloud Detection Based on the 2-D Hybrid Sparse Antenna Array

3D high-resolution imaging algorithm using 1D MIMO array for autonomous driving application

FOUR-DIMENSIONAL HIGH-RESOLUTION AUTOMOTIVE RADAR IMAGING EXPLOITING JOINT SPARSE-FREQUENCY AND SPARSE-ARRAY DESIGN

Radar Aided mmWave Vehicle-to-InfrastructureLink Configuration Using Deep Learning

Multi-Channel Back-Projection Algorithm for Mmwave Automotive MIMO SAR Imaging With Doppler-Division Multiplexing

Fast Forward-Backward Hankel Matrix Completion for Automotive Radar DOA Estimation Using Sparse Linear Arrays

Deep Learning Based Computationally Efficient Unrolling IAA for Direction-of-Arrival Estimation