Abstract:Advanced driver assistance systems (ADASs) and autonomous vehicles rely on different types of sensors, such as camera, radar, ultrasonic, and LiDAR, to sense the surrounding environment. Compared with the other types of sensors, millimeter-wave automotive radar has advantages in terms of cost and reliability under bad weather conditions (e.g., snow, rain, and fog) and does not suffer from light condition variations (e.g., darkness). Typical radar devices used in today's commercial vehicles with ADAS features produce sparse point clouds in low angular resolution with a limited number of antennas. In this article, we present a machine-learning-aided signal processing chain to suppress the radar imaging blur effect introduced by the phase migration in time-division multiplexing multiple-input multiple-output radar, to generate low-level high-resolution radar bird's-eye view (BEV) spectra with rich object's features. Compared with radar point clouds, there is no information loss in radar BEV spectra. We then propose a temporal-fusion distance-tolerant single-stage object detection network, termed as TDRadarNet, and an enhanced version, TDRadarNet+, to robustly detect vehicles in both long and short ranges on radar BEVs. We introduce a first-of-its-kind multimodel dataset, containing 14 800 frames of high-resolution low-level radar BEV spectra with synchronized stereo camera RGB images and 3-D LiDAR point clouds. Our dataset achieves 0.39-m range resolution and 1.2 degrees degree azimuth angular resolution with 100-m maximum detectable range. Moreover, we create a subdataset, the Doppler Unfolding dataset, containing 244 140 beam vectors extracted from the 3-D radar data cube. With extensive testing and evaluation, we demonstrate that our Doppler unfolding network achieves 93.46% Doppler unfolding accuracy. Compared to YOLOv7, a state-of-the-art image-based object detection network, TDRadarNet, achieves a 70.3% average precision (AP) for vehicle detection, demonstrating a 21.0% improvement; TDRadarNet+ achieves a 73.9% AP, showing a 24.6% improvement in performance.

A coarse-to-fine vehicle detection in large SAR scenes based on GL-CFAR and PRID R-CNN

Vehicle Target Detection Method for Wide-Area SAR Images Based on Coarse-Grained Judgment and Fine-Grained Detection

Vehicle Localization Method in Complex SAR Images Based on Feature Reconstruction and Aggregation

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

DAR-Net: Dense Attentional Residual Network for Vehicle Detection in Aerial Images

SARNet: Spatial Attention Residual Network for pedestrian and vehicle detection in large scenes

A Fast Progressive Ship Detection Method for Very Large Full-Scene SAR Images

Arbitrary-oriented target detection in large scene sar images

LR-CNN: Local-aware Region CNN for Vehicle Detection in Aerial Imagery

Morphology-Based Feature Extraction Network for Arbitrary-Oriented SAR Vehicle Detection

Efficient Target Detection of Monostatic/Bistatic SAR Vehicle Small Targets in Ultracomplex Scenes via Lightweight Model

A Multiscale Feature Pyramid SAR Ship Detection Network With Robust Background Interference

Integrated Anti-Aliasing and Fully Shared Convolution for Small-Ship Detection in Synthetic Aperture Radar (SAR) Images

Target-Guided Feature Super-Resolution for Vehicle Detection in Remote Sensing Images

CFAR-DP-FW: A CFAR-guided Dual-Polarization Fusion Framework for Large Scene SAR Ship Detection

A Novel Detector Based on Convolution Neural Networks for Multiscale SAR Ship Detection in Complex Background

Learning Efficient Representations for Enhanced Object Detection on Large-scene SAR Images

Stereo priori RCNN based car detection on point level for autonomous driving

Deep-Neural-Network-Enabled Vehicle Detection Using High-Resolution Automotive Radar Imaging

Multi-Scale Rotation-Invariant Haar-Like Feature Integrated CNN-Based Ship Detection Algorithm of Multiple-Target Environment in SAR Imagery

See Further Than CFAR: a Data-Driven Radar Detector Trained by Lidar