Abstract:Object detection is one of the core tasks in autonomous driving perception systems. Most perception algorithms commonly use cameras and LiDAR sensors, but the robustness is insufficient in harsh environments such as heavy rain and fog. Moreover, velocity of objects is crucial for identifying motion states. The next generation of 4D millimeter-wave radar retains traditional radar advantages in robustness and speed measurement, while also providing height information, higher resolution and density. 4D radar has great potential in the field of 3D object detection. However, existing methods overlook the need for specific feature extraction modules for 4D millimeter-wave radar, which can lead to potential information loss. In this study, we propose RadarPillarDet, a novel approach for extracting features from 4D radar to achieve high-quality object detection. Specifically, our method introduces a dual-stream encoder (DSE) module, which combines traditional multilayer perceptron and attention-based methods. The DSE module serves as a powerful point feature extractor that enhances feature dimensions. Compared to other methods, Sum-Avg-Max Pillar Encoding (SAMPE) module effectively enriches the features of sparse radar point clouds by collecting various pillar features using three different encoders. Additionally, to effectively address the issue of noise points in 4D radar, the designed multi-pillar self-attention (MPSA) module can adaptively learn the weights of different pillar features, thereby enhancing the quality of the 4D radar bird's eye view (BEV) features. Experimental results on the View of Delft (VoD) dataset show that the proposed RadarPillarDet achieves excellent detection performance, with a performance 3.22% mAP higher than the baseline.

Enhanced 3D Object Detection Using 4D Radar and Vision Fusion with Segmentation Assistance

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

RaViDeep: Target Detection Based on Deep Fusion of Radar and Vision in Berthing Scenarios

TL-4DRCF:A Two-Level 4D Radar-Camera Fusion Method for Object Detection in Adverse Weather

SPV-SSD: An Anchor-Free 3D Single-Stage Detector with Supervised-PointRendering and Visibility Representation

MVFAN: Multi-View Feature Assisted Network for 4D Radar Object Detection

RadarPillarDet: Multi-Pillar Feature Fusion with 4D Millimeter-Wave Radar for 3D Object Detection

MUFASA: Multi-View Fusion and Adaptation Network with Spatial Awareness for Radar Object Detection

L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detection

HGSFusion: Radar-Camera Fusion with Hybrid Generation and Synchronization for 3D Object Detection

LXL: LiDAR Excluded Lean 3D Object Detection with 4D Imaging Radar and Camera Fusion

3D Object Detection Algorithm in Adverse Weather Conditions Based on LiDAR-Radar Fusion

CenterRadarNet: Joint 3D Object Detection and Tracking Framework using 4D FMCW Radar

RADIANT: Radar-Image Association Network for 3D Object Detection

RaCFormer: Towards High-Quality 3D Object Detection via Query-based Radar-Camera Fusion

Traffic Object Detection for Autonomous Driving Fusing LiDAR and Pseudo 4D-Radar under Bird’s-Eye-View

V2X-R: Cooperative LiDAR-4D Radar Fusion for 3D Object Detection with Denoising Diffusion

SMURF: Spatial Multi-Representation Fusion for 3D Object Detection with 4D Imaging Radar

SCKD: Semi-Supervised Cross-Modality Knowledge Distillation for 4D Radar Object Detection

RadarOcc: Robust 3D Occupancy Prediction with 4D Imaging Radar