Abstract:Object detection is one of the core tasks in autonomous driving perception systems. Most perception algorithms commonly use cameras and LiDAR sensors, but the robustness is insufficient in harsh environments such as heavy rain and fog. Moreover, velocity of objects is crucial for identifying motion states. The next generation of 4D millimeter-wave radar retains traditional radar advantages in robustness and speed measurement, while also providing height information, higher resolution and density. 4D radar has great potential in the field of 3D object detection. However, existing methods overlook the need for specific feature extraction modules for 4D millimeter-wave radar, which can lead to potential information loss. In this study, we propose RadarPillarDet, a novel approach for extracting features from 4D radar to achieve high-quality object detection. Specifically, our method introduces a dual-stream encoder (DSE) module, which combines traditional multilayer perceptron and attention-based methods. The DSE module serves as a powerful point feature extractor that enhances feature dimensions. Compared to other methods, Sum-Avg-Max Pillar Encoding (SAMPE) module effectively enriches the features of sparse radar point clouds by collecting various pillar features using three different encoders. Additionally, to effectively address the issue of noise points in 4D radar, the designed multi-pillar self-attention (MPSA) module can adaptively learn the weights of different pillar features, thereby enhancing the quality of the 4D radar bird's eye view (BEV) features. Experimental results on the View of Delft (VoD) dataset show that the proposed RadarPillarDet achieves excellent detection performance, with a performance 3.22% mAP higher than the baseline.

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

RadarPillarDet: Multi-Pillar Feature Fusion with 4D Millimeter-Wave Radar for 3D Object Detection

Multi-Modal and Multi-Scale Fusion 3D Object Detection of 4D Radar and LiDAR for Autonomous Driving

FusionPillars: A 3D Object Detection Network with Cross-Fusion and Self-Fusion

InterFusion: Interaction-based 4D Radar and LiDAR Fusion for 3D Object Detection

RI-Fusion: 3D Object Detection Using Enhanced Point Features With Range-Image Fusion for Autonomous Driving.

TL-4DRCF:A Two-Level 4D Radar-Camera Fusion Method for Object Detection in Adverse Weather

L4DR: LiDAR-4DRadar Fusion for Weather-Robust 3D Object Detection

Radar-Lidar Fusion for Object Detection by Designing Effective Convolution Networks

Enhanced 3D Object Detection Using 4D Radar and Vision Fusion with Segmentation Assistance

Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection

Traffic Object Detection for Autonomous Driving Fusing LiDAR and Pseudo 4D-Radar under Bird’s-Eye-View

Context-Aware Fusion for 3D Object Detection in LiDAR-Camera Systems

Deep LiDAR-Radar-Visual Fusion for Object Detection in Urban Environments

BAFusion: Bidirectional Attention Fusion for 3D Object Detection Based on LiDAR and Camera

Instance Fusion for Addressing Imbalanced Camera and Radar Data

RCFusion: Fusing 4-D Radar and Camera with Bird's-Eye View Features for 3-D Object Detection.

Improved Pillar with Fine-grained Feature for 3D Object Detection

PAFNet: Pillar Attention Fusion Network for Vehicle–Infrastructure Cooperative Target Detection Using LiDAR

Bridging the View Disparity Between Radar and Camera Features for Multi-Modal Fusion 3D Object Detection

RaLiBEV: Radar and LiDAR BEV Fusion Learning for Anchor Box Free Object Detection System