Abstract:In recent years, LiDAR has emerged as one of the primary sensors for mobile robots, enabling accurate detection of 3D objects. On the other hand, 4D millimeter-wave Radar presents several advantages which can be a complementary for LiDAR, including an extended detection range, enhanced sensitivity to moving objects, and the ability to operate seamlessly in various weather conditions, making it a highly promising technology. To leverage the strengths of both sensors, this paper proposes a novel fusion method that combines LiDAR and 4D millimeter-wave Radar for 3D object detection. The proposed approach begins with an efficient multi-modal feature extraction technique utilizing a pillar representation. This method captures comprehensive information from both LiDAR and millimeter-wave Radar data, facilitating a holistic understanding of the environment. Furthermore, a Pillar Attention Fusion (PAF) module is employed to merge the extracted features, enabling seamless integration and fusion of information from both sensors. This fusion process results in lightweight detection headers capable of accurately predicting object boxes. To evaluate the effectiveness of our proposed approach, extensive experiments were conducted on the VoD dataset. The experimental results demonstrate the superiority of our fusion method, showcasing improved performance in terms of detection accuracy and robustness across different environmental conditions. The fusion of LiDAR and 4D millimeter-wave Radar holds significant potential for enhancing the capabilities of mobile robots in real-world scenarios. The proposed method, with its efficient multi-modal feature extraction and attention-based fusion, provides a reliable and effective solution for 3D object detection.

LiDAR-Camera Fusion: Guided Vehicle-to-Aircraft Sensing with Cooperative Vehicle Infrastructure

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

EMIFF: Enhanced Multi-scale Image Feature Fusion for Vehicle-Infrastructure Cooperative 3D Object Detection

Intelligent Driving Vehicle Object Detection Based on Improved AVOD Algorithm for the Fusion of LiDAR and Visual Information

LiDAR-based End-to-end Temporal Perception for Vehicle-Infrastructure Cooperation

Occlusion-Guided Multi-Modal Fusion for Vehicle-Infrastructure Cooperative 3D Object Detection

Enhancing 3D object detection through multi-modal fusion for cooperative perception

Multi-sensor fusion algorithm in cooperative vehicle-infrastructure system for blind spot warning

CoBEVFusion: Cooperative Perception with LiDAR-Camera Bird's-Eye View Fusion

VIPS: Real-Time Perception Fusion for Infrastructure-Assisted Autonomous Driving

Estimation of Closest In-Path Vehicle (CIPV) by Low-Channel LiDAR and Camera Sensor Fusion for Autonomous Vehicle

Real time object detection using LiDAR and camera fusion for autonomous driving

VIMI: Vehicle-Infrastructure Multi-view Intermediate Fusion for Camera-based 3D Object Detection

Radar and Camera Fusion for Multi-Task Sensing in Autonomous Driving

Cooperative Visual Augmentation Algorithm of Intelligent Vehicle Based on Inter-Vehicle Image Fusion

Adaptive Feature Fusion for Cooperative Perception using LiDAR Point Clouds

Intelligent Perception System for Vehicle-Road Cooperation

PAFNet: Pillar Attention Fusion Network for Vehicle–Infrastructure Cooperative Target Detection Using LiDAR

Cooper: Cooperative Perception for Connected Autonomous Vehicles based on 3D Point Clouds

DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection

Real-Time Vehicle Detection Framework Based on the Fusion of LiDAR and Camera