Abstract:In recent years, LiDAR has emerged as one of the primary sensors for mobile robots, enabling accurate detection of 3D objects. On the other hand, 4D millimeter-wave Radar presents several advantages which can be a complementary for LiDAR, including an extended detection range, enhanced sensitivity to moving objects, and the ability to operate seamlessly in various weather conditions, making it a highly promising technology. To leverage the strengths of both sensors, this paper proposes a novel fusion method that combines LiDAR and 4D millimeter-wave Radar for 3D object detection. The proposed approach begins with an efficient multi-modal feature extraction technique utilizing a pillar representation. This method captures comprehensive information from both LiDAR and millimeter-wave Radar data, facilitating a holistic understanding of the environment. Furthermore, a Pillar Attention Fusion (PAF) module is employed to merge the extracted features, enabling seamless integration and fusion of information from both sensors. This fusion process results in lightweight detection headers capable of accurately predicting object boxes. To evaluate the effectiveness of our proposed approach, extensive experiments were conducted on the VoD dataset. The experimental results demonstrate the superiority of our fusion method, showcasing improved performance in terms of detection accuracy and robustness across different environmental conditions. The fusion of LiDAR and 4D millimeter-wave Radar holds significant potential for enhancing the capabilities of mobile robots in real-world scenarios. The proposed method, with its efficient multi-modal feature extraction and attention-based fusion, provides a reliable and effective solution for 3D object detection.

A Novel Method for 3D Object Detection in Open-Pit Mine Based on Hybrid Solid-State LiDAR Point Cloud

Robust vehicle detection using 3D Lidar under complex urban environment

Fusing LiDAR and Radar with Pillars Attention for 3D Object Detection

A Study on 3D LiDAR-based Point Cloud Object Detection using an Enhanced PointPillars Network

A Mine Intersection Recognition Method Based on Geometric Invariant Point Detection Using 3D Point Cloud

A Detection and Tracking Method Based on Heterogeneous Multi-Sensor Fusion for Unmanned Mining Trucks

Large-Scale Underground Mine Positioning and Mapping with LiDAR-Based Semantic Intersection Detection

A novel global re-localization method for underground mining vehicles in haulage roadways: A case study of solid-state LiDAR-equipped load-haul-dump vehicles

Deep learning‐based object identification with instance segmentation and pseudo‐LiDAR point cloud for work zone safety

A LiDAR Multi-Object Detection Algorithm for Autonomous Driving

Improved Pillar with Fine-grained Feature for 3D Object Detection

SimMining-3D: Altitude-Aware 3D Object Detection in Complex Mining Environments: A Novel Dataset and ROS-Based Automatic Annotation Pipeline

Pillar-Based 3D Object Detection from Point Cloud with Multiattention Mechanism

Robust GICP-Based 3D LiDAR SLAM for Underground Mining Environment

Efficient Laser-Based 3D SLAM for Coal Mine Rescue Robots

A High-Precision Road Network Construction Method Based on Deep Learning for Unmanned Vehicle in Open Pit

PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds

Real-Time And Robust 3D Object Detection with Roadside LiDARs

Efficient Laser-Based 3D SLAM in Real Time for Coal Mine Rescue Robots