Abstract:3D object detection, as the core of the autonomous vehicle perception module, is essential for efficient transportation and comfortable experiences. However, the challenge of 3D object detection under adverse weather conditions hinders the advancement of autonomous vehicles to higher levels. Hence, achieving accurate 3D object detection under adverse weather conditions is increasingly crucial as it forms the foundation for trajectory planning and driving strategy making in autonomous vehicles, thereby revolutionizing transportation modes for both goods and passengers. Advances in Light Detection and Ranging (LiDAR) technology have facilitated the development of 3D object detection in the past few years. Adverse weather, which inevitably occurs in real-world driving scenarios, could degrade measurement accuracy and point density of LiDAR and lead to particle interference. Detecting accurate 3D bounding boxes from sparse, incomplete point clouds with particle interference is difficult. Therefore, this research presents a novel geometric information constraint network for 3D object detection tasks from LiDAR point clouds under adverse weather (GIC-Net). In this study, we focus on how to incorporate geometric location information and line geometric feature information into the network against adverse weather. Further, we propose a geometric location constrained backbone module (GLC) to reduce rain and snow particle interference and ensure sufficient receptive fields. Then, we design a line geometric feature constraint module (LGFC) to add line constraints of 3D bounding boxes into the training process. Finally, a line loss function is designed, and features from the GLC and LGFC modules are fed into the multi-task detection head for accurate 3D bounding box prediction. Experiments on the Canadian Adverse Driving Conditions (CADC) autonomous vehicle dataset demonstrate the superiority of our method over six other state-of-the-art methods under adverse weather, which is at least 13.32 %, 4.67 %, and 10.44 % mAP higher than the other compared methods in the car, truck, and pedestrian classes respectively. Also, we further verify the better generalization ability of our network compared to other methods.

Multi-Modal Contrastive Learning for LiDAR Point Cloud Rail-Obstacle Detection in Complex Weather

Robust Artificial Intelligence-Aided Multimodal Rail-Obstacle Detection Method by Rail Track Topology Reconstruction

Improved 3D Object Detector Under Snowfall Weather Condition Based on LiDAR Point Cloud

Geometric information constraint 3D object detection from LiDAR point cloud for autonomous vehicles under adverse weather

Cross-Modal Self-Supervised Learning with Effective Contrastive Units for LiDAR Point Clouds

Robust-FusionNet: Deep Multimodal Sensor Fusion for 3-D Object Detection Under Severe Weather Conditions

3D Object Detection Algorithm in Adverse Weather Conditions Based on LiDAR-Radar Fusion

Directed Mix Contrast for Lidar Point Cloud Segmentation

On-road multiple obstacles detection using color images and LiDAR point clouds

ImLiDAR: Cross-Sensor Dynamic Message Propagation Network for 3-D Object Detection

Robust 3D Semantic Segmentation Method Based on Multi-Modal Collaborative Learning

Roadside LiDAR Vehicle Detection and Tracking Using Range and Intensity Background Subtraction

Long-Tailed 3D Detection via Multi-Modal Fusion

Multimodal 3D Object Detection on Unseen Domains

Snow-CLOCs: Camera-LiDAR Object Candidate Fusion for 3D Object Detection in Snowy Conditions

Future Does Matter: Boosting 3D Object Detection with Temporal Motion Estimation in Point Cloud Sequences

Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Driving

MSL3D: 3D object detection from monocular, stereo and point cloud for autonomous driving

CFPC: The Curbed Fake Point Collector to Pseudo-LiDAR-Based 3D Object Detection for Autonomous Vehicles

LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection

3D Multi-object Detection and Tracking with Sparse Stationary LiDAR