Abstract:The recognition of road weather conditions can provide environmental information for the autonomous driving systems, enabling them to develop safe driving strategies. Previous studies have utilized cameras or radars to identify road weather conditions, but they were unable to detect specific dry, wet, or snowy road areas. Some methods based on image segmentation can detect these areas, but their performance is limited by the similar features exhibited by dry and wet roads. In this paper, we propose a novel method for segmenting dry, wet, and snowy road areas based on the fusion of images and point cloud reflection intensities. By fusing the point cloud reflection intensity, we enhance the distinction between different road types, thereby improving the accuracy of the segmentation. Furthermore, we address the challenge posed by sparser point cloud data compared to image pixels by introducing a point cloud reflection intensity upsampling method. Unlike other interpolation methods, our proposed method relies on the physical principle that an object’s reflectivity is correlated with its color and texture features, which makes the point cloud reflection intensity obtained by upsampling more reliable. To evaluate the performance of our method, we conducted experiments on a self-collected dataset that contains over 20,000 images. More than 4,000 images were annotated at the pixel level, and each of them was accompanied by corresponding point cloud data. The experimental results demonstrate that our proposed algorithm achieves an impressive mIoU (mean Intersection over Union) of 87.94%. Compared to image segmentation algorithms that do not fuse point clouds, our algorithm achieves an approximately 3% improvement in mIoU, substantiating its effectiveness.

A Hierarchical Scheme of Road Unevenness Perception with LiDAR for Autonomous Driving Comfort

Graph-based ground segmentation of 3D LIDAR in rough area

Integrated Road Information Perception Framework for Road Type Recognition and Adaptive Evenness Assessment

Detecting the Anomalies in LiDAR Pointcloud

Unstructured Road Segmentation Based on Road Boundary Enhancement Point-Cylinder Network Using LiDAR Sensor

Efficient LiDAR Odometry for Autonomous Driving.

Assessing and Mapping of Road Surface Roughness based on GPS and Accelerometer Sensors on Bicycle-Mounted Smartphones

Uncertainty-Aware Point-Cloud Semantic Segmentation for Unstructured Roads

Research on LiDAR point cloud data transformation method based on weighted altitude difference map

Experimental Study of Road Identification by LSTM with Application to Adaptive Suspension Damping Control

A Response-Type Road Anomaly Detection and Evaluation Method for Steady Driving of Automated Vehicles

Point-Based Visual Status Evaluation of Worn Pavement Markings Based on a Feature-Binary-PointNet Network and Shape Descriptors Using LiDAR Point Clouds: A Case Study of an Expressway

Monocular Connected-Vehicle Position Estimation on Sloping and Uneven Roads

Road Weather Condition Recognition via Fusing Images and Upsampled Point Cloud Reflection Intensities

GoComfort: Comfortable Navigation for Autonomous Vehicles Leveraging High-Precision Road Damage Crowdsensing

Safe and Comfortable Motion Planning for Bumpy Road Driving

Surrogate Evaluation Model for Assessing Lane Detection Reliability of Automated Vehicles in Complex Road Environments

Image-Guided Outdoor LiDAR Perception Quality Assessment for Autonomous Driving

Research on Road Environmental Sense Method of Intelligent Vehicle Based on Tracking Check