Abstract:The recognition of road weather conditions can provide environmental information for the autonomous driving systems, enabling them to develop safe driving strategies. Previous studies have utilized cameras or radars to identify road weather conditions, but they were unable to detect specific dry, wet, or snowy road areas. Some methods based on image segmentation can detect these areas, but their performance is limited by the similar features exhibited by dry and wet roads. In this paper, we propose a novel method for segmenting dry, wet, and snowy road areas based on the fusion of images and point cloud reflection intensities. By fusing the point cloud reflection intensity, we enhance the distinction between different road types, thereby improving the accuracy of the segmentation. Furthermore, we address the challenge posed by sparser point cloud data compared to image pixels by introducing a point cloud reflection intensity upsampling method. Unlike other interpolation methods, our proposed method relies on the physical principle that an object’s reflectivity is correlated with its color and texture features, which makes the point cloud reflection intensity obtained by upsampling more reliable. To evaluate the performance of our method, we conducted experiments on a self-collected dataset that contains over 20,000 images. More than 4,000 images were annotated at the pixel level, and each of them was accompanied by corresponding point cloud data. The experimental results demonstrate that our proposed algorithm achieves an impressive mIoU (mean Intersection over Union) of 87.94%. Compared to image segmentation algorithms that do not fuse point clouds, our algorithm achieves an approximately 3% improvement in mIoU, substantiating its effectiveness.

Research on ROI Region Detection Methods of Meteorological Image in Expressway Scenes

ROI Adaptive Segmentation Method Based on Vanishing Point and Vehicle Height

Integrating Visual and Range Data for Road Detection.

Multi-scale Vehicle Detection Method for Expressway Based on YOLOv7.

Research on Methods of Expressway Vehicle Detection under Abnormal Weather Conditions Based on Deep Learning

Expressway visibility estimation based on image entropy and piecewise stationary time series analysis

Road vanishing point detection using Weber local descriptor

ROI perspective transform based road marking detection and recognition

Visibility Detection Approach to Road Scene Foggy Images

An ROI Optimization Method Based on Dynamic Estimation Adjustment Model

Road Weather Condition Recognition via Fusing Images and Upsampled Point Cloud Reflection Intensities

Research on Traffic Sign Detection and Recognition in Fog Based on Yolov5

Structural Road Identification and Tracking Algorithm Based on Maximum Correlation Criterion Image Segmentation

More Interesting Regions: an Efficient Road Segmentation Method Based on Vanishing Point.

Vanishing Point Estimation for Challenging Road Images.

Fast Defogging and Restoration Assessment Approach to Road Scene Images.

Image defogging method for road traffic in haze days

YOLO-TSF: A Small Traffic Sign Detection Algorithm for Foggy Road Scenes

New Efficient Vanishing Point Detection from A Single Road Image Based on Intrinsic Line Orientation and Color Texture Properties

Fast and Robust Vanishing Point Detection Using Contourlet Texture Detector for Unstructured Road

Saliency and Density Enhanced Region-of-interest Extraction for Large-Scale High-Resolution Remote Sensing Images