Abstract:A comprehensive understanding of the environment is essential for ensuring the driving safety of intelligent vehicles. Road surface conditions, e.g., uneven and damaged roads, icy, or slippery surfaces can severely impact driving safety, requiring the vehicle to perceive road surface attributes accurately. Concurrent works have delved into recognizing dynamic or static obstacles with onboard sensors, e.g. , Lidar or Camera. However, how to accurately understand road surface conditions remains elusive. Furthermore, collecting and annotating the data from different real-world terrains can be a burden. The recognition model should be able to extract knowledge from different road surfaces with limited data. For robust road surface recognition across varied data distributions in complex environments, we propose a novel multi-task learning (MTL) framework to leverage the information across different road surfaces regardless of the wetness and illumination conditions, especially in scenarios with limited labeled data. By treating road surface type recognition under different levels of road wetness and illumination as separate tasks, we leverage shared knowledge through optimal transport theory. Based on this, we implement adversarial training using Wasserstein-1 Distance to derive task-invariant features. Additionally, previous research has indicated that such methods may lead to ambiguous classification boundaries in the feature space. We thus incorporate a metric learning objective for enhancing the prediction performance by leveraging the feature similarities. To verify the effectiveness of the proposed method, we conduct detailed experiments on the open-source RSCD dataset and our own newly collected MRSD dataset. The results demonstrate the efficacy and superiority of our method, laying a robust foundation for road surface knowledge sharing and boundary discrimination across varied wetness and illumination conditions in intelligent driving applications.

Multi-Modality Driven LoRA for Adverse Condition Depth Estimation

An Interpretable Image Denoising Framework Via Dual Disentangled Representation Learning

Cross-Modality 3D Multi-Object Tracking under Adverse Weather Via Adaptive Hard Sample Mining

LiDAR Point Cloud Augmentation for Adverse Conditions Using Conditional Generative Model

Adverse Weather-Immune Semantic Segmentation with Unfolded Regularization and Foundation Model Knowledge Distillation for Autonomous Driving

WM-MoE: Weather-aware Multi-scale Mixture-of-Experts for Blind Adverse Weather Removal

Multi-Modal Contrastive Learning for LiDAR Point Cloud Rail-Obstacle Detection in Complex Weather

Vehicle Depth Estimation Based on Monocular Camera in Extreme Weather

AIE-YOLO: Effective object detection method in extreme driving scenarios via adaptive image enhancement

Enhancing road surface recognition via optimal transport and metric learning in task-agnostic intelligent driving environments

Robust Perception under Adverse Conditions for Autonomous Driving Based on Data Augmentation

Language-driven All-in-one Adverse Weather Removal

Weather-oriented Domain Generalization of Semantic Segmentation for Autonomous Driving.

Robust autonomous driving control using deep hybrid-learning network under rainy/snown conditions

Research on Road Scene Understanding of Autonomous Vehicles Based on Multi-Task Learning

Real-Time Environment Condition Classification for Autonomous Vehicles

NiteDR: Nighttime Image De-Raining with Cross-View Sensor Cooperative Learning for Dynamic Driving Scenes

Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving

Monocular Depth Estimation on Adverse Weathers with Curriculum Domain Distribution Alignment

YOLO-Vehicle-Pro: A Cloud-Edge Collaborative Framework for Object Detection in Autonomous Driving under Adverse Weather Conditions

Condition directed Multi-domain Adversarial Learning for Loop Closure Detection.