Abstract:The recognition of traffic signs is of great significance to intelligent driving and traffic systems. Most current traffic sign recognition algorithms do not consider the impact of rainy weather. The rain marks will obscure the recognition target in the image, which will lead to the performance degradation of the algorithm, a problem that has yet to be solved. In order to improve the accuracy of traffic sign recognition in rainy weather, we propose a rainy traffic sign recognition algorithm. The algorithm in this paper includes two modules. First, we propose an image deraining algorithm based on the Progressive multi-scale residual network (PMRNet), which uses a multi-scale residual structure to extract features of different scales, so as to improve the utilization rate of the algorithm for information, combined with the Convolutional long-short term memory (ConvLSTM) network to enhance the algorithm's ability to extract rain mark features. Second, we use the CoT-YOLOv5 algorithm to recognize traffic signs on the recovered images. In this paper, in order to improve the performance of YOLOv5 (You-Only-Look-Once, YOLO), the 3 × 3 convolution in the feature extraction module is replaced by the Contextual Transformer (CoT) module to make up for the lack of global modeling capability of Convolutional Neural Network (CNN), thus improving the recognition accuracy. The experimental results show that the deraining algorithm based on PMRNet can effectively remove rain marks, and the evaluation indicators Peak Signal-to-Noise Ratio (PSNR) and Structural Similarity Index Measure (SSIM) are better than the other representative algorithms. The mean Average Precision (mAP) of the CoT-YOLOv5 algorithm on the TT100k datasets reaches 92.1%, which is 5% higher than the original YOLOv5.

ResNet15: Weather Recognition on Traffic Road with Deep Convolutional Neural Network

efficient weather recognition algorithm on highway roads for vehicle guidance

Res2Net-based multi-scale and multi-attention model for traffic scene image classification

Daily Traffic Flow Forecasting Through a Contextual Convolutional Recurrent Neural Network Modeling Inter- and Intra-Day Traffic Patterns.

Deep Learning with Attention Mechanisms for Road Weather Detection

Winter Road Surface Condition Recognition Using A Pretrained Deep Convolutional Network

A Method Based on Deep Learning for Severe Convective Weather Forecast: CNN-BiLSTM-AM (Version 1.0)

Real-Time Environment Condition Classification for Autonomous Vehicles

Design of Efficient Deep Learning models for Determining Road Surface Condition from Roadside Camera Images and Weather Data

Image Deraining and Denoising Convolutional Neural Network ForAutonomous Driving

Research on rainy day traffic sign recognition algorithm based on PMRNet

A classification model of road accumulated snow severity based on the fusion of DeepLabV3 + and U-Net

Weather Classification: A new multi-class dataset, data augmentation approach and comprehensive evaluations of Convolutional Neural Networks

Traffic Sign Recognition Based on Convolutional Neural Network

Urban Remote Sensing Scene Recognition Based on Lightweight Convolution Neural Network

Intelligent Highway Traffic Detection Algorithm based on Deep Learning

Deep Learning-Based Object Detection and Scene Perception under Bad Weather Conditions

Optimized Deep Learning with Learning without Forgetting (LwF) for Weather Classification for Sustainable Transportation and Traffic Safety

Cloud/snow recognition for multispectral satellite imagery based on a multidimensional deep residual network

Severe Convective Weather Classification In Remote Sensing Images By Semantic Segmentation

TRU-NET: A Deep Learning Approach to High Resolution Prediction of Rainfall