Abstract:Object detection and image recognition are some of the most significant and challenging branches in the field of computer vision. The prosperous development of unmanned driving technology has made the detection and recognition of traffic signs crucial. Affected by diverse factors such as light, the presence of small objects, and complicated backgrounds, the results of traditional traffic sign detection technology are not satisfactory. To solve this problem, this paper proposes two novel traffic sign detection models, called YOLOv5-DH and YOLOv5-TDHSA, based on the YOLOv5s model with the following improvements (YOLOv5-DH uses only the second improvement): (1) replacing the last layer of the 'Conv + Batch Normalization + SiLU' (CBS) structure in the YOLOv5s backbone with a transformer self-attention module (T in the YOLOv5-TDHSA's name), and also adding a similar module to the last layer of its neck, so that the image information can be used more comprehensively, (2) replacing the YOLOv5s coupled head with a decoupled head (DH in both models' names) so as to increase the detection accuracy and speed up the convergence, and (3) adding a small-object detection layer (S in the YOLOv5-TDHSA's name) and an adaptive anchor (A in the YOLOv5-TDHSA's name) to the YOLOv5s neck to improve the detection of small objects. Based on experiments conducted on two public datasets, it is demonstrated that both proposed models perform better than the original YOLOv5s model and three other state-of-the-art models (Faster R-CNN, YOLOv4-Tiny, and YOLOv5n) in terms of the mean accuracy (mAP) and F1 score, achieving mAP values of 77.9% and 83.4% and F1 score values of 0.767 and 0.811 on the TT100K dataset, and mAP values of 68.1% and 69.8% and F1 score values of 0.71 and 0.72 on the CCTSDB2021 dataset, respectively, for YOLOv5-DH and YOLOv5-TDHSA. This was achieved, however, at the expense of both proposed models having a bigger size, greater number of parameters, and slower processing speed than YOLOv5s, YOLOv4-Tiny and YOLOv5n, surpassing only Faster R-CNN in this regard. The results also confirmed that the incorporation of the T and SA improvements into YOLOv5s leads to further enhancement, represented by the YOLOv5-TDHSA model, which is superior to the other proposed model, YOLOv5-DH, which avails of only one YOLOv5s improvement (i.e., DH).

Traffic sign detection based on classic visual recognition models

An Efficient Framework for Detection and Recognition of Numerical Traffic Signs

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Traffic Signs Detection and Recognition System using Deep Learning

A Traffic Sign Recognition Method Under Complex Illumination Conditions

Traffic Sign Recognition from Digital Images by Using Deep Learning

Two Novel Models for Traffic Sign Detection Based on YOLOv5s

The Improved Framework for Traffic Sign Recognition Using Guided Image Filtering

Traffic sign recognition based on deep learning

A Novel Convolutional Neural Network Based Architecture for Object Detection and Recognition with an Application to Traffic Sign Recognition from Road Scenes

An Improved Traffic Sign Detection and Recognition Deep Model Based on YOLOv5

Deep Learning-Based Real-Time Traffic Sign Recognition System for Urban Environments

Research on Detection and Recognition of Traffic Signs Based on Convolutional Neural Networks

Traffic Sign Detection Based on SSD.

Traffic Sign Detection by ROI Extraction and Histogram Features-Based Recognition

YOLOv7-TS: A Traffic Sign Detection Model Based on Sub-Pixel Convolution and Feature Fusion

Traffic Sign Detection and Recognition for Autonomous Driving in Virtual Simulation Environment

A Lightweight Convolutional Neural Network (CNN) Architecture for Traffic Sign Recognition in Urban Road Networks

Autonomous traffic sign detection for self-driving car system using convolutional neural network algorithm

Traffic Sign Detection and Classification

Improved detection method for traffic signs in real scenes applied in intelligent and connected vehicles