Abstract:Traffic sign recognition (TSR) technology allows the vehicle to recognize road signs through a camera and use it for driving. For traffic safety, TSR is one of the core technologies constituting advanced driver assistance systems (ADAS), and several researches have been studied. The advent of convolutional neural networks (CNNs) has opened up new possibilities in automotive environments, especially for ADAS. However, deploying a real-time TSR application in resource-constrained ADAS is challenging because most CNNs require high computing resources and memory usage. To address this problem, some works have been studied to consider optimization in embedded platforms, but existing works used many hardware resources or showed low computation performance. In this paper, we propose a low-cost CNN-based real-time TSR hardware accelerator. Firstly, we extend a novel hardware-friendly quantization method to reduce computational complexity. The quantization method can reconstruct the CNN so that all operations, including the skip connection path of residual blocks, use only integer arithmetic and reduce the computational overhead by replacing the quantization affine mapping process with a shift operation. Secondly, the proposed hardware accelerator applied two parallelization strategies to balance real-time inference and resource consumption. In addition, we present a simple and effective hardware design scheme that handles the skip connection path of residual blocks. This design scheme can optimize the dataflow of the skip connection path and reduce additional internal memory usage. Experimental results show that the reconstructed fully integer-based CNN only requires 24M integer operations (IOPs) and possesses a model size of 0.17MB. Compared with the previous work, the proposed CNN model size was reduced by , and the number of operations was reduced by . In addition, the proposed CNN can achieve a TSR accuracy of 99.07%, which is the highest accuracy among CNN-based TSR works implemented on embedded platforms. The proposed hardware accelerator achieves a computation performance of 960 MOPS and a frame rate of 40 FPS when implemented on a Xilinx ZC706 SoC. Consequently, this work improves by and on computation performance and frame rate compared to the previous work.

FPGA-based Convolution Neural Network for Traffic Sign Recognition

An Efficient Framework for Detection and Recognition of Numerical Traffic Signs

An edge implementation of a traffic sign detection system for Advanced driver Assistance Systems

A Low-Cost Fully Integer-Based CNN Accelerator on FPGA for Real-Time Traffic Sign Recognition

Traffic Sign Detection With Event Cameras and DCNN

Traffic Sign Recognition Based on Convolutional Neural Network

Simplified Neural Networks with Smart Detection for Road Traffic Sign Recognition

Toward Effective Traffic Sign Detection via Two-Stage Fusion Neural Networks

A Novel Convolutional Neural Network Based Architecture for Object Detection and Recognition with an Application to Traffic Sign Recognition from Road Scenes

Real-time traffic sign detection network using DS-DetNet and lite fusion FPN

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Research on Detection and Recognition of Traffic Signs Based on Convolutional Neural Networks

An FPGA-Based Hardware Accelerator for Traffic Sign Detection

A feature‐enhanced hybrid attention network for traffic sign recognition in real scenes

A storage-efficient SNN–CNN hybrid network with RRAM-implemented weights for traffic signs recognition

Autonomous traffic sign detection for self-driving car system using convolutional neural network algorithm

Efficient Traffic-Sign Recognition with Scale-aware CNN

Improved Traffic Sign Detection and Recognition Algorithm for Intelligent Vehicles

A Lightweight Convolutional Neural Network (CNN) Architecture for Traffic Sign Recognition in Urban Road Networks

A Traffic Sign Recognition Method Under Complex Illumination Conditions

PSG-Yolov5: A Paradigm for Traffic Sign Detection and Recognition Algorithm Based on Deep Learning