Abstract:Traffic sign recognition (TSR) technology allows the vehicle to recognize road signs through a camera and use it for driving. For traffic safety, TSR is one of the core technologies constituting advanced driver assistance systems (ADAS), and several researches have been studied. The advent of convolutional neural networks (CNNs) has opened up new possibilities in automotive environments, especially for ADAS. However, deploying a real-time TSR application in resource-constrained ADAS is challenging because most CNNs require high computing resources and memory usage. To address this problem, some works have been studied to consider optimization in embedded platforms, but existing works used many hardware resources or showed low computation performance. In this paper, we propose a low-cost CNN-based real-time TSR hardware accelerator. Firstly, we extend a novel hardware-friendly quantization method to reduce computational complexity. The quantization method can reconstruct the CNN so that all operations, including the skip connection path of residual blocks, use only integer arithmetic and reduce the computational overhead by replacing the quantization affine mapping process with a shift operation. Secondly, the proposed hardware accelerator applied two parallelization strategies to balance real-time inference and resource consumption. In addition, we present a simple and effective hardware design scheme that handles the skip connection path of residual blocks. This design scheme can optimize the dataflow of the skip connection path and reduce additional internal memory usage. Experimental results show that the reconstructed fully integer-based CNN only requires 24M integer operations (IOPs) and possesses a model size of 0.17MB. Compared with the previous work, the proposed CNN model size was reduced by , and the number of operations was reduced by . In addition, the proposed CNN can achieve a TSR accuracy of 99.07%, which is the highest accuracy among CNN-based TSR works implemented on embedded platforms. The proposed hardware accelerator achieves a computation performance of 960 MOPS and a frame rate of 40 FPS when implemented on a Xilinx ZC706 SoC. Consequently, this work improves by and on computation performance and frame rate compared to the previous work.

A storage-efficient SNN–CNN hybrid network with RRAM-implemented weights for traffic signs recognition

A Low-Cost Fully Integer-Based CNN Accelerator on FPGA for Real-Time Traffic Sign Recognition

Efficient Traffic-Sign Recognition with Scale-aware CNN

A Three-Stage Real-Time Detector for Traffic Signs in Large Panoramas

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Study on Traffic Sign Recognition by Optimized Lenet-5 Algorithm

MambaTSR: You only need 90k parameters for traffic sign recognition

Reducing SRAM Reading Power with Column Data Segment and Weights Correlation Enhancement for CNN Processing.

FPGA-based Convolution Neural Network for Traffic Sign Recognition

An Attention Based YOLOv5 Network for Small Traffic Sign Recognition

Training Low Bitwidth Convolutional Neural Network on RRAM

A Traffic-Sign Detection Algorithm Based on Improved Sparse R-cnn

A lightweight network architecture for traffic sign recognition based on enhanced LeNet-5 network

Research on Detection and Recognition of Traffic Signs Based on Convolutional Neural Networks

Real-time traffic sign detection network using DS-DetNet and lite fusion FPN

Binary Convolutional Neural Network on RRAM.

Investigating Binary Neural Networks for Traffic Sign Detection and Recognition

Low Bit-Width Convolutional Neural Network on RRAM

A Traffic Sign Recognition System Based on Lightweight Network Learning

A feature‐enhanced hybrid attention network for traffic sign recognition in real scenes

Evaluation of Robust Spatial Pyramid Pooling Based on Convolutional Neural Network for Traffic Sign Recognition System