A Coarse-to-Fine Deep Learning Based Framework for Traffic Light Recognition
Jie Fu,Zikai Yao,Qing Li,Qing Ye,Qiang Liu,Qian Xie,Bo Li
DOI: https://doi.org/10.1109/TITS.2024.3390576
2024-10-01
Abstract:Accurate recognition of traffic light plays a crucial role in ensuring road traffic safety. Due to the wide variety of traffic light classes and the inherent conflict between location determination and intra-class classification of traffic lights, existing deep learning-based methods cannot obtain satisfactory results, making them still unreliable as traffic light recognizers. To address this issue, we propose an effective Coarse-to-fine framework for traffic light recognition, which is consisted of an enhanced super class detector and a fine-grained classifier. The main contributions lie in three aspects. Firstly, we determine the optimal number of super class by adopting a clustering algorithm. It can alleviate the effect caused by similar classes of traffic light. Secondly, we enhance the super class detector by introducing an additional prediction layer, which enable utilizing the shadow features and improving the detection performance of traffic light super class. Lastly, we propose a fine-grained classifier based on depth-wise separable convolution and expansion layer for super class candidate classification. It can achieve superior recognition performance of different traffic lights especially for similar classes. To evaluate the effectiveness of our method, we conduct experiments on WPI (Worcester Polytechnic Institute) traffic light dataset. With an input size of $416\,\,{\times }\,\,416$ pixels, the proposed method can achieve a precision of 99.04% and a recall of 97.40% with a speed of 9.9ms. Compared with other state-of-the-art methods, the results demonstrate the significant competitiveness of our method and its high effectiveness for traffic light recognition.
Engineering,Computer Science