Real-Time Recognition Method of Vehicle Taillight Signal Based on Video Understanding

Jing Lian,Tangpeng Gu,Linhui Li
DOI: https://doi.org/10.1007/s42154-024-00295-y
2024-01-01
Automotive Innovation
Abstract:Vehicle taillight signals contain a wealth of semantic information crucial for inferring the leading vehicle's driving intentions. In this paper, to enhance the recognition accuracy, optimize the hardware requirements for deployment, and reduce the model reasoning time, a lightweight method for taillight signal recognition is proposed. This method involves three stages: detection, tracking, and recognition. Firstly, the lightweight MCA-YOLOv5 network is designed for the detection of vehicle rears. Subsequently, the detection results are tracked via the Bytetrack algorithm, resulting in tracking sequences. Finally, the TSA-X3d network aims to effectively obtain spatio-temporal information from the tracking sequences and recognize the taillight signals. The experimental results indicate that the MCA-YOLOv5s network significantly outperforms its precursor—the original YOLOv5s model—in efficiency and size. Specifically, the model size, parameter count, and computational demand of the proposed MCA-YOLOv5s network are respectively reduced to 33.33
What problem does this paper attempt to address?