Abstract:In order to improve the ability of intelligent vehicle to accurately recognize the semantics of the front vehicle, a new method of lamp signal recognition is proposed by combining deep learning with traditional computer vision. Firstly, the method uses YOLOv4 (You Only Look Once) network to detect vehicles and obtain accurate vehicle tail areas; Then, according to the spatial distribution characteristics of the pixels lighting the lamp in hue, saturation, value (HSV), a HSV spatial segmentation method based on region adaptive threshold is proposed to improve the pixel extraction quality; Finally, the deep neural network model is established to train the collected sample data, classify the brake lamp, turn signal lamp and lamp off state according to the information of lighting lamp pixels, and infer the current lamp meaning of the vehicle in front. In this paper, Python3.8, Pytorch1.9 and Opencv3.2 are used as algorithm implementation tools to test the road in the daytime urban traffic scene. The experimental results show that the average accuracy of the algorithm is 81.3%, the accuracy of the left turn signal is 75.8%, and the accuracy of the right turn signal is 76.4%. Article Highlights This paper investigates vehicle lamp signal recognition that is rarely explored in intelligent vehicle perception. A convolutional neural network is trained on the autonomous driving dataset for detection of vehicle tail regions. This paper transforms the image color space and proposes a region-based adaptive threshold for semantic segmentation of vehicle taillights with different hue, saturation and value. This paper constructs a deep neural network for lamp signal classification. Combined with the data collected in the actual traffic scene and the optimized network structure, the judgment of turn signals and brake signals is completed.

Application of Convolutional Neural Networks and Image Processing Algorithms Based on Traffic Video in Vehicle Taillight Detection.

Performance Evaluation of Region-Based Convolutional Neural Networks Toward Improved Vehicle Taillight Detection

A Robust Video Based Traffic Light Detection Algorithm for Intelligent Vehicles

Research on Intelligent Vehicle Lamp Signal Recognition in Traffic Scene

Enhanced Vision-Based Taillight Signal Recognition for Analyzing Forward Vehicle Behavior

An Attention-based Recurrent Convolutional Network for Vehicle Taillight Recognition

Traffic Light Detection and Recognition for Autonomous Vehicles

Nighttime vehicle detection based on illumination visibility recognition

Real-Time Recognition Method of Vehicle Taillight Signal Based on Video Understanding

Simultaneous detection and tracking using deep learning and integrated channel feature for ambint traffic light recognition

The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles

A Highly Efficient Vehicle Taillight Detection Approach Based on Deep Learning

A Vision-based Taillight Intention Detection Method for Intelligent and Connected Vehicles

Application of Image Processing and Three-Dimensional Data Reconstruction Algorithm Based on Traffic Video in Vehicle Component Detection

Traffic Lights Detection Based on Deep Learning Feature.

Robust and Real-Time Traffic Lights Recognition in Complex Urban Environments

Deep Traffic Light Perception with Spatiotemporal Analysis for Autonomous Driving.

Deep CNN-Based Real-Time Traffic Light Detector for Self-Driving Vehicles

Turn Signal Detection During Nighttime by CNN Detector and Perceptual Hashing Tracking

Preceding vehicle detection and tracking adaptive to illumination variation in night traffic scenes based on relevance analysis

Traffic Lights Detection and Recognition Algorithm Based on Multi-feature Fusion