Abstract:In order to improve the ability of intelligent vehicle to accurately recognize the semantics of the front vehicle, a new method of lamp signal recognition is proposed by combining deep learning with traditional computer vision. Firstly, the method uses YOLOv4 (You Only Look Once) network to detect vehicles and obtain accurate vehicle tail areas; Then, according to the spatial distribution characteristics of the pixels lighting the lamp in hue, saturation, value (HSV), a HSV spatial segmentation method based on region adaptive threshold is proposed to improve the pixel extraction quality; Finally, the deep neural network model is established to train the collected sample data, classify the brake lamp, turn signal lamp and lamp off state according to the information of lighting lamp pixels, and infer the current lamp meaning of the vehicle in front. In this paper, Python3.8, Pytorch1.9 and Opencv3.2 are used as algorithm implementation tools to test the road in the daytime urban traffic scene. The experimental results show that the average accuracy of the algorithm is 81.3%, the accuracy of the left turn signal is 75.8%, and the accuracy of the right turn signal is 76.4%. Article Highlights This paper investigates vehicle lamp signal recognition that is rarely explored in intelligent vehicle perception. A convolutional neural network is trained on the autonomous driving dataset for detection of vehicle tail regions. This paper transforms the image color space and proposes a region-based adaptive threshold for semantic segmentation of vehicle taillights with different hue, saturation and value. This paper constructs a deep neural network for lamp signal classification. Combined with the data collected in the actual traffic scene and the optimized network structure, the judgment of turn signals and brake signals is completed.

Deep Traffic Light Perception with Spatiotemporal Analysis for Autonomous Driving.

Traffic Lights Detection Based on Deep Learning Feature.

Simultaneous detection and tracking using deep learning and integrated channel feature for ambint traffic light recognition

Short-Term Forecasting of Traffic Flow and Speed: A Deep Learning Approach

Vehicle-Related Scene Understanding Using Deep Learning

Deep CNN-Based Real-Time Traffic Light Detector for Self-Driving Vehicles

Traffic Light Detection and Recognition for Autonomous Vehicles

Traffic-light Sign Recognition Using Capsule Network

Deep learning-based perception systems for autonomous driving: A comprehensive survey

Spatiotemporal Analysis of Static and Dynamic Traffic Elements from Road Scenes.

Vision-Based Traffic Light Detection For Intelligent Vehicles

Driving Assistance System Based on Deep Learning and Traditional Vision

Research on Intelligent Vehicle Lamp Signal Recognition in Traffic Scene

Traffic Light Recognition Using Deep Learning and Prior Maps for Autonomous Cars

Robust and Real-Time Traffic Lights Recognition in Complex Urban Environments

A Vision-Based Method for Improving the Safety of Self-Driving

Real-Time Traffic Light Detection with Adaptive Background Suppression Filter

Spatial-Temproal Based Lane Detection Using Deep Learning

Real-time Full-stack Traffic Scene Perception for Autonomous Driving with Roadside Cameras

TLD-READY: Traffic Light Detection -- Relevance Estimation and Deployment Analysis

Traffic Lights Detection and Recognition Algorithm Based on Multi-feature Fusion