Abstract:Object detection and semantic segmentation are two fundamental techniques for Intelligent Vehicles (IV) and Advanced Driving Assistance System (ADAS). Motivated by recent studies demonstrating that object detection and semantic segmentation are two highly-correlated tasks, this paper handles the problem of joint object detection and semantic segmentation in traffic scenes. Existing methods perform the joint object detection and semantic segmentation by sharing the same backbone network, but always ignore the interactive connection between the subdividing detection branch and segmentation branch, leading to the insufficient interaction between the two branches. Considering this situation, this paper proposes a joint object detection and semantic segmentation model with the cross-attention and inner-attention mechanisms. The cross-attention mechanism enables to build up the essential interaction between the subdividing detection branch and segmentation branch to fully make use of their correlation. In addition, the inner-attention contributes to strengthening the representations of feature maps in the model. Given an image, an encoder-decoder network is firstly used to extract initial feature maps. Then, the inner-attention mechanism is applied to strengthen the initial feature maps to obtain segmentation feature maps. Subsequently, the cross-attention mechanism utilizes the segmentation feature maps to guide the generation of object detection feature maps. Finally, the semantic segmentation is performed on the segmentation feature maps and object detection is performed on the detection feature maps. In the experiments, two well-known public traffic datasets are used to evaluate our model. Our model achieves the highest performance in comparison with several recently-proposed methods. In addition, some ablation studies are conducted to evaluate the proposed inner-attention and cross-attention mechanisms, and experiment results validate their effectiveness.

Integrating visual selective attention model with HOG features for traffic light detection and recognition

A Robust Video Based Traffic Light Detection Algorithm for Intelligent Vehicles

Traffic Light Detection and Recognition for Autonomous Vehicles

Traffic Lights Detection Based on Deep Learning Feature.

Traffic Lights Detection and Recognition Algorithm Based on Multi-feature Fusion

Robust and real-time traffic light recognition based on hierarchical vision architecture

Robust and Real-Time Traffic Lights Recognition in Complex Urban Environments

Unifying Visual Saliency with HOG Feature Learning for Traffic Sign Detection

Vision-Based Traffic Light Detection For Intelligent Vehicles

Traffic light detection and recognition in intersections based on intelligent vehicle

Increasing accuracy of traffic light color detection and recognition using machine learning

Recognition of Traffic Lights in Urban Traffic Scenes Using Color Space Model

Fast Traffic Light Recognition Using a Lightweight Attention-Enhanced Model

The recognition and tracking of traffic lights based on color segmentation and CAMSHIFT for intelligent vehicles

Simultaneous detection and tracking using deep learning and integrated channel feature for ambint traffic light recognition

A Multi-Feature Fusion Based Traffic Light Recognition Algorithm for Intelligent Vehicles

Automatic Traffic Light Detection Using AI for VLC.

Traffic Light Detection Based on Multi-feature Segmentation and Online Selecting Scheme

Traffic lights recognition based on concatenated filtering method

Traffic Lights Recognition Using Image Processing

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms