Abstract:The instance segmentation of traffic targets in complex road scenes is one of the most challenging tasks in autonomous driving. Unlike the bounding box localization for object detection and the category perception mask for semantic segmentation, instance segmentation requires accurate identification of each object under each category and more precise segmentation and positioning of these target objects. Although instance segmentation has apparent advantages, methods, for instance segmentation in complex road scenes, still need to be discovered. In this paper, we proposed an efficient instance segmentation method TTIS-YOLO(Traffic Target Instance Segmentation - YOLO) based on YOLOV5-7.0 for traffic object segmentation of complex road scenes. Our main work is as follows: to propose a MECSP(Multiscale Efficient Cross Stage Partial Network) module, which has fewer parameters, better cross-layer information exchange, and feature representation capabilities. Propose an Efficient Bidirectional Cross Scale Connection optimization method that enables the network to perform more detailed and efficient feature fusion without losing original information, refining the mask flow. WIoU Loss is used as the loss function of positioning and segmentation, and the positioning performance of the model is effectively improved through the strategy of dynamically allocating gradient gains. Experiments have shown that our proposed TTIS-YOLO outperforms baseline models and other mainstream instances segmentation algorithms such as Mask RCNN, YOLACT, SOLO, and SOLOV2 with the highest segmentation accuracy and fastest inference speed. Our proposed TTIS-YOLO-S achieves the best balance between segmentation accuracy and inference speed. Compared to the baseline model, the AP50 and recall values on the Cityscapes validation set increased by 1.7% and 0.9%, respectively, with a parameter reduction of 20.6%, inference speed of 78.1fps on GeForce RTX 3090Ti. Meanwhile, TTIS-YOLO-L achieved the highest segmentation accuracy, with an AP50 value of 27%, and the model parameter quantity decreased by 35.4% compared to the baseline model.

Fully densely linked and strongly correlated road scene instance segmentation

Fully densely linked and strongly correlated instance segmentation for street-level images

Panoptic Segmentation for Seasonal River Scene Based on Spatial Context Prior and DenseASPP

CenterLPS: Segment Instances by Centers for LiDAR Panoptic Segmentation

Road Traffic Sign Detection Method Based on RTS R-CNN Instance Segmentation Network

Segmenting Against Dense Distribution and Occlusion in Road Scenarios

PSFE-Net: Semantic Segmentation Network for Airborne LiDAR Transmission Corridor Scenes Inspection

Improvement of Road Instance Segmentation Algorithm Based on the Modified Mask R-CNN

Exploiting Low-level Representations for Ultra-Fast Road Segmentation

Panoptic-PolarNet: Proposal-free LiDAR Point Cloud Panoptic Segmentation

TTIS-YOLO: A Traffic Target Instance Segmentation Paradigm for Complex Road Scenarios

MP-PolarMask: A Faster and Finer Instance Segmentation for Concave Images

LiDAR-based Panoptic Segmentation via Dynamic Shifting Network

Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes

LiDAR-based 4D Panoptic Segmentation via Dynamic Shifting Network

Road Scene Segmentation Via Fusing Camera and Lidar Data.

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Seg-Road: A Segmentation Network for Road Extraction Based on Transformer and CNN with Connectivity Structures

FastRoadSeg: Fast Monocular Road Segmentation Network

CPISNet: Delving into Consistent Proposals of Instance Segmentation Network for High-Resolution Aerial Images