Abstract:For applications such as autonomous vehicles, instance segmentation of captured images about surrounding environments is critical, and in the meantime, these types of tasks require high accuracy as well. However, most existing models do not consider the extra computation caused by complex architectures and the poor ability of overly lightweight structures to capture semantic information. To enable real-time instance segmentation including semantic segmentation and object detection, a new framework based on an encoder–decoder architecture is proposed, which differs from existing work in two aspects: 1) it adopts two branches to generate a prototype and semantic masks and predicts instance class confidence, bounding box and the coefficients of prototype masks and 2) it adds a spatial attention module (SAM) and the Laplacian operator into a loss function for the segmentation branch to refine boundaries. The instance masks are then produced by combining the generated segmentation mask and mask coefficients. An expansion crop training strategy is employed to accelerate training and detection speed and alleviate bad results due to convolutional translation invariance. Extensive experiments are carried out on available public datasets, including Cityscapes Urban and COCO 2017. Results show that the proposed model achieves 38.9 AP on the Cityscapes test set and 46.8 AP on the COCO test set with eight categories of instances. Compared with other state-of-the-art methods for real-time applications, our method reaches 29.0 FPS with improved accuracy.

Toward Efficient Simultaneous Detection and Segmentation.

A Simultaneous Object Detection and Component Segmentation Approach Based on Mask R-CNN

An Efficient Compressive Convolutional Network for Unified Object Detection and Image Compression

High-Resolution Remote Sensing Image Semantic Segmentation Method Based on Improved Encoder-Decoder Convolutional Neural Network

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Multiple receptive fields and small-object-focusing weakly-supervised segmentation network for fast object detection

A Two-Pipeline Instance Segmentation Network via Boundary Enhancement for Scene Understanding

Unifying Instance and Panoptic Segmentation with Dynamic Rank-1 Convolutions

R-FCN plus plus : Towards Accurate Region-Based Fully Convolutional Networks for Object Detection

Hybrid Dilated Convolution Network Using Attentive Kernels for Real-Time Semantic Segmentation

Efficient Object Region Discovery for Weakly-supervised Semantic Segmentation

BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation

Conditional Convolutions for Instance Segmentation

Cascaded panoptic segmentation method for high resolution remote sensing image

A MultiPath Network for Object Detection

A novel fast combine-and-conquer object detector based on only one-level feature map

Cascade Mask Generation Framework for Fast Small Object Detection

An Improved Faster R-CNN for Small Object Detection

FCOS: Fully Convolutional One-Stage Object Detection

An Efficient Object Detection Framework with Modified Dense Connections for Small Objects Optimizations

INS-Conv: Incremental Sparse Convolution for Online 3D Segmentation