Abstract:Instance segmentation needs to locate all instances in an image correctly and segment each instance precisely. Currently, the most dominant methods for instance segmentation take object detection as a pre-task. However, they rely on the accuracy of object detection incredibly. If the pre-task cannot predict an accurate bounding box, the performance of instance segmentation will degenerate. In this paper, we present a novel method for instance segmentation to solve this problem, which is called S egmenting B eyond the B ounding B ox ( S3B-Net ). Our S3B-Net designs a sub-network to help instance segmentation methods based on object detection to segment the part of an instance beyond the bounding box. Specifically, the sub-network first predicts a two-dimensional pixel embedding for each pixel. Then, the Gaussian function is employed to calculate a pixel’s probability belongs to a corresponding instance according to the two-dimensional pixel embedding. Finally, the output of the sub-network combines with the output of instance segmentation based on object detection to generate a more precise instance mask. Our sub-network can easily extend on the existing instance segmentation method based on object detection to segment instance beyond the bounding box. We do our experiments on dominant instance segmentation datasets, such as the COCO dataset and Cityscapes dataset. The results show that our method can achieve 6.8 points gain compared with the baseline Mask R-CNN with ResNet-50-FPN in Cityscapes datasets, and 1.7 points gain with ResNet-101-FPN-DCN in COCO datasets. Our S3B-Net outperforms the previous state-of-the-art instance segmentation method, which proves our method is competitive. The source code of our method will be made available.

A Super-pixel Based Method for Instance Segmentation Post-processing

Improving Semantic Image Segmentation with a Probabilistic Superpixel-Based Dense Conditional Random Field.

A New Method for Image Superpixel Segmentation

Interactive Image Segmentation Based on Hierarchical Superpixels Initialization and Region Merging

Fast and robust superpixel generation method

Image superpixel segmentation based on hierarchical multi-level LI-SLIC

Automatic Image Segmentation with Superpixels and Image-Level Labels.

An Error-Controlled Method For Superpixel Segmentation

The Image Segmentation Based on Optimized Spatial Feature of Superpixel

Adaptive and Fast Image Superpixel Segmentation Approach.

Mask SSD: an Effective Single-Stage Approach to Object Instance Segmentation

Semasuperpixel - A Multi-Channel Probability-Driven Superpixel Segmentation Method.

Cluster-based fine-to-coarse superpixel segmentation

Small-scale Image Semantic Segmentation Method Based on Multi-level Superposition and Enhancement Fusion

Adaptive Superpixel Segmentation Aggregating Local Contour and Texture Features

A High Resolution Remote Sensing Image Segmentation Method by Combining Superpixels with Minimum Spanning Tree

Salient Object Segmentation Based on Superpixel and Background Connectivity Prior.

MSP : Refine Boundary Segmentation via Multiscale Superpixel

Superpixels Segmentation Via Growing Minimum Spanning Trees and Reassigning Boundary Pixels

Segmenting Beyond the Bounding Box for Instance Segmentation.

A Novel Image Segmentation Method Based on Random Walk Combined with Superpixel Layer and Robust Sampling Prior