Abstract:We present a novel explicit shape representation for instance segmentation. Based on how to model the object shape, current instance segmentation systems can be divided into two categories, implicit and explicit models. The implicit methods, which represent the object mask/contour by intractable network parameters, and produce it through pixel-wise classification, are predominant. However, the explicit methods, which parameterize the shape with simple and explainable models, are less explored. Since the operations to generate the final shape are light-weighted, the explicit methods have a clear speed advantage over implicit methods, which is crucial for real-world applications. The proposed USD-Seg adopts a linear model, sparse coding with dictionary, for object shapes. First, it learns a dictionary from a large collection of shape datasets, making any shape being able to be decomposed into a linear combination through the dictionary. Hence the name "Universal Shape Dictionary". Then it adds a simple shape vector regression head to ordinary object detector, giving the detector segmentation ability with minimal overhead. For quantitative evaluation, we use both average precision (AP) and the proposed Efficiency of AP (AP$_E$) metric, which intends to also measure the computational consumption of the framework to cater to the requirements of real-world applications. We report experimental results on the challenging COCO dataset, in which our single model on a single Titan Xp GPU achieves 35.8 AP and 27.8 AP$_E$ at 65 fps with YOLOv4 as base detector, 34.1 AP and 28.6 AP$_E$ at 12 fps with FCOS as base detector.

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

3D Graph-S<SUP>2</SUP>Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution

3D Shape Segmentation Using Soft Density Peak Clustering and Semi-Supervised Learning

Semi-supervised 3D shape segmentation with multilevel consistency and part substitution

Semi-Supervised 3D Shape Segmentation via Self Refining

3D Shape Co-segmentation by Combining Sparse Representation with Extreme Learning Machine.

Learning Universal Shape Dictionary for Realtime Instance Segmentation

Unsupervised Co-Segmentation of 3D Shapes Via Affinity Aggregation Spectral Clustering.

Unsupervised Shape Co-segmentation Based on Transformation Network

AdaCoSeg: Adaptive Shape Co-Segmentation with Group Consistency Loss

Superpoint-guided Semi-supervised Semantic Segmentation of 3D Point Clouds

Shape-aware Semi-supervised 3D Semantic Segmentation for Medical Images

iSeg3D: An Interactive 3D Shape Segmentation Tool

Unsupervised Part Segmentation through Disentangling Appearance and Shape

Deep Learning based 3D Segmentation: A Survey

Image-driven Unsupervised 3D Model Co-Segmentation

Local Deep Feature Learning Framework for 3D Shape.

Transductive 3d Shape Segmentation Using Sparse Reconstruction

Weakly Supervised 3D Instance Segmentation without Instance-level Annotations

Unsupervised 3D Learning for Shape Analysis Via Multiresolution Instance Discrimination