Abstract:We present a novel explicit shape representation for instance segmentation. Based on how to model the object shape, current instance segmentation systems can be divided into two categories, implicit and explicit models. The implicit methods, which represent the object mask/contour by intractable network parameters, and produce it through pixel-wise classification, are predominant. However, the explicit methods, which parameterize the shape with simple and explainable models, are less explored. Since the operations to generate the final shape are light-weighted, the explicit methods have a clear speed advantage over implicit methods, which is crucial for real-world applications. The proposed USD-Seg adopts a linear model, sparse coding with dictionary, for object shapes. First, it learns a dictionary from a large collection of shape datasets, making any shape being able to be decomposed into a linear combination through the dictionary. Hence the name "Universal Shape Dictionary". Then it adds a simple shape vector regression head to ordinary object detector, giving the detector segmentation ability with minimal overhead. For quantitative evaluation, we use both average precision (AP) and the proposed Efficiency of AP (AP$_E$) metric, which intends to also measure the computational consumption of the framework to cater to the requirements of real-world applications. We report experimental results on the challenging COCO dataset, in which our single model on a single Titan Xp GPU achieves 35.8 AP and 27.8 AP$_E$ at 65 fps with YOLOv4 as base detector, 34.1 AP and 28.6 AP$_E$ at 12 fps with FCOS as base detector.

Discovery of Topical Object in Image Collections

Discovery of Topical Objects from Video: A Structured Dictionary Learning Approach

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Building a Dictionary of Image Fragments

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Discovery of the Topical Object in Commercial Video: A Sparse Coding Method

Learning Universal Shape Dictionary for Realtime Instance Segmentation

A Combing Top-Down And Bottom-Up Discriminative Dictionaries Learning For Non-Specific Object Detection

Unsupervised Object Discovery Via Object-Centric Representation

Dataset-driven Unsupervised Object Discovery for Region-based Instance Image Retrieval

Discover and Learn New Objects from Documentaries

Knowledge-Guided Object Discovery with Acquired Deep Impressions

Object retrieval using configurations of salient regions

Discovering Objects that Can Move

Unsupervised Object Discovery and Co-Localization by Deep Descriptor Transforming

Look Further to Recognize Better: Learning Shared Topics and Category-Specific Dictionaries for Open-Ended 3D Object Recognition

Detection and Segmentation of Unlearned Objects in Unknown Environment

Salient Region Detection and Segmentation for General Object Recognition and Image Understanding

Unsupervised regions based segmentation using object discovery

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Object Segmentation Framework Based on Dictionary-Group and Sparse Shape Representation