Abstract:In this paper, we address the tasks of detecting, segmenting, parsing, and matching deformable objects. We use a novel probabilistic object model that we call a hierarchical deformable template (HDT). The HDT represents the object by state variables defined over a hierarchy (with typically five levels). The hierarchy is built recursively by composing elementary structures to form more complex structures. A probability distribution--a parameterized exponential model--is defined over the hierarchy to quantify the variability in shape and appearance of the object at multiple scales. To perform inference--to estimate the most probable states of the hierarchy for an input image--we use a bottom-up algorithm called compositional inference. This algorithm is an approximate version of dynamic programming where approximations are made (e.g., pruning) to ensure that the algorithm is fast while maintaining high performance. We adapt the structure-perceptron algorithm to estimate the parameters of the HDT in a discriminative manner (simultaneously estimating the appearance and shape parameters). More precisely, we specify an exponential distribution for the HDT using a dictionary of potentials, which capture the appearance and shape cues. This dictionary can be large and so does not require handcrafting the potentials. Instead, structure-perceptron assigns weights to the potentials so that less important potentials receive small weights (this is like a "soft" form of feature selection). Finally, we provide experimental evaluation of HDTs on different visual tasks, including detection, segmentation, matching (alignment), and parsing. We show that HDTs achieve state-of-the-art performance for these different tasks when evaluated on data sets with groundtruth (and when compared to alternative algorithms, which are typically specialized to each task).

Learning Hierarchical Dictionary For Shape Patterns

Topology Preserving Dictionary Learning for Pattern Classification.

Full and Partial Shape Similarity Through Sparse Descriptor Reconstruction

LEARNING SHAPE PRIORS BY PAIRWISE COMPARISON FOR ROBUST SEMANTIC SEGMENTATION

Shape Representation and Recognition in High Dimensional Feature Space

Linear Discrimination Dictionary Learning for Shape Descriptors

Multiscale Dictionary Learning for Hierarchical Sparse Representation.

Nested Dictionary Learning for Hierarchical Organization of Imagery and Text

Local Deep Feature Learning Framework for 3D Shape.

Unsupervised Learning of Dictionaries of Hierarchical Compositional Models

Learning Universal Shape Dictionary for Realtime Instance Segmentation

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

Multi-level Discriminative Dictionary Learning with Application to Large Scale Image Classification.

Shape prior modeling using sparse representation and online dictionary learning.

Learning a discriminative deformation-invariant 3D shape descriptor via many-to-one encoder.

Deformable segmentation via sparse representation and dictionary learning.

DeepShape: Deep-Learned Shape Descriptor for 3D Shape Retrieval

Discriminative structured dictionary learning with hierarchical group sparsity

Learning a hierarchical deformable template for rapid deformable object parsing

Constructing Hierarchical Visual Tree for Discriminative Image Representation and Classification.

Object Segmentation Framework Based on Dictionary-Group and Sparse Shape Representation