Abstract:Models of the object shape play an important role in many image applications such as object detection,image segmentation and inpainting.Compared with the gray,texture,edge and other low-level visual features of the image,shape as high-level visual feature helps to describe the global visual information of an object better.Generally,the performance of algorithm will be improved after global shape information (expressed by a good model) joined.In recent years,deep learning models have attracted more and more attentions because of their excellent learning ability on modeling data with intrinsic structure.Deep learning models contain multiple layers and hidden perception units,which are used to simulate the cognitive mechanism of human brain.They can extract multi-level data features and represent complicated data distributions.They form high-level data abstract representation through combining the lower layer features.A deep learning model learning the representation and abstraction of multiple levels is more helpful to make sense of data,such as shape images.In view of the complicated and changeable object shape,we propose two kinds of shape models based on deep belief network and deep Boltzmann machine,and the methods of two models constructing,training and shape generating in this paper.Both of these two models are deep,hierarchical probabilistic models that make heavy use of hidden units to modal high-order dependencies between the observed units,which can make full use of low-level features and multi-layer high-level features of object shape to describe the probability distribution of training set.They have the potential of learning internal representation that become progressively complex at higher layers.The key feature of these two models is greedy layer-by-layer training that can be repeated several times in order to find a good set of modal parameters quickly,even for modal contains many layers and parameters.Thus they can effectively model the shape,this kind of model not only can express the shape of the training set,but also can generate shape that differ from samples in the training set.The shape change is relatively large when the shape of the training set is multiple categories,the modal can also define the multi-model distribution of the shape set.A deep learning model has strong ability of shape expression and can be applied in many kinds of tasks such as shape generating,shape completion,and denoising.We give some of the experimental results on the Weizmann Horse data set and Caltech101 Silhouettes data set.The results show that compared with the restricted Boltzmann machine model,the proposed two models based on deep learning can express the shape of training set better.The samples generated from the deep models involving structure of multi-layer nonlinear processing are more realistic,and the samples from the deep Boltzmann machine model are much more clear than deep belief network model.Experimental results in the graphical shape and similarity measure illustrate that deep learning model is fit for the training shape,and the model has better generalization ability.

Deep Learning Shape Priors for Object Segmentation

LEARNING SHAPE PRIORS BY PAIRWISE COMPARISON FOR ROBUST SEMANTIC SEGMENTATION

Shape Sparse Representation for Joint Object Classification and Segmentation

Shape Degeneration and Multi-object Search Basing on Multi-shape Priors.

Learning Universal Shape Dictionary for Realtime Instance Segmentation

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Deep Convolutional Neural Networks Meet Variational Shape Compactness Priors for Image Segmentation

Image Segmentation Based on MRF Combining with Deep Learning Shape Priors.

Learning Fine-Grained Segmentation of 3D Shapes without Part Labels

Sparse Convex Combination of Shape Priors for Joint Object Segmentation and Recognition

Deep Optimized Priors for 3D Shape Modeling and Reconstruction

Optimal Multi-Object Segmentation with Novel Gradient Vector Flow Based Shape Priors

Unsupervised 3D Shape Segmentation and Co-Segmentation Via Deep Learning.

Unsupervised Deep Shape Descriptor with Point Distribution Learning.

Shape Modeling Method Based on Deep Learning

Reduced Set Density Estimator For Object Segmentation Based On Shape Probabilistic Representation

Shape Prior-Constrained Deep Learning Network for Medical Image Segmentation

High-level semantic feature for 3D shape based on deep belief networks

Learning Shape Priors for Single-View 3D Completion and Reconstruction

Learning with Explicit Shape Priors for Medical Image Segmentation

Nonparametric Joint Shape and Feature Priors for Image Segmentation