Abstract:Segmenting images of low quality or with missing data is a challenging problem. In such scenarios, exploiting statistical prior information about the shapes to be segmented can improve the segmentation results significantly. Incorporating prior density of shapes into a Bayesian framework leads to the posterior density of segmenting shapes given the observed data. Most segmentation algorithms that exploit shape priors optimize a cost function based on the posterior density and find a point estimate (e.g., using maximum a posteriori estimation). However, especially when the prior shape density is multimodal leading to a multimodal posterior density, a point estimate does not provide a measure of the degree of confidence in that result, neither does it provide a picture of other probable solutions based on the observed data and the shape priors. With a statistical view, addressing these issues would involve the problem of characterizing the posterior distributions of the shapes of the objects to be segmented. An analytic computation of such posterior distributions is intractable; however, characterization is still possible through their samples. In this paper, we propose an efficient pseudo-marginal Markov chain Monte Carlo (MCMC) sampling approach to draw samples from posterior shape distributions for image segmentation. The computation time of the proposed approach is independent from the training set size. Therefore, it scales well for very large data sets. In addition to better characterization of the statistical structure of the problem, such an approach has the potential to address issues with getting stuck at local optima, suffered by existing shape-based segmentation methods. Our approach is able to characterize the posterior probability density in the space of shapes through its samples, and to return multiple solutions, potentially from different modes of a multimodal probability density, which would be encountered, e.g., in segmenting objects from multiple shape classes. We present promising results on a variety of synthetic and real data sets.

A Level Set Method with Shape Priors by Using Locality Preserving Projections

Salient Object Segmentation with a Shape-Constrained Level Set

A Nonlinear Adaptive Level Set for Image Segmentation

A Hybrid Level Set with Semantic Shape Constraint for Object Segmentation.

LEARNING SHAPE PRIORS BY PAIRWISE COMPARISON FOR ROBUST SEMANTIC SEGMENTATION

Weakly Supervised Instance Segmentation Using Multi-Prior Fusion.

A Modified Level Set Algorithm Based on Point Distance Shape Constraint for Lesion and Organ Segmentation

Deep Level Set for Box-supervised Instance Segmentation in Aerial Images

An improved level set method for fast image segmentation based on single parameter

DSLSM: Dual-kernel-induced statistic level set model for image segmentation

An Adaptive Shape Subspace Model for Level Set-Based Object Tracking

Local Deep Feature Learning Framework for 3D Shape.

Level Set Active Contours on Unstructured Point Cloud

Weakly Supervised Segmentation by a Deep Geodesic Prior

Nonparametric Joint Shape and Feature Priors for Image Segmentation

Pseudo-Marginal MCMC Sampling for Image Segmentation Using Nonparametric Shape Priors

3D face recognition using local shape map

New Normalized Nonlocal Hybrid Level Set Method for Image Segmentation

Level Set Tracking with Dynamical Shape Priors

Shape Prior Segmentation Guided by Harmonic Beltrami Signature

LSM: Learning Subspace Minimization for Low-Level Vision