Abstract:Instance segmentation is a core computer vision task with great practical significance. Recent advances, driven by large-scale benchmark datasets, have yielded good general-purpose Convolutional Neural Network (CNN)-based methods. Natural Resource Monitoring (NRM) utilizes remote sensing imagery with generally known scale and containing multiple overlapping instances of the same class, wherein the object contours are jagged and highly irregular. This is in stark contrast with the regular man-made objects found in classic benchmark datasets. We address this problem and propose a novel instance segmentation method geared towards NRM imagery. We formulate the problem as Bayesian maximum a posteriori inference which, in learning the individual object contours, incorporates shape, location, and position priors from state-of-the-art CNN architectures, driving a simultaneous level-set evolution of multiple object contours. We employ loose coupling between the CNNs that supply the priors and the active contour process, allowing a drop-in replacement of new network architectures. Moreover, we introduce a novel prior for contour shape, namely, a class of Deep Shape Models based on architectures from Generative Adversarial Networks (GANs). These Deep Shape Models are in essence a non-linear generalization of the classic Eigenshape formulation. In experiments, we tackle the challenging, real-world problem of segmenting individual dead tree crowns and delineating precise contours. We compare our method to two leading general-purpose instance segmentation methods - Mask R-CNN and K-net - on color infrared aerial imagery. Results show our approach to significantly outperform both methods in terms of reconstruction quality of tree crown contours. Furthermore, use of the GAN-based deep shape model prior yields significant improvement of all results over the vanilla Eigenshape prior.

Objective Segmentation Based on Shape Prior and Contour Pre-positioning

Upper Body Human Detection and Segmentation in Low Contrast Video

Human Body Segmentation Based on Shape Constraint

A Hybrid Level Set with Semantic Shape Constraint for Object Segmentation.

Shape Prior Segmentation Guided by Harmonic Beltrami Signature

Shape Prior-Constrained Deep Learning Network for Medical Image Segmentation

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

Color image segmentation based on shape prior and graph cuts

Global structure constrained local shape prior estimation for medical image segmentation

Automated Medical Image Segmentation Based on FCM and LBF Model

Automatic Segmentation of Head-and-Shoulder Images by Combining Edge Feature and Shape Prior

Shape Degeneration and Multi-object Search Basing on Multi-shape Priors.

Convexity Shape Prior for Level Set-Based Image Segmentation Method

Active Contours with Group Similarity

A New Automatic Human Body Slice Segmentation Method Based on Closed -Form Solution Matting and Distance Transform

C2FC: Coarse-to-fine Contour-Based Method for Interactive Medical Image Segmentation

Target-Oriented Shape Modeling With Structure Constraint For Image Segmentation

Automated Lumen Segmentation in Carotid Artery Ultrasound Images Based on Adaptive Generated Shape Prior

Segmenting objects with Bayesian fusion of active contour models and convnet priors

Salient Object Segmentation with a Shape-Constrained Level Set

Segmentation Based on Shape Prior and Graph Model Optimization