Abstract:Instance segmentation is a core computer vision task with great practical significance. Recent advances, driven by large-scale benchmark datasets, have yielded good general-purpose Convolutional Neural Network (CNN)-based methods. Natural Resource Monitoring (NRM) utilizes remote sensing imagery with generally known scale and containing multiple overlapping instances of the same class, wherein the object contours are jagged and highly irregular. This is in stark contrast with the regular man-made objects found in classic benchmark datasets. We address this problem and propose a novel instance segmentation method geared towards NRM imagery. We formulate the problem as Bayesian maximum a posteriori inference which, in learning the individual object contours, incorporates shape, location, and position priors from state-of-the-art CNN architectures, driving a simultaneous level-set evolution of multiple object contours. We employ loose coupling between the CNNs that supply the priors and the active contour process, allowing a drop-in replacement of new network architectures. Moreover, we introduce a novel prior for contour shape, namely, a class of Deep Shape Models based on architectures from Generative Adversarial Networks (GANs). These Deep Shape Models are in essence a non-linear generalization of the classic Eigenshape formulation. In experiments, we tackle the challenging, real-world problem of segmenting individual dead tree crowns and delineating precise contours. We compare our method to two leading general-purpose instance segmentation methods - Mask R-CNN and K-net - on color infrared aerial imagery. Results show our approach to significantly outperform both methods in terms of reconstruction quality of tree crown contours. Furthermore, use of the GAN-based deep shape model prior yields significant improvement of all results over the vanilla Eigenshape prior.

Image Segmentation with Topological Priors

LEARNING SHAPE PRIORS BY PAIRWISE COMPARISON FOR ROBUST SEMANTIC SEGMENTATION

Topology-Preserving Segmentation Network: A Deep Learning Segmentation Framework for Connected Component

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Semantic segmentation of microscopic neuroanatomical data by combining topological priors with encoder–decoder deep networks

Weakly Supervised Segmentation by a Deep Geodesic Prior

Topograph: An efficient Graph-Based Framework for Strictly Topology Preserving Image Segmentation

Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation

Using Image Priors to Improve Scene Understanding

Nonparametric Joint Shape and Feature Priors for Image Segmentation

PI-Att: Topology Attention for Segmentation Networks through Adaptive Persistence Image Representation

Anatomically plausible segmentations: Explicitly preserving topology through prior deformations

Learning with Explicit Shape Priors for Medical Image Segmentation

Deep Learning Shape Priors for Object Segmentation

Segmenting objects with Bayesian fusion of active contour models and convnet priors

Topologically Faithful Multi-class Segmentation in Medical Images

Towards Robust Perception Using Topological Invariants

Learning what and where to segment: A new perspective on medical image few-shot segmentation

Deep vessel segmentation with joint multi-prior encoding

A Top-Down Manner-Based DCNN Architecture for Semantic Image Segmentation.

A Learning-based Framework for Topology-Preserving Segmentation using Quasiconformal Mappings