Abstract:Instance segmentation is a core computer vision task with great practical significance. Recent advances, driven by large-scale benchmark datasets, have yielded good general-purpose Convolutional Neural Network (CNN)-based methods. Natural Resource Monitoring (NRM) utilizes remote sensing imagery with generally known scale and containing multiple overlapping instances of the same class, wherein the object contours are jagged and highly irregular. This is in stark contrast with the regular man-made objects found in classic benchmark datasets. We address this problem and propose a novel instance segmentation method geared towards NRM imagery. We formulate the problem as Bayesian maximum a posteriori inference which, in learning the individual object contours, incorporates shape, location, and position priors from state-of-the-art CNN architectures, driving a simultaneous level-set evolution of multiple object contours. We employ loose coupling between the CNNs that supply the priors and the active contour process, allowing a drop-in replacement of new network architectures. Moreover, we introduce a novel prior for contour shape, namely, a class of Deep Shape Models based on architectures from Generative Adversarial Networks (GANs). These Deep Shape Models are in essence a non-linear generalization of the classic Eigenshape formulation. In experiments, we tackle the challenging, real-world problem of segmenting individual dead tree crowns and delineating precise contours. We compare our method to two leading general-purpose instance segmentation methods - Mask R-CNN and K-net - on color infrared aerial imagery. Results show our approach to significantly outperform both methods in terms of reconstruction quality of tree crown contours. Furthermore, use of the GAN-based deep shape model prior yields significant improvement of all results over the vanilla Eigenshape prior.

Convolutional Oriented Boundaries: From Image Segmentation to High-Level Tasks

Boundary-aware Graph Convolution for Semantic Segmentation.

Contour Proposal Networks for Biomedical Instance Segmentation

Boundary-Aware Instance Segmentation

Theoretically Achieving Continuous Representation of Oriented Bounding Boxes

Boundary Objectness Network For Object Detection And Localization

Object Contour Detection with a Fully Convolutional Encoder-Decoder Network

CT-Bound: Robust Boundary Detection From Noisy Images Via Hybrid Convolution and Transformer Neural Networks

Push-the-Boundary: Boundary-aware Feature Propagation for Semantic Segmentation of 3D Point Clouds

Boundary Attention: Learning curves, corners, junctions and grouping

Segmenting objects with Bayesian fusion of active contour models and convnet priors

BoundarySqueeze: Image Segmentation as Boundary Squeezing

COCO-Occ: A Benchmark for Occluded Panoptic Segmentation and Image Understanding

Occlusion-Aware Instance Segmentation via BiLayer Network Architectures

Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentation

BI-GCN: Boundary-Aware Input-Dependent Graph Convolution Network for Biomedical Image Segmentation

Joint Boundary-Aware Method and Bayesian Inference for Object Proposal

BAN: Focusing on Boundary Context for Object Detection

Boundary-Area Enhanced Module for Instance Segmentation

DOC: Deep OCclusion Estimation From a Single Image

Object segmentation by Oriented Image Foresting Transform with connectivity constraints