Abstract:Deep learning (DL) based semantic segmentation methods have achieved excellent performance in biomedical image segmentation, producing high quality probability maps to allow extraction of rich instance information to facilitate good instance segmentation. While numerous efforts were put into developing new DL semantic segmentation models, less attention was paid to a key issue of how to effectively explore their probability maps to attain the best possible instance segmentation. We observe that probability maps by DL semantic segmentation models can be used to generate many possible instance candidates, and accurate instance segmentation can be achieved by selecting from them a set of "optimized" candidates as output instances. Further, the generated instance candidates form a well-behaved hierarchical structure (a forest), which allows selecting instances in an optimized manner. Hence, we propose a novel framework, called hierarchical earth mover's distance (H-EMD), for instance segmentation in biomedical 2D+time videos and 3D images, which judiciously incorporates consistent instance selection with semantic-segmentation-generated probability maps. H-EMD contains two main stages. (1) Instance candidate generation: capturing instance-structured information in probability maps by generating many instance candidates in a forest structure. (2) Instance candidate selection: selecting instances from the candidate set for final instance segmentation. We formulate a key instance selection problem on the instance candidate forest as an optimization problem based on the earth mover's distance (EMD), and solve it by integer linear programming. Extensive experiments on eight biomedical video or 3D datasets demonstrate that H-EMD consistently boosts DL semantic segmentation models and is highly competitive with state-of-the-art methods.

A Progressive Approach for Computing the Earth Mover's Distance

Efficient EMD-based Similarity Search Via Batch Pruning and Incremental Computation (extended Abstract)

A linear approximate algorithm for earth mover's distance with thresholded ground distance

Efficient approximation of Earth Mover's Distance Based on Nearest Neighbor Search

MELODY-JOIN: Efficient Earth Mover's Distance Similarity Joins Using MapReduce

A Novel Earth Mover's Distance Methodology for Image Matching with Gaussian Mixture Models.

Heads-Join: Efficient Earth Mover's Distance Similarity Joins on Hadoop

Towards Bridging the Distribution Gap: Instance to Prototype Earth Mover's Distance for Distribution Alignment.

Video-Based face recognition using earth mover's distance

Relaxed Earth Mover's Distances for Chain- and Tree-connected Spaces and their use as a Loss Function in Deep Learning

Variational Earth Mover's Distance for Image Segmentation

Improved EMD Object Tracking Method

DeepEMD: A Transformer-based Fast Estimation of the Earth Mover's Distance

A novel document similarity measure based on earth mover's distance

On Constant Factor Approximation for Earth Mover Distance over Doubling Metrics

H-EMD: A Hierarchical Earth Mover's Distance Method for Instance Segmentation

Visual Tracking Using Sparse Coding and Earth Mover's Distance.

Approximating the Earth Mover's Distance between sets of geometric objects

A Scene Matching Method with Weighted Hausdorff Distance Based on Edge Measure

Technical Report on A Generic Multi-Dimensional Data Generator for Earth Mover ’ s Distance Similarity Analysis

Shape context based on H-EMD algorithm for shape matching