Abstract:Statistical shape models are an essential tool for various tasks in medical image analysis, including shape generation, reconstruction and classification. Shape models are learned from a population of example shapes, which are typically obtained through segmentation of volumetric medical images. In clinical practice, highly anisotropic volumetric scans with large slice distances are prevalent, e.g., to reduce radiation exposure in CT or image acquisition time in MR imaging. For existing shape modeling approaches, the resolution of the emerging model is limited to the resolution of the training shapes. Therefore, any missing information between slices prohibits existing methods from learning a high-resolution shape prior. We propose a novel shape modeling approach that can be trained on sparse, binary segmentation masks with large slice distances. This is achieved through employing continuous shape representations based on neural implicit functions. After training, our model can reconstruct shapes from various sparse inputs at high target resolutions beyond the resolution of individual training examples. We successfully reconstruct high-resolution shapes from as few as three orthogonal slices. Furthermore, our shape model allows us to embed various sparse segmentation masks into a common, low-dimensional latent space – independent of the acquisition direction, resolution, spacing, and field of view. We show that the emerging latent representation discriminates between healthy and pathological shapes, even when provided with sparse segmentation masks. Lastly, we qualitatively demonstrate that the emerging latent space is smooth and captures characteristic modes of shape variation. We evaluate our shape model on two anatomical structures: the lumbar vertebra and the distal femur, both from publicly available datasets.

Deformable segmentation via sparse representation and dictionary learning.

Deformable Segmentation Via Sparse Shape Representation.

Joint CRF and Locality-Consistent Dictionary Learning for Semantic Segmentation.

Shape prior modeling using sparse representation and online dictionary learning.

LEARNING SHAPE PRIORS BY PAIRWISE COMPARISON FOR ROBUST SEMANTIC SEGMENTATION

Towards Robust and Effective Shape Modeling: Sparse Shape Composition

Sparse shape composition: A new framework for shape prior modeling

Learning Universal Shape Dictionary for Realtime Instance Segmentation

Efficient Sparse Shape Composition with Its Applications in Biomedical Image Analysis: an Overview

Object Segmentation Framework Based on Dictionary-Group and Sparse Shape Representation

Shape Sparse Representation for Joint Object Classification and Segmentation

Simultaneous variational image segmentation and object recognition via shape sparse representation

Shared Latent Membership Enables Joint Shape Abstraction and Segmentation With Deformable Superquadrics

Learning continuous shape priors from sparse data with neural implicit functions

Point-Based Geometric Deformable Models for Medical Image Segmentation

Target-Oriented Shape Modeling With Structure Constraint For Image Segmentation

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects

Cross Modality Deformable Segmentation Using Hierarchical Clustering and Learning.

Discriminative Learning for Deformable Shape Segmentation: A Comparative Study

Transductive 3d Shape Segmentation Using Sparse Reconstruction