Abstract:We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task, instead of relying on hand-engineered representations. Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks. The networks operate on unordered point clouds and provide invariance to similarity transformations, avoiding the need to identify point correspondences between shapes. Based on the framework, we assemble a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes. In particular, we propose a conditional generative model, where the condition vector provides a mechanism to control the generative process. instance, it enables to assess shape variations specific to a particular diagnosis, when passing it as side information. Next to working on single shapes, we introduce an extension for the joint analysis of multiple anatomical structures, where the simultaneous modeling of multiple structures can lead to a more compact encoding and a better understanding of disorders. We demonstrate the advantages of our framework in comprehensive experiments on real and synthetic data. The key insights are that (i) learning a shape representation specific to the given task yields higher performance than alternative shape descriptors, (ii) multi-structure analysis is both more efficient and more accurate than single-structure analysis, and (iii) point clouds generated by our model capture morphological differences associated to Alzheimers disease, to the point that they can be used to train a discriminative model for disease classification. Our framework naturally scales to the analysis of large datasets, giving it the potential to learn characteristic variations in large populations.

Automatic Shape Model Construction in Multiscale Space

Shape Representation and Recognition in High Dimensional Feature Space

Neighborhood Aided Implicit Active Contours

Segmentation Through Point-based Multiscale Deformable Model

Learning Contour-Based Mid-Level Representation for Shape Classification

Multiscale shape context and re-ranking for deformable shape retrieval

Contour Guided Hierarchical Model For Shape Matching

Construction of 3D Dynamic Statistical Deformable Models for Complex Topological Shapes

Shape Matching under Affine Transformation Using Normalization and Multi-Scale Area Integral Features

Multiscale Mesh Deformation Component Analysis with Attention-based Autoencoders

Multi-part shape matching by simultaneous partial functional correspondence

Subject Specific Shape Modeling with Incremental Mixture Models

Deformation-Guided Unsupervised Non-Rigid Shape Matching

Discriminative Learning for Deformable Shape Segmentation: A Comparative Study

Multi-level contour combination features for shape recognition

Learning a discriminative deformation-invariant 3D shape descriptor via many-to-one encoder.

Contour Based Shape Matching For Object Recognition

Self-supervised Learning of Implicit Shape Representation with Dense Correspondence for Deformable Objects

Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks

Object detection via structural feature selection and shape model

Finding Deformable Shapes by Correspondence-Free Instantiation and Registration of Statistical Shape Models.