Abstract:Non-rigid registration between 3D surfaces is an important but notorious problem in medical imaging, because finding correspondences between non-isometric instances is mathematically non-trivial. We propose a novel self-supervised method to learn shape correspondences directly from a group of bone surfaces segmented from CT scans, without any supervision from time-consuming and error-prone manual annotations. Relying on a Siamese architecture, DiffusionNet as the feature extractor is jointly trained with a pair of randomly rotated and scaled copies of the same shape. The learned embeddings are aligned in spectral domain using eigenfunctions of the Laplace-Beltrami Operator. Additional normalization and regularization losses are incorporated to guide the learned embeddings towards a similar uniform representation over spectrum, which promotes the embeddings to encode multiscale features and advocates sparsity and diagonality of the inferred functional maps. Our method achieves state-of-the-art results among the unsupervised methods on several benchmarks, and presents greater robustness and efficacy in registering moderately deformed shapes. A hybrid refinement strategy is proposed to retrieve smooth and close-to-conformal point-to-point correspondences from the inferred functional map. Our method is orientation and discretization-invariant. Given a pair of near-isometric surfaces, our method automatically computes registration in high accuracy, and outputs anatomically meaningful correspondences. In this study, we show that it is possible to use neural networks to learn general embeddings from 3D shapes in a self-supervised way. The learned features are multiscale, informative, and discriminative, which might potentially benefit almost all types of morphology-related downstream tasks, such as diagnostics, data screening and statistical shape analysis in future.

Learnable Relation with Triplet Formulation for Semi-supervised Medical Image Classification.

Semi-Supervised Relational Contrastive Learning

Semi-supervised Medical Image Classification with Relation-driven Self-ensembling Model

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

Semi-Supervised Dual Relation Learning for Multi-Label Classification

Semi-supervised medical image classification via distance correlation minimization and graph attention regularization

Exploring simple triplet representation learning

A Semi-Supervised Medical Image Classification Method Based on Combined Pseudo-Labeling and Distance Metric Consistency

Semi-supervised biomedical relation classification using generalized expectation criteria.

Application of Semi-Supervised Learning in Image Classification: Research on Fusion of Labeled and Unlabeled Data

Dual-Task Mutual Learning for Semi-Supervised Medical Image Segmentation

Triple-View Feature Learning for Medical Image Segmentation

Adaptive Weight of Unreliable Relation Module for Semi-supervised Multi-label Image Recognition

Semi-Supervised 3D Medical Image Segmentation Based on Dual-Task Consistent Joint Learning and Task-Level Regularization.

Correlation-Aware Mutual Learning for Semi-supervised Medical Image Segmentation

A Teacher-Student Framework for Semi-supervised Medical Image Segmentation From Mixed Supervision

An Efficient Semi-Supervised Framework with Multi-Task and Curriculum Learning for Medical Image Segmentation

Weakly supervised learning for multi-class medical image segmentation via feature decomposition

Unsupervised Local Discrimination for Medical Images

Self-Supervised Learning for Non-Rigid Registration Between Near-Isometric 3D Surfaces in Medical Imaging.

Self-supervised learning and semi-supervised learning for multi-sequence medical image classification