Abstract:Incorporating prior knowledge into a segmentation task, whether it be under the form of geometrical constraints (area/volume penalisation, convexity enforcement, etc.) or of topological constraints (to preserve the contextual relations between objects, to monitor the number of connected components), proves to increase accuracy in medical image segmentation. In particular, it allows to compensate for the issue of weak boundary definition, of imbalanced classes, and to be more in line with anatomical consistency even though the data do not explicitly exhibit those features. This observation underpins the introduced contribution that aims, in a hybrid setting, to leverage the best of both worlds that variational methods and supervised deep learning approaches embody: (a) versatility and adaptability in the mathematical formulation of the problem to encode geometrical/topological constraints, (b) interpretability of the results for the former formalism, while (c) more efficient and effective processing models, (d) ability to become more proficient at learning intricate features and executing more computationally intensive tasks, for the latter one. To be more precise, a unified variational framework involving topological prescriptions in the training of convolutional neural networks through the design of a suitable penalty in the loss function is provided. These topological constraints are implicitly enforced by viewing the segmentation procedure as a registration task between the processed image and its associated ground truth under incompressibility conditions, thus making them homeomorphic. A very preliminary version (Lambert et al., in Calatroni, Donatelli, Morigi, Prato, Santacesaria (eds) Scale space and variational methods in computer vision, Springer, Berlin, 2023, pp. 363–375) of this work has been published in the proceedings of the Ninth International Conference on Scale Space and Variational Methods in Computer Vision, 2023. It contained neither all the theoretical results, nor the detailed related proofs, nor did it include the numerical analysis of the designed algorithm. Besides these more involved developments in the present version, a more complete, systematic and thorough analysis of the numerical experiments is also conducted, addressing several issues: (i) limited amount of labelled data in the training phase, (ii) low contrast or imbalanced classes exhibited by the data, and (iii) explainability of the results.

Deep Convolutional Neural Networks with Spatial Regularization, Volume and Star-Shape Priors for Image Segmentation

Deep Convolutional Neural Networks with Spatial Regularization, Volume and Star-shape Priori for Image Segmentation

Simultaneous Alignment and Surface Regression Using Hybrid 2D-3D Networks for 3D Coherent Layer Segmentation of Retinal OCT Images with Full and Annotations

Integrating Spatial Prior Adapter for Enhancing SAM Performance in Medical Image Segmentation

Deep Convolutional Neural Networks Meet Variational Shape Compactness Priors for Image Segmentation

A Top-Down Manner-Based DCNN Architecture for Semantic Image Segmentation.

Spatially regularized Leaky ReLU in dual space for CNN based image segmentation

Optimizing Spatial Relationships in GCN to Improve the Classification Accuracy of Remote Sensing Images

Learning with Explicit Shape Priors for Medical Image Segmentation

Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs

Cardiac Segmentation from LGE MRI Using Deep Neural Network Incorporating Shape and Spatial Priors

Dense Convolutional Networks for Semantic Segmentation.

Learning Deep Conditional Neural Network for Image Segmentation

SACNet: A Spatially Adaptive Convolution Network for 2D Multi-organ Medical Segmentation

Semantic Segmentation of Aerial Imagery Via Split-Attention Networks with Disentangled Nonlocal and Edge Supervision

Globally Optimal Surface Segmentation using Deep Learning with Learnable Smoothness Priors

Deep Active Contour Network for Medical Image Segmentation.

About the Incorporation of Topological Prescriptions in CNNs for Medical Image Semantic Segmentation

Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation

Aerial image semantic segmentation using DCNN predicted distance maps

A Regularized Convolutional Neural Network for Semantic Image Segmentation