Assembling a Learnable Mumford–Shah Type Model with Multigrid Technique for Image Segmentation

Junying Meng,Weihong Guo,Jun Liu,Mingrui Yang
DOI: https://doi.org/10.1137/23m1577663
IF: 1.938
2024-05-24
SIAM Journal on Imaging Sciences
Abstract:SIAM Journal on Imaging Sciences, Volume 17, Issue 2, Page 1007-1039, June 2024. The classical Mumford–Shah (MS) model has been successful in some medical image segmentation tasks, providing segmentation results with smooth boundaries of objects. However, the MS model, which operates at the pixel level of the images, faces challenges when dealing with medical images with low contrast or unclear edges. In this paper, we begin by using a feature extractor to capture high-dimensional deep features that contain more comprehensive semantic information than pixel-level data alone. Inspired by the MS model, we develop a variational model that incorporates threshold dynamics (TD) regularization for segmenting each feature. We obtain the final segmentation result for the original image by assembling segmentation results of all the features. This process results in MS-MGNet, a lightweight trainable segmentation network with a similar architecture to many encoder–decoder networks. The intermediate layers of MS-MGNet are designed by unrolling the numerical scheme based on the multigrid method for solving the variational model. We provide interpretability for the encoder–decoder architecture by elucidating the roles of each layer and offering explanations of the underlying mathematical models. By incorporating the TD regularizer, we integrate spatial priors from the variational models into the network architecture, resulting in better segmentation results with smoother edges and a certain robustness to noise. Compared to some relevant methods, experimental results on the selected data sets with low contrast or unclear edges show that the proposed method can achieve better segmentation performance with fewer parameters, even when trained on smaller data sets.
mathematics, applied,computer science, software engineering, artificial intelligence,imaging science & photographic technology
What problem does this paper attempt to address?