Abstract:Due to the scarcity of labeled data, self-supervised learning (SSL) has gained much attention in 3D medical image segmentation, by extracting semantic representations from unlabeled data. Among SSL strategies, Masked image modeling (MIM) has shown effectiveness by reconstructing randomly masked images to learn detailed representations. However, conventional MIM methods require extensive training data to achieve good performance, which still poses a challenge for medical imaging. Since random masking uniformly samples all regions within medical images, it may overlook crucial anatomical regions and thus degrade the pretraining efficiency. We propose AnatoMask, a novel MIM method that leverages reconstruction loss to dynamically identify and mask out anatomically significant regions to improve pretraining efficacy. AnatoMask takes a self-distillation approach, where the model learns both how to find more significant regions to mask and how to reconstruct these masked regions. To avoid suboptimal learning, Anatomask adjusts the pretraining difficulty progressively using a masking dynamics function. We have evaluated our method on 4 public datasets with multiple imaging modalities (CT, MRI, and PET). AnatoMask demonstrates superior performance and scalability compared to existing SSL methods. The code is available at <a class="link-external link-https" href="https://github.com/ricklisz/AnatoMask" rel="external noopener nofollow">this https URL</a>.

Reducing Randomness of Non-Regular Sampling Masks for Image Reconstruction

Estimation-free Spatial-Domain Image Reconstruction of Structured Illumination Microscopy

Reconstruction of images taken by a pair of non-regular sampling sensors using correlation based matching

Resampling Images to a Regular Grid from a Non-Regular Subset of Pixel Positions Using Frequency Selective Reconstruction

Design Techniques for Incremental Non-Regular Image Sampling Patterns

Statistical Image Reconstruction for Low-Dose Ct Using Nonlocal Means-Based Regularization

High-quality Image Restoration from Partial Mixed Adaptive-Random Measurements

Deep Learning Guided Undersampling Mask Design for MR Image Reconstruction

A Novel End-To-End Network for Reconstruction of Non-Regularly Sampled Image Data Using Locally Fully Connected Layers

High-resolution Image Reconstruction Based on Independent Equations of Pixel Grey Level

Enhanced Image Reconstruction From Quarter Sampling Measurements Using An Adapted Very Deep Super Resolution Network

Quantitative Study on a Resampling Mask Method for Speckle Reduction with Amplitude Superposition

AnatoMask: Enhancing Medical Image Segmentation with Reconstruction-guided Self-masking

Efficient imaging through scattering media by random sampling

Image Reconstruction From Random Samples With Multiscale Hybrid Parametric and Nonparametric Modeling

Iteratively Refined Image Reconstruction with Learned Attentive Regularizers

Speckle Reduction in Digital Holography with Resampling Ring Masks

Image-Guided Depth Sampling and Reconstruction

Image reconstruction from random samples with parametric and nonparametric modeling.

Single image super-resolution using self-optimizing mask via fractional-order gradient interpolation and reconstruction

Learned reconstructions for practical mask-based lensless imaging