Abstract:Recently, large pretrained vision foundation models based on masked image modeling (MIM) have attracted unprecedented attention and achieved remarkable performance across various tasks. However, the study of MIM for ultrasound imaging remains relatively unexplored, and most importantly, current MIM approaches fail to account for the gap between natural images and ultrasound, as well as the intrinsic imaging characteristics of the ultrasound modality, such as the high noise-to-signal ratio. In this paper, motivated by the unique high noise-to-signal ratio property in ultrasound, we propose a deblurring MIM approach specialized to ultrasound, which incorporates a deblurring task into the pretraining proxy task. The incorporation of deblurring facilitates the pretraining to better recover the subtle details within ultrasound images that are vital for subsequent downstream analysis. Furthermore, we employ a multi-scale hierarchical encoder to extract both local and global contextual cues for improved performance, especially on pixel-wise tasks such as segmentation. We conduct extensive experiments involving 280,000 ultrasound images for the pretraining and evaluate the downstream transfer performance of the pretrained model on various disease diagnoses (nodule, Hashimoto's thyroiditis) and task types (classification, segmentation). The experimental results demonstrate the efficacy of the proposed deblurring MIM, achieving state-of-the-art performance across a wide range of downstream tasks and datasets. Overall, our work highlights the potential of deblurring MIM for ultrasound image analysis, presenting an ultrasound-specific vision foundation model.

A Blind Deconvolution Approach to Ultrasound Imaging

Blind Deconvolution Using an Improved L0 Sparse Representation

Multi-frame Blind Deconvolution Using Sparse Priors

Regularized Deconvolution for Structured Illumination Microscopy Via Accelerated Linearized ADMM

Sparse Deconvolution Method for Ultrasound Images Based on Automatic Estimation of Reference Signals.

A Blind Deconvolution Method for Attenuative Materials Based on Asymmetrical Gaussian Model.

Identifiability of Multichannel Blind Deconvolution and Nonconvex Regularization Algorithm

Sparse Blind Deconvolution with Nonconvex Optimization for Ultrasonic NDT Application

Adaptive Multichannel Blind Deconvolution Using State-Space Models

Deblurring masked image modeling for ultrasound image analysis

Compressive Deconvolution in Medical Ultrasound Imaging

PHOCUS: Physics-Based Deconvolution for Ultrasound Resolution Enhancement

A Unifying Approach to Inverse Problems of Ultrasound Beamforming and Deconvolution

Joint Blind Deconvolution and Robust Principal Component Analysis for Blood Flow Estimation in Medical Ultrasound Imaging

Deconvolution Based on Sparsity and Continuity Improves the Quality of Ultrasound Image

Ultrasound image optimization method based on deconvolution algorithm

Blind deconvolution subject to sparse representation for fluorescence microscopy

Despeckling Medical Ultrasound Images Based on Blind Deconvolution and Maximum-Likelihood Estimation

Single Image Blind Deconvolution Using Sparse Representation and Structural Self-similarity

Randomized Channel Subsampling Method for Efficient Ultrafast Ultrasound Imaging

Low complexity adaptive ultrasound image beamformer combined with improved multiphase apodization with cross-correlation