Abstract:PurposeUltrasound (US) imaging has been widely used in diagnosis, image‐guided intervention, and therapy, where high‐quality three‐dimensional (3D) images are highly desired from sparsely acquired two‐dimensional (2D) images. This study aims to develop a deep learning‐based algorithm to reconstruct high‐resolution (HR) 3D US images only reliant on the acquired sparsely distributed 2D images.MethodsWe propose a self‐supervised learning framework using cycle‐consistent generative adversarial network (cycleGAN), where two independent cycleGAN models are trained with paired original US images and two sets of low‐resolution (LR) US images, respectively. The two sets of LR US images are obtained through down‐sampling the original US images along the two axes, respectively. In US imaging, in‐plane spatial resolution is generally much higher than through‐plane resolution. By learning the mapping from down‐sampled in‐plane LR images to original HR US images, cycleGAN can generate through‐plane HR images from original sparely distributed 2D images. Finally, HR 3D US images are reconstructed by combining the generated 2D images from the two cycleGAN models.ResultsThe proposed method was assessed on two different datasets. One is automatic breast ultrasound (ABUS) images from 70 breast cancer patients, the other is collected from 45 prostate cancer patients. By applying a spatial resolution enhancement factor of 3 to the breast cases, our proposed method achieved the mean absolute error (MAE) value of 0.90 ± 0.15, the peak signal‐to‐noise ratio (PSNR) value of 37.88 ± 0.88 dB, and the visual information fidelity (VIF) value of 0.69 ± 0.01, which significantly outperforms bicubic interpolation. Similar performances have been achieved using the enhancement factor of 5 in these breast cases and using the enhancement factors of 5 and 10 in the prostate cases.ConclusionsWe have proposed and investigated a new deep learning‐based algorithm for reconstructing HR 3D US images from sparely acquired 2D images. Significant improvement on through‐plane resolution has been achieved by only using the acquired 2D images without any external atlas images. Its self‐supervision capability could accelerate HR US imaging.

Self-Supervised Learning of a Deep Neural Network for Ultrafast Ultrasound Imaging as an Inverse Problem

Ultrasound Image Reconstruction from Plane Wave Radio-Frequency Data by Self-Supervised Deep Neural Network.

Ultrasound Image Reconstruction by Self- Supervised Deep Neural Network A Study on Coherent Compounding Strategy

Sparse Deconvolution Method for Ultrasound Images Based on Automatic Estimation of Reference Signals.

A General Framework for Inverse Problem Solving using Self-Supervised Deep Learning: Validations in Ultrasound and Photoacoustic Image Reconstruction

Self-supervised Learning for Accelerated 3D High-resolution Ultrasound Imaging.

CNN-Based Image Reconstruction Method for Ultrafast Ultrasound Imaging

Deep learning-based self-high-resolution for 3D ultrasound imaging

A Plug-and-Play Untrained Neural Network for Full Waveform Inversion in Reconstructing Sound Speed Images of Ultrasound Computed Tomography

Deep Learning Ultrasound Computed Tomography under Sparse Sampling.

Deep Learning Ultrasound Computed Tomography with Sparse Transmissions

A robust super-resolution approach with sparsity constraint for near-field wideband acoustic imaging

Deep Learning for Super-resolution Ultrasound Imaging with Spatiotemporal Data

Improving the Quality of Monostatic Synthetic-Aperture Ultrasound Imaging Through Deep-Learning-Based Beamforming

Efficient B-Mode Ultrasound Image Reconstruction From Sub-Sampled RF Data Using Deep Learning

Image Quality Enhancement Using a Deep Neural Network for Plane Wave Medical Ultrasound Imaging

Deep-Learning Based Adaptive Ultrasound Imaging From Sub-Nyquist Channel Data

DFUSNN: zero-shot dual-domain fusion unsupervised neural network for parallel MRI reconstruction

Super-Resolution Reconstruction of Plane-Wave Ultrasound Imaging Based on the Improved CNN Method

Deep learning for fast denoising filtering in ultrasound localization microscopy

DEEP-LEARNING-BASED ULTRASOUND SOUND-SPEED TOMOGRAPHY RECONSTRUCTION WITH TIKHONOV PSEUDO-INVERSE PRIORI