Abstract:CT images for radiotherapy planning are usually acquired in thick slices to reduce the imaging dose, especially for pediatric patients, and to lessen the need for contouring and treatment planning on more slices. However, low through-plane resolution may degrade the accuracy of dose calculations. In this paper, a self-supervised deep learning workflow is proposed to synthesize high through-plane resolution CT images by learning from their high in-plane resolution features. The proposed workflow was designed to facilitate neural networks to learn the mapping from low-resolution (LR) to high-resolution (HR) images in the axial plane. During the inference step, the HR sagittal and coronal images were generated by feeding two parallel-trained neural networks with the respective LR sagittal and coronal images to the trained neural networks. The CT simulation images of a cohort of 75 patients with head and neck cancer (1 mm slice thickness) and 200 CT images of a cohort of 20 lung cancer patients (3 mm slice thickness) were retrospectively investigated in a cross-validation manner. The HR images generated with the proposed method were qualitatively (visual quality, image intensity profiles and preliminary observer study) and quantitatively (mean absolute error, edge keeping index, structural similarity index measurement, information fidelity criterion and visual information fidelity in pixel domain) inspected, while taking the original CT images of the head and neck and lung cancer patients as the reference. The qualitative results showed the capability of the proposed method for generating high through-plane resolution CT images with data from both groups of cancer patients. All the improvements in the measure metrics were confirmed to be statistically significant with paired two-sample t-test analysis. The innovative point of the work is that the proposed deep learning workflow for CT image generation with high through-plane resolution in radiotherapy is self-supervised, meaning that it does not rely on ground truth CT images to train the network. In addition, the assumption that the in-plane HR information can supervise the through-plane HR generation is confirmed. We hope that this will inspire more research on this topic to further improve the through-plane resolution of medical images.

Deep learning-based self-high-resolution for 3D ultrasound imaging

Self-supervised Learning for Accelerated 3D High-resolution Ultrasound Imaging.

Deep Learning-based Virtual Refocusing of Out-of-Plane Images for Ultrasound Computed Tomography

Self-Supervised Learning-Based High-Resolution Ultrasound Imaging for Prostate Brachytherapy.

Sensorless End-to-End Freehand Three-dimensional Ultrasound Reconstruction with Physics Guided Deep Learning

Self-Supervised Learning of a Deep Neural Network for Ultrafast Ultrasound Imaging as an Inverse Problem

Deep Attentional GAN-based High-Resolution Ultrasound Imaging

Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction

Deep Learning Ultrasound Computed Tomography with Sparse Transmissions

High Through-Plane Resolution CT Imaging with Self-Supervised Deep Learning

Three-dimensional ultrasound image reconstruction based on 3D-ResNet in the musculoskeletal system using a 1D probe: ex vivo and in vivo feasibility studies

Deep Learning-based Breast Tumor Detection and Segmentation in 3D Ultrasound Image

Enhancing Ultrasound Imaging with Synthetic Aperture Data: A Deep Learning Approach for Superior Resolution and Contrast

Learning-based Framework for US Signals Super-resolution

Neural Implicit Surface Reconstruction of Freehand 3D Ultrasound Volume with Geometric Constraints

Three-dimensional Ultrasound Image Reconstruction Based on 3D-Resnet in the Musculoskeletal System Using a 1D Probe:Ex Vivoandin Vivofeasibility Studies.

Computationally efficient deep learning-based image reconstruction for sound speed estimation in ultrasound computed tomography

Wireless and Sensorless 3D Ultrasound Imaging

A dual-domain deep learning-based reconstruction method for fully 3D sparse data helical CT

Faster super-resolution ultrasound imaging with a deep learning model for tissue decluttering and contrast agent localization

Learned super resolution ultrasound for improved breast lesion characterization