Abstract:Abstract For medical image analysis, there is always an immense need for rich details in an image. Typically, the diagnosis will be served best if the fine details in the image are retained and the image is available in high resolution. In medical imaging, acquiring high-resolution images is challenging and costly as it requires sophisticated and expensive instruments, trained human resources, and often causes operation delays. Deep learning based super resolution techniques can help us to extract rich details from a low-resolution image acquired using the existing devices. In this paper, we propose a new Generative Adversarial Network (GAN) based architecture for medical images, which maps low-resolution medical images to high-resolution images. The proposed architecture is divided into three steps. In the first step, we use a multi-path architecture to extract shallow features on multiple scales instead of single scale. In the second step, we use a ResNet34 architecture to extract deep features and upscale the features map by a factor of two. In the third step, we extract features of the upscaled version of the image using a residual connection-based mini-CNN and again upscale the feature map by a factor of two. The progressive upscaling overcomes the limitation for previous methods in generating true colors. Finally, we use a reconstruction convolutional layer to map back the upscaled features to a high-resolution image. Our addition of an extra loss term helps in overcoming large errors, thus, generating more realistic and smooth images. We evaluate the proposed architecture on four different medical image modalities: (1) the DRIVE and STARE datasets of retinal fundoscopy images, (2) the BraTS dataset of brain MRI, (3) the ISIC skin cancer dataset of dermoscopy images, and (4) the CAMUS dataset of cardiac ultrasound images. The proposed architecture achieves superior accuracy compared to other state-of-the-art super-resolution architectures.

Towards Efficient Medical Video Super-Resolution Based on Deep Back-Projection Networks

Video Super-Resolution Based on Multiple Networks Merging

Super-resolution Reconstruction Algorithms Based on Fusion of Deep Learning Mechanism and Wavelet

Iterative Back Projection Network Based on Deformable 3D Convolution

Towards efficient motion-blurred public security video super-resolution based on back-projection networks

Depth Image Super-resolution via Two-Branch Network

Learning deconvolutional deep neural network for high resolution medical image reconstruction

Neighborhood evaluator for efficient super-resolution reconstruction of 2D medical images

Towards High-Quality and Efficient Video Super-Resolution via Spatial-Temporal Data Overfitting

Video Super-Resolution Via a Spatio-Temporal Alignment Network.

Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image

A new generative adversarial network for medical images super resolution

Video Super-Resolution Reconstruction Based on Deep Convolutional Neural Network and Spatio-Temporal Similarity

Edge reconstruction and feature enhancement‐driven architecture for blind super‐resolution in medical imaging systems

Super Resolution Method for Network Video

Medical Image Super-Resolution Reconstruction Algorithms Based on Deep Learning: A Survey

Video Super-Resolution Reconstruction Based on Deep Learning and Spatio-Temporal Feature Self-similarity

Video super-resolution via dense non-local spatial-temporal convolutional network

Accelerated Super-resolution MR Image Reconstruction via a 3D Densely Connected Deep Convolutional Neural Network

AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions