Abstract:Medical images play a vital role in medical analysis by providing crucial information about patients' pathological conditions. However, the quality of these images can be compromised by many factors, such as limited resolution of the instruments, artifacts caused by movements, and the complexity of the scanned areas. As a result, low-resolution (LR) images cannot provide sufficient information for diagnosis. To address this issue, researchers have attempted to apply image super-resolution (SR) techniques to restore the high-resolution (HR) images from their LR counterparts. However, these techniques are designed for generic images, and thus suffer from many challenges unique to medical images. An obvious one is the diversity of the scanned objects; for example, the organs, tissues, and vessels typically appear in different sizes and shapes, and are thus hard to restore with standard convolution neural networks (CNNs). In this paper, we develop a dynamic-local learning framework to capture the details of these diverse areas, consisting of deformable convolutions with adjustable kernel shapes. Moreover, the global information between the tissues and organs is vital for medical diagnosis. To preserve global information, we propose pixel-pixel and patch-patch global learning using a non-local mechanism and a vision transformer (ViT), respectively. The result is a novel CNN-ViT neural network with Local-to-Global feature learning for medical image SR, referred to as LGSR, which can accurately restore both local details and global information. We evaluate our method on six public datasets and one large-scale private dataset, which include five different types of medical images (i.e., Ultrasound, OCT, Endoscope, CT, and MRI images). Experiments show that the proposed method achieves superior PSNR/SSIM and visual performance than the state of the arts with competitive computational costs, measured in network parameters, runtime, and FLOPs. What is more, the experiment conducted on OCT image segmentation for the downstream task demonstrates a significantly positive performance effect of LGSR.

Spectrally-Enforced Global Receptive Field for Contextual Medical Image Segmentation and Classification

3D Multiple-Contextual ROI-Attention Network for Efficient and Accurate Volumetric Medical Image Segmentation.

Multi-Receptive-Field CNN for Semantic Segmentation of Medical Images

ConvMedSegNet:A multi-receptive field depthwise convolutional neural network for medical image segmentation

MCRNet: Multi-level Context Refinement Network for Semantic Segmentation in Breast Ultrasound Imaging

Segmentation-based Context-Aware Enhancement Network for Medical Images

A Multi-Scaled Receptive Field Learning Approach for Medical Image Segmentation

Deep local-to-global feature learning for medical image super-resolution

LGCE-Net: a local and global contextual encoding network for effective and efficient medical image segmentation

Neighborhood evaluator for efficient super-resolution reconstruction of 2D medical images

ResX: Feature Extraction Block for Medical Image Segmentation

Non-Local Context Encoder: Robust Biomedical Image Segmentation against Adversarial Attacks

Biomedical image segmentation based on full-Resolution network

Boundary-aware context neural network for medical image segmentation

Multi-Level Contextual Network for Biomedical Image Segmentation

A Multi-Scale Context Aware Attention Model for Medical Image Segmentation

MSDEnet: Multi-scale detail enhanced network based on human visual system for medical image segmentation

Harmonized Spatial and Spectral Learning for Robust and Generalized Medical Image Segmentation

Hybrid-scale Contextual Fusion Network for Medical Image Segmentation

Fast Non-Local Neural Networks with Spectral Residual Learning

MSMCNet: Differential context drives accurate localization and edge smoothing of lesions for medical image segmentation