Unpaired MRI Super Resolution with Contrastive Learning

Hao Li,Quanwei Liu,Jianan Liu,Xiling Liu,Yanni Dong,Tao Huang,Zhihan Lv
2024-02-16
Abstract:Magnetic resonance imaging (MRI) is crucial for enhancing diagnostic accuracy in clinical settings. However, the inherent long scan time of MRI restricts its widespread applicability. Deep learning-based image super-resolution (SR) methods exhibit promise in improving MRI resolution without additional cost. Due to lacking of aligned high-resolution (HR) and low-resolution (LR) MRI image pairs, unsupervised approaches are widely adopted for SR reconstruction with unpaired MRI images. However, these methods still require a substantial number of HR MRI images for training, which can be difficult to acquire. To this end, we propose an unpaired MRI SR approach that employs contrastive learning to enhance SR performance with limited HR training data. Empirical results presented in this study underscore significant enhancements in the peak signal-to-noise ratio and structural similarity index, even when a paucity of HR images is available. These findings accentuate the potential of our approach in addressing the challenge of limited HR training data, thereby contributing to the advancement of MRI in clinical applications.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The main goal of this paper is to address the issues of long scan times and high costs associated with Magnetic Resonance Imaging (MRI) in clinical applications. Specifically, the paper proposes a novel unsupervised Super Resolution (SR) method that leverages Contrastive Learning (CL) techniques to enhance the resolution of MRI images, even when only a small amount of High-Resolution (HR) training data is available. The core contributions of the paper are as follows: 1. **Proposing an unsupervised MRI super-resolution framework based on contrastive learning**: By constructing positive sample pairs between the generated super-resolution images and the corresponding HR images, and negative sample pairs with other HR images, the framework utilizes contrastive loss for training. 2. **Developing an unsupervised network for contrastive representation learning**: This network provides a novel and effective unsupervised MRI super-resolution method, demonstrating competitive performance when compared to other state-of-the-art unsupervised methods. 3. **Excelling with limited HR training data**: Experimental results show that the proposed contrastive learning method performs comparably to unsupervised learning methods with large amounts of training data when only a limited number of HR training data is available. It outperforms other unsupervised learning methods when only limited data is available, showcasing the superiority of the method. These findings indicate that the method can be effectively applied in clinical settings, particularly in situations where acquiring a large number of HR images is challenging.