CSR-dMRI: Continuous Super-Resolution of Diffusion MRI with Anatomical Structure-assisted Implicit Neural Representation Learning

Ruoyou Wu,Jian Cheng,Cheng Li,Juan Zou,Jing Yang,Wenxin Fan,Yong Liang,Shanshan Wang

2024-08-14

Abstract:Deep learning-based dMRI super-resolution methods can effectively enhance image resolution by leveraging the learning capabilities of neural networks on large datasets. However, these methods tend to learn a fixed scale mapping between low-resolution (LR) and high-resolution (HR) images, overlooking the need for radiologists to scale the images at arbitrary resolutions. Moreover, the pixel-wise loss in the image domain tends to generate over-smoothed results, losing fine textures and edge information. To address these issues, we propose a novel continuous super-resolution method for dMRI, called CSR-dMRI, which utilizes an anatomical structure-assisted implicit neural representation learning approach. Specifically, the CSR-dMRI model consists of two components. The first is the latent feature extractor, which primarily extracts latent space feature maps from LR dMRI and anatomical images while learning structural prior information from the anatomical images. The second is the implicit function network, which utilizes voxel coordinates and latent feature vectors to generate voxel intensities at corresponding positions. Additionally, a frequency-domain-based loss is introduced to preserve the structural and texture information, further enhancing the image quality. Extensive experiments on the publicly available HCP dataset validate the effectiveness of our approach. Furthermore, our method demonstrates superior generalization capability and can be applied to arbitrary-scale super-resolution, including non-integer scale factors, expanding its applicability beyond conventional approaches.

Image and Video Processing

What problem does this paper attempt to address?

The paper aims to address the problem of super-resolution reconstruction in diffusion magnetic resonance imaging (dMRI). Specifically, existing deep learning-based dMRI super-resolution methods have the following two main issues:

1. **Fixed Scale Mapping**: Existing methods tend to learn a fixed ratio mapping between low-resolution (LR) images and high-resolution (HR) images, which cannot meet the radiologists' need for arbitrary resolution scaling.
2. **Over-Smoothing**: Pixel-domain loss functions often lead to overly smooth generated images, losing fine textures and edge information.

To solve these problems, the authors propose a new continuous super-resolution method—CSR-dMRI, which utilizes anatomical structure-assisted implicit neural representation learning. This method includes two main components:
- Latent Feature Extractor: Extracts latent spatial feature maps from LR dMRI images and anatomical images, and learns structural prior information from the anatomical images.
- Implicit Function Network: Uses voxel coordinates and latent feature vectors to generate voxel intensity values at corresponding positions.

Additionally, the method introduces a frequency-domain-based loss function to preserve the structural and texture information of the images, further enhancing image quality. Experimental results show that this method not only effectively improves image quality but also has good generalization ability. It can be applied to super-resolution reconstruction at any scale, including non-integer scale factors, thereby extending its applicability.