Self-supervised Fetal MRI 3D Reconstruction Based on Radiation Diffusion Generation Model

Junpeng Tan,Xin Zhang,Yao Lv,Xiangmin Xu,Gang Li

2023-10-16

Abstract:Although the use of multiple stacks can handle slice-to-volume motion correction and artifact removal problems, there are still several problems: 1) The slice-to-volume method usually uses slices as input, which cannot solve the problem of uniform intensity distribution and complementarity in regions of different fetal MRI stacks; 2) The integrity of 3D space is not considered, which adversely affects the discrimination and generation of globally consistent information in fetal MRI; 3) Fetal MRI with severe motion artifacts in the real-world cannot achieve high-quality super-resolution reconstruction. To address these issues, we propose a novel fetal brain MRI high-quality volume reconstruction method, called the Radiation Diffusion Generation Model (RDGM). It is a self-supervised generation method, which incorporates the idea of Neural Radiation Field (NeRF) based on the coordinate generation and diffusion model based on super-resolution generation. To solve regional intensity heterogeneity in different directions, we use a pre-trained transformer model for slice registration, and then, a new regionally Consistent Implicit Neural Representation (CINR) network sub-module is proposed. CINR can generate the initial volume by combining a coordinate association map of two different coordinate mapping spaces. To enhance volume global consistency and discrimination, we introduce the Volume Diffusion Super-resolution Generation (VDSG) mechanism. The global intensity discriminant generation from volume-to-volume is carried out using the idea of diffusion generation, and CINR becomes the deviation intensity generation network of the volume-to-volume diffusion model. Finally, the experimental results on real-world fetal brain MRI stacks demonstrate the state-of-the-art performance of our method.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address the severe motion artifacts and noise issues in fetal MRI (Magnetic Resonance Imaging) caused by fetal movement and the non-static environment of the maternal uterus during acquisition. Specifically, the paper focuses on the following three main problems:

1. **Uneven Regional Intensity Distribution**: Traditional Slice-to-Volume (SVR) methods typically use slices as input, which cannot effectively address the uneven intensity distribution and complementarity issues between different fetal MRI stack regions.
2. **Insufficient 3D Spatial Integrity**: Existing SVR methods do not consider the overall integrity of the 3D space, which affects the distinction and generation of globally consistent information in fetal MRI.
3. **Difficulty in High-Quality Super-Resolution Reconstruction**: In practice, fetal MRI suffers from severe motion artifacts, making it challenging to achieve high-quality super-resolution reconstruction.

To tackle these problems, the authors propose a new high-quality volumetric reconstruction method for fetal brain MRI, called the Radiation Diffusion Generation Model (RDGM). This model combines the concepts of Neural Radiation Field (NeRF) and Diffusion Model, achieving slice rigid registration, SVR, and volume-to-volume super-resolution reconstruction through self-supervised learning. The specific contributions include:

1. **Proposing a New Self-Supervised Framework**: RDGM introduces the concepts of NeRF and Diffusion Model, achieving slice rigid registration, SVR, and volume-to-volume super-resolution reconstruction.
2. **Proposing a New Consistency Implicit Neural Representation Network (CINR)**: CINR generates the initial fetal brain MRI 3D volume by combining the coordinate association maps of two different coordinate mapping spaces, enhancing the intensity consistency of regional coordinates.
3. **Introducing a Volume Diffusion Super-Resolution Generation Mechanism (VDSG)**: The VDSG mechanism further improves the quality of the initial fetal brain MRI 3D volume, achieving global super-resolution generation through the diffusion model.

Ultimately, RDGM can achieve high-quality reconstruction in real low-quality fetal MRI data, especially in the presence of severe motion artifacts.