DDMM-Synth: A Denoising Diffusion Model for Cross-modal Medical Image Synthesis with Sparse-view Measurement Embedding

Xiaoyue Li,Kai Shang,Gaoang Wang,Mark D. Butala

2023-03-28

Abstract:Reducing the radiation dose in computed tomography (CT) is important to mitigate radiation-induced risks. One option is to employ a well-trained model to compensate for incomplete information and map sparse-view measurements to the CT reconstruction. However, reconstruction from sparsely sampled measurements is insufficient to uniquely characterize an object in CT, and a learned prior model may be inadequate for unencountered cases. Medical modal translation from magnetic resonance imaging (MRI) to CT is an alternative but may introduce incorrect information into the synthesized CT images in addition to the fact that there exists no explicit transformation describing their relationship. To address these issues, we propose a novel framework called the denoising diffusion model for medical image synthesis (DDMM-Synth) to close the performance gaps described above. This framework combines an MRI-guided diffusion model with a new CT measurement embedding reverse sampling scheme. Specifically, the null-space content of the one-step denoising result is refined by the MRI-guided data distribution prior, and its range-space component derived from an explicit operator matrix and the sparse-view CT measurements is directly integrated into the inference stage. DDMM-Synth can adjust the projection number of CT a posteriori for a particular clinical application and its modified version can even improve the results significantly for noisy cases. Our results show that DDMM-Synth outperforms other state-of-the-art supervised-learning-based baselines under fair experimental conditions.

Image and Video Processing,Computer Vision and Pattern Recognition,Medical Physics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to maintain or improve the quality of CT images while reducing the radiation dose of CT scans. Specifically, the paper focuses on two main issues:

1. **Reducing radiation dose**: In medical diagnosis, although CT imaging is very important, high - dose radiation poses a threat to patients' health, especially for chronic disease patients who need long - term or frequent CT examinations or patients in cancer treatment. Therefore, it is very necessary to reduce the radiation dose of CT scans, but this usually leads to artifacts in CT images, affecting the accuracy of clinical diagnosis.

2. **Reconstructing high - quality CT images from sparse - view measurements**: In order to reduce the radiation dose, sparse - view measurements (that is, reducing the number of projections in CT scans) can be adopted, but the lack of information caused by this makes it very difficult to reconstruct high - quality CT images. Traditional reconstruction methods may not be able to effectively handle such sparse data, resulting in poor reconstructed image quality.

To solve the above problems, the author proposes a new framework named **DDMM - Synth**, which combines the MRI - guided diffusion model and a new CT measurement - embedded reverse sampling scheme. Through this method, DDMM - Synth can not only use the rich tissue information provided by MRI to guide the synthesis of CT images, but also maintain the data consistency of CT images in the case of sparse - view measurements, thereby generating higher - quality and more reliable CT images while reducing the radiation dose. In addition, the paper also explores how to improve the performance of the model under noisy conditions, further improving its practicality and reliability in actual clinical applications.