2.5D Multi-view Averaging Diffusion Model for 3D Medical Image Translation: Application to Low-count PET Reconstruction with CT-less Attenuation Correction

Tianqi Chen,Jun Hou,Yinchi Zhou,Huidong Xie,Xiongchao Chen,Qiong Liu,Xueqi Guo,Menghua Xia,James S. Duncan,Chi Liu,Bo Zhou
2024-06-15
Abstract:Positron Emission Tomography (PET) is an important clinical imaging tool but inevitably introduces radiation hazards to patients and healthcare providers. Reducing the tracer injection dose and eliminating the CT acquisition for attenuation correction can reduce the overall radiation dose, but often results in PET with high noise and bias. Thus, it is desirable to develop 3D methods to translate the non-attenuation-corrected low-dose PET (NAC-LDPET) into attenuation-corrected standard-dose PET (AC-SDPET). Recently, diffusion models have emerged as a new state-of-the-art deep learning method for image-to-image translation, better than traditional CNN-based methods. However, due to the high computation cost and memory burden, it is largely limited to 2D applications. To address these challenges, we developed a novel 2.5D Multi-view Averaging Diffusion Model (MADM) for 3D image-to-image translation with application on NAC-LDPET to AC-SDPET translation. Specifically, MADM employs separate diffusion models for axial, coronal, and sagittal views, whose outputs are averaged in each sampling step to ensure the 3D generation quality from multiple views. To accelerate the 3D sampling process, we also proposed a strategy to use the CNN-based 3D generation as a prior for the diffusion model. Our experimental results on human patient studies suggested that MADM can generate high-quality 3D translation images, outperforming previous CNN-based and Diffusion-based baseline methods.
Computer Vision and Pattern Recognition,Artificial Intelligence,Image and Video Processing
What problem does this paper attempt to address?
The paper primarily aims to address two key issues in Positron Emission Tomography (PET): 1. **Reducing Radiation Dose**: As an important clinical imaging tool, PET requires the injection of radioactive tracers into patients, which inevitably poses radiation risks to both patients and medical staff. Therefore, it is essential to reduce the injection dose of tracers to lower the overall radiation dose. 2. **Low-Dose PET Image Reconstruction without CT Attenuation Correction**: Typically, to correct for the attenuation of PET signals, a scan is performed together with CT to provide an attenuation map (μ-map). However, this multimodal imaging process increases the patient's radiation exposure. Hence, researchers aim to perform attenuation correction on low-dose PET images without CT, achieving "CT-less Attenuation Correction" (CT-less AC). Specifically, the paper proposes a novel method called the 2.5D Multi-View Average Diffusion Model (MADM), which aims to directly generate attenuation-corrected standard-dose PET images (AC-SDPET) from non-attenuation-corrected low-dose PET images (NAC-LDPET). This method leverages the latest advancements in diffusion models for image-to-image translation tasks and introduces a 2.5D perspective to improve the quality of 3D images while employing a strategy to accelerate the 3D sampling process. The key contributions of the paper include: - Proposing a 2.5D model that combines information from multiple adjacent slices to predict the target slice, alleviating the computational burden of 3D models and reducing the inherent discontinuities in 2D models. - Training independent 2.5D models for different views (axial, coronal, and sagittal) and averaging the results at each denoising step to further reduce discontinuities and improve prediction accuracy. - Utilizing the 3D predictions of a Convolutional Neural Network (CNN) model as prior information for the diffusion model to accelerate the translation process and enhance the accuracy of the generated images. Experimental results show that MADM can generate high-quality attenuation-corrected standard-dose PET images from low-dose PET images and outperforms several previous methods under reasonable computational resources. Additionally, MADM demonstrates significant improvements in reducing quantification errors in tumor regions.