DX2CT: Diffusion Model for 3D CT Reconstruction from Bi or Mono-planar 2D X-ray(s)

Yun Su Jeong,Hye Bin Yoo,Il Yong Chun

2024-09-13

Abstract:Computational tomography (CT) provides high-resolution medical imaging, but it can expose patients to high radiation. X-ray scanners have low radiation exposure, but their resolutions are low. This paper proposes a new conditional diffusion model, DX2CT, that reconstructs three-dimensional (3D) CT volumes from bi or mono-planar X-ray image(s). Proposed DX2CT consists of two key components: 1) modulating feature maps extracted from two-dimensional (2D) X-ray(s) with 3D positions of CT volume using a new transformer and 2) effectively using the modulated 3D position-aware feature maps as conditions of DX2CT. In particular, the proposed transformer can provide conditions with rich information of a target CT slice to the conditional diffusion model, enabling high-quality CT reconstruction. Our experiments with the bi or mono-planar X-ray(s) benchmark datasets show that proposed DX2CT outperforms several state-of-the-art methods. Our codes and model will be available at: <a class="link-external link-https" href="https://www.github.com/intyeger/DX2CT" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address the problem of reconstructing high-quality 3D CT volumes from 2D X-ray images (single-plane or dual-plane). Specifically, traditional CT imaging techniques, while providing high-resolution medical images, expose patients to higher radiation doses, limiting their use in pediatric patients or those at risk of cancer. On the other hand, X-ray scans, although having lower radiation doses, have relatively lower resolution. To overcome these challenges, the paper proposes a novel conditional diffusion model, DX2CT, which can reconstruct 3D CT volumes from single-plane or dual-plane X-ray images. The main innovations of DX2CT include: 1. **Feature Map Extraction and Modulation**: Through a new Transformer module, feature maps extracted from 2D X-ray images are modulated with the positional information of the 3D CT volume to generate 3D position-aware feature maps. 2. **Conditional Diffusion Model**: Using the modulated 3D position-aware feature maps as conditions, a high-quality CT reconstruction is performed through a conditional diffusion model. 3. **Efficient Computation**: By reformulating the problem of 2D X-ray to 3D CT reconstruction as a problem of 2D X-ray to 2D CT slice reconstruction, computational efficiency is improved. Experimental results show that DX2CT outperforms several existing state-of-the-art methods on multiple benchmark datasets.

DX2CT: Diffusion Model for 3D CT Reconstruction from Bi or Mono-planar 2D X-ray(s)

DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays

DIFR3CT: Latent Diffusion for Probabilistic 3D CT Reconstruction from Few Planar X-Rays

XTransCT: Ultra-Fast Volumetric CT Reconstruction using Two Orthogonal X-Ray Projections for Image-guided Radiation Therapy via a Transformer Network

Dual-Domain Collaborative Diffusion Sampling for Multi-Source Stationary Computed Tomography Reconstruction

PrideDiff: Physics-Regularized Generalized Diffusion Model for CT Reconstruction

Reconstruct Spine CT from Biplanar X-Rays via Diffusion Learning

A Dual-domain Diffusion Model for Sparse-view CT Reconstruction

MSDiff: Multi-Scale Diffusion Model for Ultra-Sparse View CT Reconstruction

Synthetic CT Generation from MRI Using 3D Improved Diffusion Model

XctDiff: Reconstruction of CT Images with Consistent Anatomical Structures from a Single Radiographic Projection Image

Synthetic CT Generation from MRI using 3D Transformer-based Denoising Diffusion Model

HC$^3$L-Diff: Hybrid conditional latent diffusion with high frequency enhancement for CBCT-to-CT synthesis

CBCT-Based Synthetic CT Image Generation Using Conditional Denoising Diffusion Probabilistic Model

Integrating Deep Unfolding with Direct Diffusion Bridges for Computed Tomography Reconstruction

CT Reconstruction using Diffusion Posterior Sampling conditioned on a Nonlinear Measurement Model

X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models

Patient-specific 3D Volumetric CBCT Image Reconstruction with Single X-Ray Projection Using Denoising Diffusion Probabilistic Model

Parallel Diffusion Model-based Sparse-view Cone-beam Breast CT

Texture-preserving diffusion model for CBCT-to-CT synthesis

Investigation of Discrete Imaging Models and Iterative Image Reconstruction in Differential X-ray Phase-Contrast Tomography.