Swap-Net: A Memory-Efficient 2.5D Network for Sparse-View 3D Cone Beam CT Reconstruction

Xiaojian Xu,Marc Klasky,Michael T. McCann,Jason Hu,Jeffrey A. Fessler
2024-09-29
Abstract:Reconstructing 3D cone beam computed tomography (CBCT) images from a limited set of projections is an important inverse problem in many imaging applications from medicine to inertial confinement fusion (ICF). The performance of traditional methods such as filtered back projection (FBP) and model-based regularization is sub-optimal when the number of available projections is limited. In the past decade, deep learning (DL) has gained great popularity for solving CT inverse problems. A typical DL-based method for CBCT image reconstruction is to learn an end-to-end mapping by training a 2D or 3D network. However, 2D networks fail to fully use global information. While 3D networks are desirable, they become impractical as image sizes increase because of the high memory cost. This paper proposes Swap-Net, a memory-efficient 2.5D network for sparse-view 3D CBCT image reconstruction. Swap-Net uses a sequence of novel axes-swapping operations to produce 3D volume reconstruction in an end-to-end fashion without using full 3D convolutions. Simulation results show that Swap-Net consistently outperforms baseline methods both quantitatively and qualitatively in terms of reducing artifacts and preserving details of complex hydrodynamic simulations of relevance to the ICF community.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to perform high - quality 3D cone - beam computed tomography (CBCT) image reconstruction with limited projection data. Specifically, traditional reconstruction methods such as filtered back - projection (FBP) and model - based regularization perform poorly when the projection data is incomplete or irregularly sampled, and are prone to generate noise and artifacts. Although deep learning (DL) methods have made significant progress in solving CT inverse problems, 2D networks cannot fully utilize global information, and 3D networks become impractical when dealing with large - scale images due to high memory costs. Therefore, this paper proposes a memory - efficient 2.5D network named Swap - Net, aiming to overcome these limitations, achieve 3D CBCT image reconstruction from sparse views, while reducing artifacts and preserving details in complex fluid - dynamics simulations.