CoCPF: Coordinate-based Continuous Projection Field for Ill-Posed Inverse Problem in Imaging

Zixuan Chen,Lingxiao Yang,Jian-Huang Lai,Xiaohua Xie
2024-06-21
Abstract:Sparse-view computed tomography (SVCT) reconstruction aims to acquire CT images based on sparsely-sampled measurements. It allows the subjects exposed to less ionizing radiation, reducing the lifetime risk of developing cancers. Recent researches employ implicit neural representation (INR) techniques to reconstruct CT images from a single SV sinogram. However, due to ill-posedness, these INR-based methods may leave considerable ``holes'' (i.e., unmodeled spaces) in their fields, leading to sub-optimal results. In this paper, we propose the Coordinate-based Continuous Projection Field (CoCPF), which aims to build hole-free representation fields for SVCT reconstruction, achieving better reconstruction quality. Specifically, to fill the holes, CoCPF first employs the stripe-based volume sampling module to broaden the sampling regions of Radon transformation from rays (1D space) to stripes (2D space), which can well cover the internal regions between SV projections. Then, by feeding the sampling regions into the proposed differentiable rendering modules, the holes can be jointly optimized during training, reducing the ill-posed levels. As a result, CoCPF can accurately estimate the internal measurements between SV projections (i.e., DV sinograms), producing high-quality CT images after re-projection. Extensive experiments on simulated and real projection datasets demonstrate that CoCPF outperforms state-of-the-art methods for 2D and 3D SVCT reconstructions under various projection numbers and geometries, yielding fine-grained details and fewer artifacts. Our code will be publicly available.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the "ill - posed" inverse problem in sparse - view computed tomography (SVCT) reconstruction. Specifically, the goal of SVCT reconstruction is to obtain CT images based on sparsely sampled measurement data, which can reduce the time that subjects are exposed to ionizing radiation, thereby reducing the risk of cancer. However, the existing implicit neural representation (INR) methods have limitations when dealing with this problem, mainly in the following aspects: 1. **Ill - posed inverse problem**: Due to sparse sampling, the number of linearly independent measurements is less than the number of unknowns, resulting in an infinite number of solutions to the inverse problem, that is, an ill - posed problem. Direct use of reprojection techniques may lead to severe artifacts. 2. **Unmodeled space (Holes)**: Existing INR methods only establish a mapping relationship between coordinates and sinogram pixels based on the Radon transform and cannot cover the internal area, resulting in unmodeled space (holes) in the reconstruction results, which in turn produces blurry content and severe artifacts. To solve these problems, the authors propose the coordinate - based continuous projection field (CoCPF), which improves SVCT reconstruction in the following ways: 1. **Stripe - based volume sampling module**: Expand the sampling area of the Radon transform from one - dimensional space (rays) to two - dimensional space (stripes) to better cover the internal area between adjacent sparse - view projections. 2. **Piecewise - consistent volume rendering module and stripe - based hierarchical rendering module**: By introducing these differentiable rendering modules, jointly optimize the unmodeled space during the training process, reduce the ill - posed level, and improve the reconstruction quality. Finally, CoCPF can accurately estimate the internal measurement values between adjacent sparse - view projections (i.e., DV sinograms), thereby generating high - quality CT images, reducing artifacts and retaining more details. ### Summary The core problem of this paper is to solve the ill - posed inverse problem in SVCT reconstruction and propose a new method, CoCPF, to eliminate the unmodeled space problem existing in the INR methods, thereby achieving higher - quality CT image reconstruction.