Jiayang Shi,Daniel M. Pelt,K. Joost Batenburg
Abstract:In Computed Tomography (CT), an image of the interior structure of an object is computed from a set of acquired projection images. The quality of these reconstructed images is essential for accurate analysis, but this quality can be degraded by a variety of imaging artifacts. To improve reconstruction quality, the acquired projection images are often processed by a pipeline consisting of multiple artifact-removal steps applied in various image domains (e.g., outlier removal on projection images and denoising of reconstruction images). These artifact-removal methods exploit the fact that certain artifacts are easier to remove in a certain domain compared with other domains.
Recently, deep learning methods have shown promising results for artifact removal for CT images. However, most existing deep learning methods for CT are applied as a post-processing method after reconstruction. Therefore, artifacts that are relatively difficult to remove in the reconstruction domain may not be effectively removed by these methods. As an alternative, we propose a multi-stage deep learning method for artifact removal, in which neural networks are applied to several domains, similar to a classical CT processing pipeline. We show that the neural networks can be effectively trained in succession, resulting in easy-to-use and computationally efficient training. Experiments on both simulated and real-world experimental datasets show that our method is effective in reducing artifacts and superior to deep learning-based post-processing.
Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: how to effectively reduce multiple imaging artifacts in computed tomography (CT) images, especially those non - local artifacts that are difficult to process through local information in the reconstruction domain. Existing deep - learning methods mainly serve as post - processing steps after reconstruction and have limited effects on certain types of artifacts. Therefore, this paper proposes a multi - stage deep - learning method, aiming to gradually reduce artifacts in multiple data domains (such as projection images, sinograms, and reconstructed images).
### Specific Problem Description
1. **The Impact of Artifacts on CT Image Quality**
- The quality of CT images is crucial for accurate analysis, but various artifacts may be introduced during the imaging process, such as noise, ring artifacts, and zinger artifacts, which will degrade the image quality.
- Especially in low - dose CT, due to the low photon count, the projection images usually contain a large amount of noise, resulting in a high noise level in the reconstructed image and affecting feature detection.
2. **Limitations of Existing Methods**
- Traditional artifact - reduction methods rely on manual parameter setting, are prone to introducing additional artifacts, and require complex parameter adjustment.
- Most existing deep - learning methods are post - processing steps after reconstruction. Although they have a good effect on noise, they are not effective for non - local artifacts (such as ring artifacts and zinger artifacts).
### Proposed Solution
This paper proposes a multi - stage deep - learning method, which specifically includes the following aspects:
- **Multi - stage Processing**: Use three convolutional neural networks (CNNs) to perform artifact removal at three different stages of projection images, sinograms, and reconstructed images respectively.
- **Sequential Training**: To ensure computational efficiency, the three CNNs are trained independently in sequence, avoiding the high computational cost brought by end - to - end training.
- **Data - Driven Optimization**: Automatically learn the optimal parameters for artifact removal through supervised learning without the need for manual adjustment of complex parameters.
### Specific Process of the Method
1. **First Stage (Projection Image Processing)**
\[
p^* = f_{\theta_p}(\hat{p})
\]
Use the CNN \( f_{\theta_p} \) to process the projection image and obtain the de - artifacted projection image \( p^* \).
2. **Second Stage (Sinogram Processing)**
\[
s^* = f_{\theta_s}(T(\hat{p}), T(p^*))
\]
Use the CNN \( f_{\theta_s} \) to process the original and de - artifacted sinograms and obtain the de - artifacted sinogram \( s^* \).
3. **Third Stage (Reconstructed Image Processing)**
\[
r^* = f_{\theta_r}(R(T(\hat{p})), R(T(p^*)), R(s^*))
\]
Use the CNN \( f_{\theta_r} \) to process the original, the output of the first stage, and the output of the second stage of the reconstructed image, and finally obtain the de - artifacted reconstructed image \( r^* \).
Through this multi - stage processing method, this paper aims to improve the reconstruction quality of CT images and provide a more effective solution especially for non - local artifacts. Experimental results show that this method is superior to existing deep - learning post - processing methods in reducing artifacts.