Learning to Distill Global Representation for Sparse-View CT

Zilong Li,Chenglong Ma,Jie Chen,Junping Zhang,Hongming Shan

2023-08-19

Abstract:Sparse-view computed tomography (CT) -- using a small number of projections for tomographic reconstruction -- enables much lower radiation dose to patients and accelerated data acquisition. The reconstructed images, however, suffer from strong artifacts, greatly limiting their diagnostic value. Current trends for sparse-view CT turn to the raw data for better information recovery. The resultant dual-domain methods, nonetheless, suffer from secondary artifacts, especially in ultra-sparse view scenarios, and their generalization to other scanners/protocols is greatly limited. A crucial question arises: have the image post-processing methods reached the limit? Our answer is not yet. In this paper, we stick to image post-processing methods due to great flexibility and propose global representation (GloRe) distillation framework for sparse-view CT, termed GloReDi. First, we propose to learn GloRe with Fourier convolution, so each element in GloRe has an image-wide receptive field. Second, unlike methods that only use the full-view images for supervision, we propose to distill GloRe from intermediate-view reconstructed images that are readily available but not explored in previous literature. The success of GloRe distillation is attributed to two key components: representation directional distillation to align the GloRe directions, and band-pass-specific contrastive distillation to gain clinically important details. Extensive experiments demonstrate the superiority of the proposed GloReDi over the state-of-the-art methods, including dual-domain ones. The source code is available at <a class="link-external link-https" href="https://github.com/longzilicart/GloReDi" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to effectively reduce artifacts in images and improve image quality in sparse - view CT (Computed Tomography) reconstruction. Specifically, the paper focuses on how to overcome the problem of severe streak artifacts caused by insufficient data when using a small amount of projection data for CT image reconstruction, thereby enhancing the diagnostic value of the images.

Traditional methods such as Filtered Back - Projection (FBP) will produce severe global streak artifacts when dealing with sparse - view CT, which greatly limits their diagnostic value. Although the current trend is to turn to raw data for better information recovery, these methods are prone to produce secondary artifacts in the ultra - sparse - view scenario and have limited generalization ability for other scanners / protocols. Therefore, this paper proposes an image - post - processing - based method to improve the reconstruction quality of sparse - view CT by learning Global Representations (GloRe), and proposes the GloReDi framework. This framework utilizes Fast Fourier Convolution (FFC) to learn GloRe with a global receptive field, and at the same time distills knowledge from intermediate - view reconstructed images to provide high - quality information recovery and reconstruction. In this way, GloReDi aims to solve the limitations of existing methods in dealing with global information and the problem of representing direction alignment between CT images of different views, and finally achieve better sparse - view CT image reconstruction results.