Abstract:Computed tomography (CT) images are often corrupted by undesirable artifacts due to the presence of metallic implants, creating the problem of metal artifact reduction (MAR). Existing deep learning-based efforts of tackling this problem share two main common limitations, limiting their practical applications. Firstly, single domain knowledge is insufficient for MAR task, since image domain networks ignore the consistency constraint, while sinogram (X-ray projection) domain networks inevitably result in severe secondary artifacts. Secondly, dual domain networks which overcome this issue by jointly training subnetworks in both domains occupy more GPU memory during training due to joint training nature of their subnetworks. To address these issues, we propose a novel dual domain MAR framework that couples model- and data-driven networks. The proposed coupling strategy can help save GPU memory during training and enables the utilization of complementary network architectures. Specifically, we build a tight frame-based model-driven image domain subnetwork via encoding the non-local repetitive streaking patterns of metal artifacts as an explicit tight frame sparse representation model, while elaborate a transformer-based data-driven sinogram domain subnetwork. These two constructed subnetworks are coupled and trained separately to save GPU memory. To link the sinogram and image domains, we elaborate a prior artifact-attention threshold generating (PATG) module, which passes sinogram domain information to the image domain. The PATG module adaptively rescales multiple prior metal artifacts by taking into account the interdependencies among these artifacts. Extensive experiments on synthesized and clinical datasets demonstrate that the proposed method outperforms the state-of-the-art MAR methods by a large margin in terms of artifact reduction accuracy.

An Improved Dual-Domain Network for Metal Artifact Reduction in CT Images Using Aggregated Contextual Transformations.

DuDoNet: Dual Domain Network for CT Metal Artifact Reduction

DAN-Net: Dual-domain adaptive-scaling non-local network for CT metal artifact reduction

Coupling Model- and Data-Driven Networks for CT Metal Artifact Reduction

InDuDoNet+: A Deep Unfolding Dual Domain Network for Metal Artifact Reduction in CT Images

PND-Net: Physics based Non-local Dual-domain Network for Metal Artifact Reduction

IDOL-Net: An Interactive Dual-Domain Parallel Network for CT Metal Artifact Reduction

PND-Net: Physics-inspired Non-local Dual-domain Network for Metal Artifact Reduction

InDuDoNet+: A Model-Driven Interpretable Dual Domain Network for Metal Artifact Reduction in CT Images.

U-DuDoNet: Unpaired Dual-Domain Network for CT Metal Artifact Reduction

Encoding Metal Mask Projection for Metal Artifact Reduction in Computed Tomography

Metal artifact reduction in 2D CT images with self-supervised cross-domain learning

DuDoNet++: Encoding mask projection to reduce CT metal artifacts.

Quad-Net: Quad-domain Network for CT Metal Artifact Reduction

A Cross-Domain Metal Trace Restoring Network for Reducing X-Ray CT Metal Artifacts

TriDoNet: A Triple Domain Model-driven Network for CT Metal Artifact Reduction

InDuDoNet: An Interpretable Dual Domain Network for CT Metal Artifact Reduction

A deep recurrent neural network with primal-dual optimization for CT metal artifact reduction

Unsupervised CT Metal Artifact Reduction by Plugging Diffusion Priors in Dual Domains

ADN: Artifact Disentanglement Network for Unsupervised Metal Artifact Reduction

DuDoUFNet: Dual-Domain Under-to-Fully-Complete Progressive Restoration Network for Simultaneous Metal Artifact Reduction and Low-Dose CT Reconstruction