Abstract:Rational Deep learning (DL) has demonstrated a remarkable performance in diagnostic imaging for various diseases and modalities and therefore has a high potential to be used as a clinical tool. However, current practice shows low deployment of these algorithms in clinical practice, because DL algorithms lack transparency and trust due to their underlying black-box mechanism. For successful employment, explainable artificial intelligence (XAI) could be introduced to close the gap between the medical professionals and the DL algorithms. In this literature review, XAI methods available for magnetic resonance (MR), computed tomography (CT), and positron emission tomography (PET) imaging are discussed and future suggestions are made. Methods PubMed, Embase.com and Clarivate Analytics/Web of Science Core Collection were screened. Articles were considered eligible for inclusion if XAI was used (and well described) to describe the behavior of a DL model used in MR, CT and PET imaging. Results A total of 75 articles were included of which 54 and 17 articles described post and ad hoc XAI methods, respectively, and 4 articles described both XAI methods. Major variations in performance is seen between the methods. Overall, post hoc XAI lacks the ability to provide class-discriminative and target-specific explanation. Ad hoc XAI seems to tackle this because of its intrinsic ability to explain. However, quality control of the XAI methods is rarely applied and therefore systematic comparison between the methods is difficult. Conclusion There is currently no clear consensus on how XAI should be deployed in order to close the gap between medical professionals and DL algorithms for clinical implementation. We advocate for systematic technical and clinical quality assessment of XAI methods. Also, to ensure end-to-end unbiased and safe integration of XAI in clinical workflow, (anatomical) data minimization and quality control methods should be included.

Machine learning in industrial X-ray computed tomography – a review

Algorithm-driven Advances for Scientific CT Instruments: From Model-based to Deep Learning-based Approaches

Machine learning based sinogram interpolation for X-ray computed tomography validated on experimental data

Computer Vision on X-ray Data in Industrial Production and Security Applications: A Comprehensive Survey

Deep learning based workflow for accelerated industrial X-ray Computed Tomography

Towards Automatic Threat Detection: A Survey of Advances of Deep Learning within X-ray Security Imaging

A tomographic workflow to enable deep learning for X-ray based foreign object detection

Machine Learning in X-ray Diagnosis for Oral Health: A Review of Recent Progress

AIDM-CT: software for cone-beam X-ray tomography and deep-learning-based analysis

Deep Learning Methods to Guide CT Image Reconstruction and Reduce Metal Artifacts

Advancements in machine learning techniques for threat item detection in X-ray images: a comprehensive survey

Deep learning for tomographic image reconstruction

Radiological images and machine learning: Trends, perspectives, and prospects

A novel design of industrial real-time CT system based on sparse-view reconstruction and deep-learning image enhancement

Deep learning-based algorithms for low-dose CT imaging: A review

Recent advances in surface defect inspection of industrial products using deep learning techniques

Enabling Low-Dose In Vivo Benchtop X-ray Fluorescence Computed Tomography through Deep-Learning-Based Denoising

Deploying Machine Learning for Radiography of Aerospace Welds

Explainable artificial intelligence (XAI) in radiology and nuclear medicine: a literature review

Advantage of Machine Learning over Maximum Likelihood in Limited-Angle Low-Photon X-Ray Tomography

High-performance deep learning segmentation for non-destructive testing of X-ray tomography