Abstract:Medical image analysis plays a crucial role in healthcare systems of Internet of Medical Things (IoMT), aiding in the diagnosis, treatment planning, and monitoring of various diseases. With the increasing adoption of artificial intelligence (AI) techniques in medical image analysis, there is a growing need for transparency and trustworthiness in decision-making. This study explores the application of explainable AI (XAI) in the context of medical image analysis within medical cyber-physical systems (MCPS) to enhance transparency and trustworthiness. To this end, this study proposes an explainable framework that integrates machine learning and knowledge reasoning. The explainability of the model is realized when the framework evolution target feature results and reasoning results are the same and are relatively reliable. However, using these technologies also presents new challenges, including the need to ensure the security and privacy of patient data from IoMT. Therefore, attack detection is an essential aspect of MCPS security. For the MCPS model with only sensor attacks, the necessary and sufficient conditions for detecting attacks are given based on the definition of sparse observability. The corresponding attack detector and state estimator are designed by assuming that some IoMT sensors are under protection. It is expounded that the IoMT sensors under protection play an important role in improving the efficiency of attack detection and state estimation. The experimental results show that the XAI in the context of medical image analysis within MCPS improves the accuracy of lesion classification, effectively removes low-quality medical images, and realizes the explainability of recognition results. This helps doctors understand the logic of the system's decision-making and can choose whether to trust the results based on the explanation given by the framework.

An interpretability security framework for intelligent decision support systems based on saliency map

Exploring the Interplay of Interpretability and Robustness in Deep Neural Networks: A Saliency-guided Approach

Detection defense against adversarial attacks with saliency map

Sample-analysis Based Adversarial Attack with Saliency Map

Interpretable Deep Learning Method for Attack Detection Based on Spatial Domain Attention.

Interpretable Deep Learning under Fire

Information Fingerprint for Secure Industrial Big Data Analytics.

Defense Against Adversarial Attacks in Traffic Sign Images Identification Based on 5G

A Machine Learning Based Intrusion Detection System for Software Defined 5 G Network

Explainable GeoAI: can saliency maps help interpret artificial intelligence's learning process? An empirical study on natural feature detection

Adversarial example detection based on saliency map features

Explainable AI and Deep Autoencoders Based Security Framework for IoT Network Attack Certainty (Extended Abstract)

The role of saliency maps in enhancing ophthalmologists' trust in artificial intelligence models

Explaining Network Intrusion Detection System Using Explainable AI Framework

Saliency Map-Based Local White-Box Adversarial Attack Against Deep Neural Networks

Artificial Intelligence Security in 5G Networks: Adversarial Examples for Estimating a Travel Time Task.

A deep learning anomaly detection framework with explainability and robustness

Explainable AI for Medical Image Analysis in Medical Cyber-Physical Systems: Enhancing Transparency and Trustworthiness of IoMT

Blind Surveillance Image Quality Assessment Via Deep Neural Network Combined with the Visual Saliency

SSOLV: Real-Time AI/ML-Based Cybersecurity via Statistical Analysis

Deceiving Post-Hoc Explainable AI (XAI) Methods in Network Intrusion Detection