Abstract:Background: The application of artificial intelligence (AI) to electrocardiograms (ECGs) has shown great promise in the screening and diagnosis of cardiovascular diseases, often matching or surpassing human expertise. However, the black-box nature of deep learning models poses significant challenges to their clinical adoption. While Explainable AI (XAI) techniques, such as Saliency Maps, have attempted to address these issues, they have not been able to provide clear, clinically relevant explanations. We developed the Generative Counterfactual ECG XAI (GCX) framework, which uses counterfactual scenarios to explain AI predictions, enhancing interpretability and aligning with medical knowledge. Methods: We designed a study to validate the GCX framework by applying it to eight AI-ECG models, including those focused on regression of six ECG features, potassium level regression, and atrial fibrillation (AF) classification. PTB-XL and MIMIC-IV were used to develop and test. GCX generated counterfactual (CF) ECGs to visualize how changes in the ECG relate to AI-ECG predictions. We visualized CF ECGs for qualitative comparisons, statistically compared ECG features, and validated these findings with conventional ECG knowledge. Results: The GCX framework successfully generated interpretable ECGs aligned with clinical knowledge, particularly in the context of ECG feature regression, potassium level regression, and AF classification. For ECG feature regression, GCX demonstrated clear and consistent changes in features, reflecting the corresponding morphological alterations. CF ECGs for hyperkalemia showed a prolonged PR, discernible P wave, increased T wave amplitude, and widened QRS complex, whereas those for AF demonstrated the disappearance of the P wave and irregular rhythms. Conclusion: The GCX framework enhances the interpretability of AI-ECG models, offering clear relevant explanations for AI predictions. This approach holds substantial potential for improving the trust and utility of AI in clinical practice, although further validation across diverse datasets is required.

QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems

Toward explainable AI-empowered cognitive health assessment

An Explainable AI Framework for Artificial Intelligence of Medical Things

Explaining deep learning for ECG analysis: Building blocks for auditing and knowledge discovery

Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models.

Explainable Artificial Intelligence (XAI) for Deep Learning Based Medical Imaging Classification

Explainable AI for Medical Image Analysis in Medical Cyber-Physical Systems: Enhancing Transparency and Trustworthiness of IoMT

Designing ECG Monitoring Healthcare System with Federated Transfer Learning and Explainable AI

Towards explainability in artificial intelligence frameworks for heartcare: A comprehensive survey

A Comparative Study and Systematic Analysis of XAI Models and their Applications in Healthcare

Explainable AI for Medical Data: Current Methods, Limitations, and Future Directions

Explainable Artificial Intelligence for Medical Applications: A Review

Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond

Explainable Artificial Intelligence for Predictive Modeling in Healthcare

A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI

Exploring Interpretable AI Methods for ECG Data Classification

Framework for Classifying Explainable Artificial Intelligence (XAI) Algorithms in Clinical Medicine

A Survey on Medical Explainable AI (XAI): Recent Progress, Explainability Approach, Human Interaction and Scoring System

Recent Advances in Explainable Artificial Intelligence for Magnetic Resonance Imaging

Unveiling AI-ECG using Generative Counterfactual XAI Framework