TACE: Tumor-Aware Counterfactual Explanations

Eleonora Beatrice Rossi,Eleonora Lopez,Danilo Comminiello

2024-09-20

Abstract:The application of deep learning in medical imaging has significantly advanced diagnostic capabilities, enhancing both accuracy and efficiency. Despite these benefits, the lack of transparency in these AI models, often termed "black boxes," raises concerns about their reliability in clinical settings. Explainable AI (XAI) aims to mitigate these concerns by developing methods that make AI decisions understandable and trustworthy. In this study, we propose Tumor Aware Counterfactual Explanations (TACE), a framework designed to generate reliable counterfactual explanations for medical images. Unlike existing methods, TACE focuses on modifying tumor-specific features without altering the overall organ structure, ensuring the faithfulness of the counterfactuals. We achieve this by including an additional step in the generation process which allows to modify only the region of interest (ROI), thus yielding more reliable counterfactuals as the rest of the organ remains unchanged. We evaluate our method on mammography images and brain MRI. We find that our method far exceeds existing state-of-the-art techniques in quality, faithfulness, and generation speed of counterfactuals. Indeed, more faithful explanations lead to a significant improvement in classification success rates, with a 10.69% increase for breast cancer and a 98.02% increase for brain tumors. The code of our work is available at <a class="link-external link-https" href="https://github.com/ispamm/TACE" rel="external noopener nofollow">this https URL</a>.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

This paper attempts to address the problem of generating reliable Counterfactual Explanations in medical imaging. Specifically, existing counterfactual explanation methods not only modify the region of interest (ROI) during the generation process but also alter the overall structure of the organ, resulting in unrealistic and unreliable counterfactual images. The paper proposes a new framework—Tumor-Aware Counterfactual Explanations (TACE), which aims to generate more reliable and realistic counterfactual explanations by modifying only tumor-related features without changing the overall structure of the organ.

### Main Contributions
1. **Tumor-Aware Generation**: TACE focuses on identifying and manipulating tumor features (such as size, shape, and intensity), ensuring that the generated counterfactual images remain faithful to the original images.
2. **Additional Generation Step**: An additional generation step is introduced, which only modifies the region of interest (ROI), thereby improving the reliability of the counterfactual images.
3. **High-Quality Generation**: TACE generates higher quality counterfactual images in breast cancer and brain tumor classification tasks, with faster generation speed and significantly improved classification success rates.

### Experimental Results
- **Quantitative Analysis**: TACE outperforms existing methods (such as StylEx and OCTET) in terms of the quality and speed of generating counterfactual images. Specifically, it achieves lower LPIPS and FID scores, as well as higher classification success rates.
- **Qualitative Analysis**: The counterfactual images generated by TACE are more faithful to the original images and do not alter the overall structure of the organ, making them more clinically relevant and practical.

### Conclusion
TACE generates more reliable and realistic counterfactual explanations by modifying only tumor-related features without changing the overall structure of the organ. This provides more transparent and credible explanations for diagnoses in medical imaging, helping to improve the accuracy and efficiency of diagnoses. Future work will explore the use of diffusion models to further enhance the effectiveness of counterfactual generation.