Abstract:Deep convolutional neural networks (CNNs) have achieved remarkable success in various computer vision tasks. However, the lack of interpretability in these models has raised concerns and hindered their widespread adoption in critical domains. Generating activation maps that highlight the regions contributing to the CNN's decision has emerged as a popular approach to visualize and interpret these models. Nevertheless, existing methods often produce activation maps contaminated with irrelevant background noise or incomplete object activation, limiting their effectiveness in providing meaningful explanations. To address this challenge, we propose Union Class Activation Mapping (UnionCAM), an innovative visual interpretation framework that generates high-quality class activation maps (CAMs) through a novel three-step approach. UnionCAM introduces a weighted fusion strategy that adaptively combines multiple CAMs to create more informative and comprehensive activation maps. First, the denoising module removes background noise from CAMs by using adaptive thresholding. Subsequently, the union module fuses the denoised CAMs with region-based CAMs using a weighted combination scheme to obtain more comprehensive and informative maps, which we refer to as fused CAMs. Lastly, the activation map selection module automatically selects the optimal CAM that offers the best interpretation from the pool of fused CAMs. Extensive experiments on ILSVRC2012 and VOC2007 datasets demonstrate UnionCAM's superior performance over state-of-the-art methods. It effectively suppresses background noise, captures complete object regions, and provides intuitive visual explanations. UnionCAM achieves significant improvements in insertion and deletion scores, outperforming the best baseline. UnionCAM makes notable contributions by introducing a novel denoising strategy, adaptive fusion of CAMs, and an automatic selection mechanism. It bridges the gap between CNN performance and interpretability, providing a valuable tool for understanding and trusting CNN-based systems. UnionCAM has the potential to foster responsible deployment of CNNs in real-world applications.

SW-CAM: Class Activation Map with Feature Map Selection and Weight Modification

Score-CAM++: Class Discriminative Localization with Feature Map Selection

Hierarchical Saliency Mapping for Weakly Supervised Object Localization Based on Class Activation Mapping

Statistic-CAM: A Gradient-Free Visual Explanations for Deep Convolutional Network

Salience-CAM: Visual Explanations from Convolutional Neural Networks Via Salience Score

Opti-CAM: Optimizing saliency maps for interpretability

Extracting Class Activation Maps from Non-Discriminative Features as well

Group-CAM: Group Score-Weighted Visual Explanations for Deep Convolutional Networks

Generating Self-Attention Activation Maps for Visual Interpretations of Convolutional Neural Networks

Efficient Saliency Detection Using Convolutional Neural Networks with Feature Selection

BroadCAM: Outcome-agnostic Class Activation Mapping for Small-scale Weakly Supervised Applications

CR-CAM: Generating explanations for deep neural networks by contrasting and ranking features

SC-SM CAM: an Efficient Visual Interpretation of CNN for SAR Images Target Recognition

UnionCAM: enhancing CNN interpretability through denoising, weighted fusion, and selective high-quality class activation mapping

Score-CAM: Improved Visual Explanations Via Score-Weighted Class Activation Mapping

Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks

DCAM: Disturbed Class Activation Maps for Weakly Supervised Semantic Segmentation

HAM: Hybrid Attention Module in Deep Convolutional Neural Networks for Image Classification

Shap-CAM: Visual Explanations for Convolutional Neural Networks Based on Shapley Value.

G-SM-CAM: A Fast Visual Understanding of CNNs in SAR Images Interpretation

CAM-loss: Towards Learning Spatially Discriminative Feature Representations