Abstract:Interpretable clustering algorithms aim to group similar data points while explaining the obtained groups to support knowledge discovery and pattern recognition tasks. While most approaches to interpretable clustering construct clusters using decision trees, the interpretability of trees often deteriorates on complex problems where large trees are required. In this work, we introduce the Neural Clustering Additive Model (NeurCAM), a novel approach to the interpretable clustering problem that leverages neural generalized additive models to provide fuzzy cluster membership with additive explanations of the obtained clusters. To promote sparsity in our model's explanations, we introduce selection gates that explicitly limit the number of features and pairwise interactions leveraged. Additionally, we demonstrate the capacity of our model to perform text clustering that considers the contextual representation of the texts while providing explanations for the obtained clusters based on uni- or bi-word terms. Extensive experiments show that NeurCAM achieves performance comparable to black-box methods on tabular datasets while remaining interpretable. Additionally, our approach significantly outperforms other interpretable clustering approaches when clustering on text data.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? The paper "NEURCAM: Neural Clustering Additive Model for Explainable Clustering" aims to address the issue of explainable clustering algorithms. Specifically, the authors propose a new method called the Neural Clustering Additive Model (NeurCAM), which achieves explainable clustering through Neural Generalized Additive Models. The main objectives of the paper are as follows: 1. **Enhancing the interpretability of clustering**: - Traditional decision tree methods suffer from a significant drop in interpretability as the tree size increases when dealing with complex problems. NeurCAM provides fuzzy cluster membership through Neural Generalized Additive Models and maintains model interpretability through additive explanations. 2. **Introducing a selection gate mechanism**: - To promote the sparsity of model explanations, NeurCAM introduces a selection gate mechanism that explicitly limits the number of features and pairwise interactions used by the model. This helps reduce model complexity, making it easier to understand and validate. 3. **Interpretability in text clustering**: - NeurCAM also demonstrates its applicability in text clustering, considering contextual representations of text and providing cluster explanations based on single-word or bi-word terms. 4. **Balancing performance and interpretability**: - Experimental results show that NeurCAM performs comparably to black-box methods on tabular datasets while maintaining high interpretability. In text clustering tasks, NeurCAM significantly outperforms other explainable clustering methods. ### Main contributions of the paper 1. **Proposing a new explainable clustering method**: - Utilizing Neural Generalized Additive Models (Neural GAMs) to provide fuzzy cluster membership and generate explanations in the original feature space. 2. **Introducing a selection gate mechanism**: - Through the selection gate mechanism, users can explicitly limit the number of features and pairwise interactions used by the model, encouraging the sparsity of explanations. 3. **Demonstrating effectiveness on various datasets**: - Extensive experiments prove the effectiveness of NeurCAM in creating high-quality clusters and demonstrate the interpretability it provides. 4. **Innovative application in text clustering**: - Using transformer-based embeddings, NeurCAM can provide explanations based on single-word and bi-word terms in text clustering tasks, considering the structure and contextual information of documents. ### Summary NeurCAM addresses the issue of declining interpretability in traditional explainable clustering methods for complex problems by combining Neural Generalized Additive Models and a selection gate mechanism. It achieves a good balance between performance and interpretability, performing well across various datasets, with significant advantages in text clustering tasks.

NeurCAM: Interpretable Neural Clustering via Additive Models

Cluster-CAM: Cluster-weighted visual interpretation of CNNs' decision in image classification

Interpret3C: Interpretable Student Clustering Through Individualized Feature Selection

Interpretable Multimodal Fusion Networks Reveal Mechanisms of Brain Cognition

Feature CAM: Interpretable AI in Image Classification

Neural Additive Models for Location Scale and Shape: A Framework for Interpretable Neural Regression Beyond the Mean

A Concept and Argumentation based Interpretable Model in High Risk Domains

InterpretCC: Intrinsic User-Centric Interpretability through Global Mixture of Experts

Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation

Neural Additive Image Model: Interpretation through Interpolation

An Interpretable Neural Network for Robustly Determining the Location and Number of Cluster Centers

XAI Beyond Classification: Interpretable Neural Clustering

Salience-CAM: Visual Explanations from Convolutional Neural Networks Via Salience Score

Exploring the balance between interpretability and performance with carefully designed constrainable neural additive models

CR-CAM: Generating explanations for deep neural networks by contrasting and ranking features

Towards the Visualization of Aggregated Class Activation Maps to Analyse the Global Contribution of Class Features

MHCN: A Hyperbolic Neural Network Model for Multi-view Hierarchical Clustering

Enhancing brain tumor detection in MRI images through explainable AI using Grad-CAM with Resnet 50

CAManim: Animating end-to-end network activation maps

Neural Clustering based Visual Representation Learning