Abstract:As an emerging interpretable technique, Generalized Additive Models (GAMs) adopt neural networks to individually learn non-linear functions for each feature, which are then combined through a linear model for final predictions. Although GAMs can explain deep neural networks (DNNs) at the feature level, they require large numbers of model parameters and are prone to overfitting, making them hard to train and scale. Additionally, in real-world datasets with many features, the interpretability of feature-based explanations diminishes for humans. To tackle these issues, recent research has shifted towards concept-based interpretable methods. These approaches try to integrate concept learning as an intermediate step before making predictions, explaining the predictions in terms of human-understandable concepts. However, these methods require domain experts to extensively label concepts with relevant names and their ground-truth values. In response, we propose CAT, a novel interpretable Concept-bAsed Taylor additive model to simply this process. CAT does not have to require domain experts to annotate concepts and their ground-truth values. Instead, it only requires users to simply categorize input features into broad groups, which can be easily accomplished through a quick metadata review. Specifically, CAT first embeds each group of input features into one-dimensional high-level concept representation, and then feeds the concept representations into a new white-box Taylor Neural Network (TaylorNet). The TaylorNet aims to learn the non-linear relationship between the inputs and outputs using polynomials. Evaluation results across multiple benchmarks demonstrate that CAT can outperform or compete with the baselines while reducing the need of extensive model parameters. Importantly, it can explain model predictions through high-level concepts that human can understand.

GATS: Gather-Attend-Scatter

GATSBI: Generative Agent-centric Spatio-temporal Object Interaction

GATS: Generative Audience Targeting System for Online Advertising

UTMGAT: a unified transformer with memory encoder and graph attention networks for multidomain dialogue state tracking

UnifiedVisionGPT: Streamlining Vision-Oriented AI through Generalized Multimodal Framework

CAT: Interpretable Concept-based Taylor Additive Models

GATSBI: Generative Adversarial Training for Simulation-Based Inference

VisionGPT-3D: A Generalized Multimodal Agent for Enhanced 3D Vision Understanding

A Generalist Agent

GAT: Guided Adversarial Training with Pareto-optimal Auxiliary Tasks

GPPF: A General Perception Pre-training Framework via Sparsely Activated Multi-Task Learning

Enhancing Heterogeneous Knowledge Graph Completion with a Novel GAT-based Approach

Globally-scalable Automated Target Recognition (GATR)

VisionGPT: Vision-Language Understanding Agent Using Generalized Multimodal Framework

CAT: Learning to Collaborate Channel and Spatial Attention from Multi-Information Fusion

Jack and Masters of all Trades: One-Pass Learning Sets of Model Sets From Large Pre-Trained Models

GATER: Learning Grasp-Action-Target Embeddings and Relations for Task-Specific Grasping

ModelGPT: Unleashing LLM's Capabilities for Tailored Model Generation

scGNN+: Adapting ChatGPT for Seamless Tutorial and Code Optimization

GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation