Abstract:Evaluating, explaining, and visualizing high-level concepts in generative models, such as variational autoencoders (VAEs), is challenging in part due to a lack of known prediction classes that are required to generate saliency maps in supervised learning. While saliency maps may help identify relevant features (e.g., pixels) in the input for classification tasks of deep neural networks, similar frameworks are understudied in unsupervised learning. Therefore, we introduce a new method of obtaining saliency maps for latent representations of known or novel high-level concepts, often called concept vectors in generative models. Concept scores, analogous to class scores in classification tasks, are defined as dot products between concept vectors and encoded input data, which can be readily used to compute the gradients. The resulting concept saliency maps are shown to highlight input features deemed important for high-level concepts. Our method is applied to the VAE’s latent space of CelebA dataset in which known attributes such as "smiles" and "hats" are used to elucidate relevant facial features. Furthermore, our application to spatial transcriptomic (ST) data of a mouse olfactory bulb demonstrates the potential of latent representations of morphological layers and molecular features in advancing our understanding of complex biological systems. By extending the popular method of saliency maps to generative models, the proposed concept saliency maps help improve interpretability of latent variable models in deep learning.

Concept-Oriented Deep Learning: Generative Concept Representations

Latent Variable Modeling for Generative Concept Representations and Deep Generative Models

Concept-Oriented Deep Learning

Generative Creativity: Adversarial Learning For Bionic Design

Dual Embodied-Symbolic Concept Representations for Deep Learning

A Geometric Understanding of Deep Learning

Concept Saliency Maps to Visualize Relevant Features in Deep Generative Models

Generative Continual Concept Learning

CoLiDR: Concept Learning using Aggregated Disentangled Representations

Deep Generative Models on 3D Representations: A Survey

Generative Adversarial Networks: An Overview

Understanding Distributed Representations of Concepts in Deep Neural Networks without Supervision

Concept Evolution in Deep Learning Training: A Unified Interpretation Framework and Discoveries

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

Generating new concepts with hybrid neuro-symbolic models

On Unifying Deep Generative Models

Concept Lens: Visually Analyzing the Consistency of Semantic Manipulation in GANs

Visual Concept Learning: Combining Machine Vision and Bayesian Generalization on Concept Hierarchies

Semantics, Representations and Grammars for Deep Learning

Generative adversarial networks