Abstract:Imitation learning, which learns agent policy by mimicking expert demonstration, has shown promising results in many applications such as medical treatment regimes and self-driving vehicles. However, it remains a difficult task to interpret control policies learned by the agent. Difficulties mainly come from two aspects: 1) agents in imitation learning are usually implemented as deep neural networks, which are black-box models and lack interpretability; 2) the latent causal mechanism behind agents' decisions may vary along the trajectory, rather than staying static throughout time steps. To increase transparency and offer better interpretability of the neural agent, we propose to expose its captured knowledge in the form of a directed acyclic causal graph, with nodes being action and state variables and edges denoting the causal relations behind predictions. Furthermore, we design this causal discovery process to be state-dependent, enabling it to model the dynamics in latent causal graphs. Concretely, we conduct causal discovery from the perspective of Granger causality and propose a self-explainable imitation learning framework, {\method}. The proposed framework is composed of three parts: a dynamic causal discovery module, a causality encoding module, and a prediction module, and is trained in an end-to-end manner. After the model is learned, we can obtain causal relations among states and action variables behind its decisions, exposing policies learned by it. Experimental results on both synthetic and real-world datasets demonstrate the effectiveness of the proposed {\method} in learning the dynamic causal graphs for understanding the decision-making of imitation learning meanwhile maintaining high prediction accuracy.

Interpretable Generative Adversarial Imitation Learning

InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations

Non-Adversarial Imitation Learning and its Connections to Adversarial Methods

On Computation and Generalization of Generative Adversarial Imitation Learning.

Efficient Off-policy Adversarial Imitation Learning with Imperfect Demonstrations

Interpretable Imitation Learning with Dynamic Causal Relations

Adversarial imitation learning with mixed demonstrations from multiple demonstrators

Independent Generative Adversarial Self-Imitation Learning in Cooperative Multiagent Systems

Adversarial Imitation Learning from Incomplete Demonstrations

Domain-Robust Visual Imitation Learning with Mutual Information Constraints

Wasserstein Distance guided Adversarial Imitation Learning with Reward Shape Exploration

Latent Policies for Adversarial Imitation Learning

Diffusing States and Matching Scores: A New Framework for Imitation Learning

Generative Adversarial Imitation Learning from Failed Experiences

Ranking-Based Generative Adversarial Imitation Learning

C-GAIL: Stabilizing Generative Adversarial Imitation Learning with Control Theory

Robust Adversarial Imitation Learning Via Adaptively-Selected Demonstrations

GAILPG: Multi-Agent Policy Gradient with Generative Adversarial Imitation Learning

Situated GAIL: Multitask imitation using task-conditioned adversarial inverse reinforcement learning

Adversarial Imitation Learning from Visual Observations using Latent Information

Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets