Abstract:Recently, explanatory natural language inference has attracted much attention for the interpretability of logic relationship prediction, which is also known as explanation generation for Natural Language Inference (NLI). Existing explanation generators based on discriminative Encoder-Decoder architecture have achieved noticeable results. However, we find that these discriminative generators usually generate explanations with correct evidence but incorrect logic semantic. It is due to that logic information is implicitly encoded in the premise-hypothesis pairs and difficult to model. Actually, logic information identically exists between premise-hypothesis pair and explanation. And it is easy to extract logic information that is explicitly contained in the target explanation. Hence we assume that there exists a latent space of logic information while generating explanations. Specifically, we propose a generative model called Variational Explanation Generator (VariationalEG) with a latent variable to model this space. Training with the guide of explicit logic information in target explanations, latent variable in VariationalEG could capture the implicit logic information in premise-hypothesis pairs effectively. Additionally, to tackle the problem of posterior collapse while training VariaztionalEG, we propose a simple yet effective approach called Logic Supervision on the latent variable to force it to encode logic information. Experiments on explanation generation benchmark—explanation-Stanford Natural Language Inference (e-SNLI) demonstrate that the proposed VariationalEG achieves significant improvement compared to previous studies and yields a state-of-the-art result. Furthermore, we perform the analysis of generated explanations to demonstrate the effect of the latent variable. Keywords—Natural Language Inference, explanation generation, variational auto-encoder, generative model.

LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multi-modal Foundation Models

Explaining latent representations of generative models with large multimodal models

Multimodal Latent Language Modeling with Next-Token Diffusion

Towards Interpretable Natural Language Understanding with Explanations As Latent Variables

Variational Explanation Generator: Generating Explanation for Natural Language Inference Using Variational Auto-Encoder

Generative Example-Based Explanations: Bridging the Gap between Generative Modeling and Explainability

Explaining Deep Convolutional Neural Networks via Latent Visual-Semantic Filter Attention

Multi-Level Explanations for Generative Language Models

Latent Concept-based Explanation of NLP Models

Diffexplainer: Towards Cross-modal Global Explanations with Diffusion Models

LMExplainer: Grounding Knowledge and Explaining Language Models

Towards Uncovering How Large Language Model Works: An Explainability Perspective

Joint Gaussian Mixture Model for Versatile Deep Visual Model Explanation

Generative Local Interpretable Model-Agnostic Explanations

From Latent to Lucid: Transforming Knowledge Graph Embeddings into Interpretable Structures

Unlocking the Potential of Large Language Models for Explainable Recommendations

Automatically Interpreting Millions of Features in Large Language Models

LLMExplainer: Large Language Model based Bayesian Inference for Graph Explanation Generation

T-Explainer: A Model-Agnostic Explainability Framework Based on Gradients

Explaining machine learning models using entropic variable projection

LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks