Abstract:Large Language Models (LLMs) have become proficient in addressing complex tasks by leveraging their extensive internal knowledge and reasoning capabilities. However, the black-box nature of these models complicates the task of explaining their decision-making processes. While recent advancements demonstrate the potential of leveraging LLMs to self-explain their predictions through natural language (NL) explanations, their explanations may not accurately reflect the LLMs' decision-making process due to a lack of fidelity optimization on the derived explanations. Measuring the fidelity of NL explanations is a challenging issue, as it is difficult to manipulate the input context to mask the semantics of these explanations. To this end, we introduce FaithLM to explain the decision of LLMs with NL explanations. Specifically, FaithLM designs a method for evaluating the fidelity of NL explanations by incorporating the contrary explanations to the query process. Moreover, FaithLM conducts an iterative process to improve the fidelity of derived explanations. Experiment results on three datasets from multiple domains demonstrate that FaithLM can significantly improve the fidelity of derived explanations, which also provides a better alignment with the ground-truth explanations.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the opacity and unreliability of large - language models (LLMs) when explaining their decision - making processes. Specifically: 1. **The problem of fidelity in explanation**: Although large - language models perform well in handling complex tasks, their "black - box" nature makes it difficult to explain their decision - making processes. Existing natural - language explanation methods may not accurately reflect the actual decision - making processes of the models because these explanations lack optimization for fidelity. Therefore, how to measure and improve the fidelity of natural - language explanations has become an important research question. 2. **The problem of reliability in explanation**: Current methods often ignore the fidelity of explanations when generating natural - language explanations, resulting in explanations that may be unreliable. This is especially important in application areas that require high transparency and reliability, such as healthcare. To address these problems, the paper proposes the FaithLM framework, which aims to evaluate and improve the fidelity of natural - language explanations by introducing reverse explanations and generate more reliable explanations through iterative optimization. Specific objectives include: - **Proposing a new fidelity evaluation method**: By using reverse explanations as part of the input and observing the changes in the model output, the fidelity of the explanation is evaluated. - **Developing the FaithLM framework**: Using an iterative optimization method to gradually improve the fidelity of the generated natural - language explanations. - **Verifying the effectiveness of the method**: Through experiments on multiple datasets, it is proven that FaithLM can significantly improve the fidelity of explanations and that the generated explanations are more consistent with the real explanations. In summary, the main purpose of this paper is to solve the problems of fidelity and reliability in the generation of natural - language explanations by large - language models, thereby increasing the transparency and credibility of the models.

FaithLM: Towards Faithful Explanations for Large Language Models

Faithfulness vs. Plausibility: On the (Un)Reliability of Explanations from Large Language Models

Are self-explanations from Large Language Models faithful?

Evaluating Human Alignment and Model Faithfulness of LLM Rationale

Towards Faithful Natural Language Explanations: A Study Using Activation Patching in Large Language Models

Local Explanations and Self-Explanations for Assessing Faithfulness in black-box LLMs

Aligning Large Language Models for Faithful Integrity Against Opposing Argument

Faithful Explanations of Black-box NLP Models Using LLM-generated Counterfactuals

Towards Faithful Model Explanation in NLP: A Survey

Enhancing Large Language Models' Situated Faithfulness to External Contexts

Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement

Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate

Context-faithful Prompting for Large Language Models

Towards Consistent Natural-Language Explanations via Explanation-Consistency Finetuning

The Probabilities Also Matter: A More Faithful Metric for Faithfulness of Free-Text Explanations in Large Language Models

FaithEval: Can Your Language Model Stay Faithful to Context, Even If "The Moon is Made of Marshmallows"

On Measuring Faithfulness or Self-consistency of Natural Language Explanations

Towards Uncovering How Large Language Model Works: An Explainability Perspective

Comparing Explanation Faithfulness between Multilingual and Monolingual Fine-tuned Language Models

New Faithfulness-Centric Interpretability Paradigms for Natural Language Processing