Abstract:For automatic human figure drawing (HFD) assessment tasks, such as diagnosing autism spectrum disorder (ASD) using HFD images, the clarity and explainability of a model decision are crucial. Existing pixel-level attribution-based explainable AI (XAI) approaches demand considerable effort from users to interpret the semantic information of a region in an image, which can be often time-consuming and impractical. To overcome this challenge, we propose a part contribution evaluation based model explanation (PCEvE) framework. On top of the part detection, we measure the Shapley Value of each individual part to evaluate the contribution to a model decision. Unlike existing attribution-based XAI approaches, the PCEvE provides a straightforward explanation of a model decision, i.e., a part contribution histogram. Furthermore, the PCEvE expands the scope of explanations beyond the conventional sample-level to include class-level and task-level insights, offering a richer, more comprehensive understanding of model behavior. We rigorously validate the PCEvE via extensive experiments on multiple HFD assessment datasets. Also, we sanity-check the proposed method with a set of controlled experiments. Additionally, we demonstrate the versatility and applicability of our method to other domains by applying it to a photo-realistic dataset, the Stanford Cars.

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to solve the problem of model interpretability in the Automatic Human Figure Drawing (HFD) assessment task, especially how to provide clear and interpretable model decisions for medical applications such as diagnosing Autism Spectrum Disorder (ASD). Existing Explainable AI (XAI) methods based on pixel - level attribution require users to spend a great deal of time and effort to interpret the semantic information of regions in the image, which is usually time - consuming and impractical. To address this challenge, the authors propose a model explanation framework based on Part Contribution Evaluation - PCEvE (Part Contribution Evaluation based model Explanation). This framework improves the existing XAI methods in the following ways: 1. **Explanation based on part contribution**: Unlike traditional pixel - level attribution methods, PCEvE evaluates the contribution of each part to the model decision by measuring its Shapley value. The Shapley value is a concept from cooperative game theory and is used to fairly allocate the contributions of each participant. 2. **Multi - level explanation**: PCEvE not only provides sample - level explanations but also extends to class - level and task - level explanations. This means it can provide a more abstract and comprehensive understanding of the model's behavior. 3. **Simplify the explanation process**: PCEvE directly shows which parts are most important to the model decision by providing a part - contribution histogram, thus eliminating the step where the user needs to infer the importance of specific parts. 4. **Verification and application**: The authors conducted extensive experimental verification using multiple HFD assessment datasets and examined the effectiveness of the method through a series of controlled experiments. In addition, they also applied PCEvE to other fields, such as the Stanford Cars dataset, to demonstrate its applicability and generality in photo - level fine - grained classification tasks. ### Specific problem description - **Problem background**: In the HFD assessment task, such as using HFD images to diagnose ASD, the transparency and interpretability of model decisions are crucial. Although existing XAI methods based on pixel - level attribution can provide explanations, users need additional time and effort to understand these explanations. - **Research objective**: Propose a new model explanation framework, PCEvE, which provides more intuitive and easier - to - understand explanations by evaluating the contribution of each human part in the input image to the model decision. - **Solution**: Use the Shapley value to calculate the contribution of each part, generate a part - contribution histogram, and extend the explanation to the class - level and task - level, thereby providing more insights into the model's behavior. Through these improvements, PCEvE not only simplifies the process of model explanation but also improves the quality and depth of the explanation, making it more suitable for application scenarios that require a high degree of transparency, such as in the medical field.

PCEvE: Part Contribution Evaluation Based Model Explanation for Human Figure Drawing Assessment and Beyond

Rethinking Human Pose Estimation for Autonomous Driving with 3D Event Representations.

Accurate Explanation Model for Image Classifiers using Class Association Embedding

Respect the model: Fine-grained and Robust Explanation with Sharing Ratio Decomposition

Attentive Explanations: Justifying Decisions and Pointing to the Evidence (Extended Abstract)

I-CEE: Tailoring Explanations of Image Classification Models to User Expertise

More Persuasive Explanation Method for End-to-End Driving Models

Comprehensive Attribution: Inherently Explainable Vision Model with Feature Detector

Probabilistic Conceptual Explainers: Trustworthy Conceptual Explanations for Vision Foundation Models

How to Squeeze An Explanation Out of Your Model

Expanded Parts Model for Semantic Description of Humans in Still Images

Decompose the model: Mechanistic interpretability in image models with Generalized Integrated Gradients (GIG)

Sim2Word: Explaining Similarity with Representative Attribute Words via Counterfactual Explanations

VALE: A Multimodal Visual and Language Explanation Framework for Image Classifiers using eXplainable AI and Language Models

Prediction With Visual Evidence: Sketch Classification Explanation via Stroke-Level Attributions

Quantitative and Qualitative Evaluation of Explainable Deep Learning Methods for Ophthalmic Diagnosis

Improving Explainability of Disentangled Representations using Multipath-Attribution Mappings

Precise Benchmarking of Explainable AI Attribution Methods

Aligning Characteristic Descriptors with Images for Human-Expert-like Explainability

Visual interpretation of deep learning model in ECG classification: A comprehensive evaluation of feature attribution methods

Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use