Explainers' Mental Representations of Explainees' Needs in Everyday Explanations

Michael Erol Schaffer,Lutz Terfloth,Carsten Schulte,Heike M. Buhl
2024-11-13
Abstract:In explanations, explainers have mental representations of explainees' developing knowledge and shifting interests regarding the explanandum. These mental representations are dynamic in nature and develop over time, thereby enabling explainers to react to explainees' needs by adapting and customizing the explanation. XAI should be able to react to explainees' needs in a similar manner. Therefore, a component that incorporates aspects of explainers' mental representations of explainees is required. In this study, we took first steps by investigating explainers' mental representations in everyday explanations of technological artifacts. According to the dual nature theory, technological artifacts require explanations with two distinct perspectives, namely observable and measurable features addressing "Architecture" or interpretable aspects addressing "Relevance". We conducted extended semi structured pre-, post- and video recall-interviews with explainers (N=9) in the context of an explanation. The transcribed interviews were analyzed utilizing qualitative content analysis. The explainers' answers regarding the explainees' knowledge and interests with regard to the technological artifact emphasized the vagueness of early assumptions of explainers toward strong beliefs in the course of explanations. The assumed knowledge of explainees in the beginning is centered around Architecture and develops toward knowledge with regard to both Architecture and Relevance. In contrast, explainers assumed higher interests in Relevance in the beginning to interests regarding both Architecture and Relevance in the further course of explanations. Further, explainers often finished the explanation despite their perception that explainees still had gaps in knowledge. These findings are transferred into practical implications relevant for user models for adaptive explainable systems.
Artificial Intelligence
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to explore the mental representations of explainees' needs by explainers during the daily explanation process. Specifically, the research focuses on the following aspects: 1. **Understanding the dynamic changes of mental representations**: - How do explainers adjust the explanation content according to the changes in the knowledge and interests of explainees? - How do these mental representations develop over time and how do they affect the effectiveness of the explanation? 2. **Combining the dual - nature theory**: - The research uses the dual - nature theory, dividing technological artifacts into two aspects: "Architecture" and "Relevance". - Explore how explainers switch between these two aspects and adjust the focus of the explanation according to the different needs of explainees. 3. **Enhancing the capabilities of Explainable Artificial Intelligence (XAI)**: - It is proposed that the XAI system should have the capabilities similar to human explainers, being able to perceive and adapt to the specific needs of users. - For this purpose, XAI needs a component to monitor the users' information needs for the "Architecture" or "Relevance" aspects. 4. **Practical applications and user models**: - The research results provide practical guidance for the development of adaptive explanation systems, especially when considering the dynamic changes in users' knowledge and interests in designing user models. ### Research methods To achieve the above goals, the research adopts the following methods: - **Semi - structured interviews**: By interviewing explainers, understand their assumptions and learning situations during the explanation process. - **Video - playback interviews**: Use video - playback technology to help explainers recall and describe in detail their mental activities during the explanation process. - **Qualitative content analysis**: Code and analyze the interview data to identify the cognitive patterns of explainers regarding the changes in the knowledge and interests of explainees. ### Key findings - **Ambiguity of early assumptions**: Explainers have ambiguous assumptions about the knowledge and interests of explainees at the early stage of the explanation, and these assumptions gradually become more explicit as the explanation progresses. - **Changes in knowledge and interests**: The assumptions of explainers gradually shift from initially focusing on the "Architecture" aspect to considering both "Architecture" and "Relevance" simultaneously. - **Knowledge gaps at the end of the explanation**: Even when explainers think that the explanation is complete, they are still aware that there may be knowledge gaps for explainees. ### Practical significance These findings are helpful for developing more intelligent XAI systems, enabling them to better understand users' needs and adjust dynamically during the explanation process. This is of great significance for improving user satisfaction and the effectiveness of the explanation.