Abstract:Background: Artificial Intelligence has the potential to revolutionize healthcare, and it is increasingly being deployed to support and assist medical diagnosis. One potential application of AI is as the first point of contact for patients, replacing initial diagnoses prior to sending a patient to a specialist, allowing health care professionals to focus on more challenging and critical aspects of treatment. But for AI systems to succeed in this role, it will not be enough for them to merely provide accurate diagnoses and predictions. In addition, it will need to provide explanations (both to physicians and patients) about why the diagnoses are made. Without this, accurate and correct diagnoses and treatments might otherwise be ignored or rejected. Method: It is important to evaluate the effectiveness of these explanations and understand the relative effectiveness of different kinds of explanations. In this paper, we examine this problem across two simulation experiments. For the first experiment, we tested a re-diagnosis scenario to understand the effect of local and global explanations. In a second simulation experiment, we implemented different forms of explanation in a similar diagnosis scenario. Results: Results show that explanation helps improve satisfaction measures during the critical re-diagnosis period but had little effect before re-diagnosis (when initial treatment was taking place) or after (when an alternate diagnosis resolved the case successfully). Furthermore, initial "global" explanations about the process had no impact on immediate satisfaction but improved later judgments of understanding about the AI. Results of the second experiment show that visual and example-based explanations integrated with rationales had a significantly better impact on patient satisfaction and trust than no explanations, or with text-based rationales alone. As in Experiment 1, these explanations had their effect primarily on immediate measures of satisfaction during the re-diagnosis crisis, with little advantage prior to re-diagnosis or once the diagnosis was successfully resolved. Conclusion: These two studies help us to draw several conclusions about how patient-facing explanatory diagnostic systems may succeed or fail. Based on these studies and the review of the literature, we will provide some design recommendations for the explanations offered for AI systems in the healthcare domain.

Description of Diagnosis Process: A Review of Existing Measures and a New Approach

An Interactive Task Analysis Framework and Interactive System Research for Computer Aided Diagnosis

A Patient-Similarity-based Model for Diagnostic Prediction

A Unified Information Criterion For Evaluating Probe And Test Selection

Predictors for Human Performance in Information Seeking, Information Integration, and Overall Process in Diagnostic Tasks

Ontology-Oriented Diagnostic System for Traditional Chinese Medicine Based on Relation Refinement

AN APPROACH TO OPTIMAL MEASUREMENTS IN MODEL BASED DIAGNOSIS

Correlations Between Human Performance in Information Seeking, Information Integration, and Overall Process in Diagnostic Tasks

A More General Theory of Diagnosis from First Principles

A Process Diagnosis Technique for the Problems of Business Process

Choosing an Approach for Diagnosing Schizophrenia

Towards a New Generation of Cognitive Diagnosis

The basic statistical concepts and their interrelationships in diagnostic research

How should I compute my candidates? A taxonomy and classification of diagnosis computation algorithms

Examining the effect of explanation on satisfaction and trust in AI diagnostic systems

Medical Dialogue Generation via Intuitive-then-Analytical Differential Diagnosis

An approach in medical diagnosis based on Z-numbers soft set.

What is an Optimal Diagnosis?

Diagnostic decision-making and strategies to improve diagnosis

A new method for diagnostic problem solving based on a fuzzy abductive inference model and the tabu search approach

Efficient symptom inquiring and diagnosis via adaptive alignment of reinforcement learning and classification