Abstract:Recent advances in AI and machine learning (ML) promise significant transformations in the future delivery of healthcare. Despite a surge in research and development, few works have moved beyond demonstrations of technical feasibility and algorithmic performance. However, to realize many of the ambitious visions for how AI can contribute to clinical impact requires the closer design and study of AI tools or interventions within specific health and care contexts. This article outlines our collaborative, human-centered approach to developing an AI application that predicts treatment outcomes for patients who are receiving human-supported, internet-delivered Cognitive Behavioral Therapy (iCBT) for symptoms of depression and anxiety. Intersecting the fields of HCI, AI, and healthcare, we describe how we addressed the specific challenges of (1) identifying clinically relevant AI applications ; and (2) designing AI applications for sensitive use contexts like mental health. Aiming to better assist the work practices of iCBT supporters, we share how learnings from an interview study with 15 iCBT supporters surfaced their practices and information needs and revealed new opportunities for the use of AI. Combined with insights from the clinical literature and technical feasibility constraints, this led to the development of two clinical outcome prediction models. To clarify their potential utility for use in practice, we conducted 13 design sessions with iCBT supporters that utilized interface mock-ups to concretize the AI output and derive additional design requirements. Our findings demonstrate how design choices can impact interpretations of the AI predictions as well as supporter motivation and sense of agency. We detail how this analysis and the design principles derived from it enabled the integration of the prediction models into a production interface. Reporting on identified risks of over-reliance on AI outputs and needs for balanced information assessment and preservation of a focus on individualized care, we discuss and reflect on what constitutes a responsible, human-centered approach to AI design in this healthcare context.

User Preferences on AI Psychotherapy Based on Moderating Effects of Individual Personality Traits: Employing a Clustering Analysis

Understanding User Preferences in Developing a Mental Healthcare AI Chatbot: A Conjoint Analysis Approach

Human-Human vs Human-AI Therapy: An Empirical Study

Effect of AI chatbot emotional disclosure on user satisfaction and reuse intention for mental health counseling: a serial mediation model

Experience in psychological counseling supported by artificial intelligence technology

Robotic Moment: the Influence Mechanism of Frequency of Socializing on Willingness to Interact with AI Robots

Counselling Career with Artificial Intelligence: A Systematic Review

Artificial intelligence and social intelligence: preliminary comparison study between AI models and psychologists

Determinants of Intentions to Use Digital Mental Healthcare Content among University Students, Faculty, and Staff: Motivation, Perceived Usefulness, Perceived Ease of Use, and Parasocial Interaction with AI Chatbot

Designing Human-centered AI for Mental Health: Developing Clinically Relevant Applications for Online CBT Treatment

Using Conversational AI to Facilitate Mental Health Assessments and Improve Clinical Efficiency Within Psychotherapy Services: Real-World Observational Study

The therapeutic effectiveness of artificial intelligence-based chatbots in alleviation of depressive and anxiety symptoms in short-course treatments: A systematic review and meta-analysis

Bridging the Skills Gap: Evaluating an AI-Assisted Provider Platform to Support Care Providers with Empathetic Delivery of Protocolized Therapy

Factors Predicting Intentions of Adoption and Continued Use of Artificial Intelligence Chatbots for Mental Health: Examining the Role of UTAUT Model, Stigma, Privacy Concerns, and Artificial Intelligence Hesitancy.

Human vs. machine-like representation in chatbot mental health counseling: the serial mediation of psychological distance and trust on compliance intention

The quality traits of artificial intelligence operations in predicting mental healthcare professionals’ perceptions: A case study in the psychotherapy division

One AI Does Not Fit All: A Cluster Analysis of the Laypeople’s Perception of AI Roles

A Robotic Positive Psychology Coach to Improve College Students' Wellbeing

Do You Mind if I Ask You a Personal Question? How AI Service Agents Alter Consumer Self-Disclosure

Potential promises and perils of artificial intelligence in psychotherapy –The AI Psychotherapist (APT)

The Efficacy of Conversational Artificial Intelligence in Rectifying the Theory of Mind and Autonomy Biases: Comparative Analysis