Abstract:The study of human-machine systems is central to a variety of behavioral and engineering disciplines, including management science, human factors, robotics, and human-computer interaction. Recent advances in artificial intelligence (AI) and machine learning have brought the study of human-AI teams into sharper focus. An important set of questions for those designing human-AI interfaces concerns trust, transparency, and error tolerance. Here, we review the emerging literature on this important topic, identify open questions, and discuss some of the pitfalls of human-AI team research. We present opposition (extreme algorithm aversion or distrust) and loafing (extreme automation complacency or bias) as lying at opposite ends of a spectrum, with algorithmic vigilance representing an ideal mid-point. We suggest that, while transparency may be crucial for facilitating appropriate levels of trust in AI and thus for counteracting aversive behaviors and promoting vigilance, transparency should not be conceived solely in terms of the explainability of an algorithm. Dynamic task allocation, as well as the communication of confidence and performance metrics-among other strategies-may ultimately prove more useful to users than explanations from algorithms and significantly more effective in promoting vigilance. We further suggest that, while both aversive and appreciative attitudes are detrimental to optimal human-AI team performance, strategies to curb aversion are likely to be more important in the longer term than those attempting to mitigate appreciation. Our wider aim is to channel disparate efforts in human-AI team research into a common framework and to draw attention to the ecological validity of results in this field.

Modeling Disclosive Transparency in NLP Application Descriptions

Capturing the Trends, Applications, Issues, and Potential Strategies of Designing Transparent AI Agents

Transparency Helps Reveal When Language Models Learn Meaning

How transparency modulates trust in artificial intelligence

Collaborative Decision Making with Responsible AI: Establishing Trust and Load Models for Probabilistic Transparency

Uncertainty as a Form of Transparency: Measuring, Communicating, and Using Uncertainty

A Survey of the Interpretability Aspect of Deep Learning Models

Interpretable Deep Learning Models: Enhancing Transparency and Trustworthiness in Explainable AI

Users are the North Star for AI Transparency

Explainability for Natural Language Processing

"I had a solid theory before but it's falling apart": Polarizing Effects of Algorithmic Transparency

Transparency: The Missing Link to Boosting AI Transformations in Chemical Engineering

Progressive Disclosure

Understanding the Effect of Algorithm Transparency of Model Explanations in Text-to-SQL Semantic Parsing

Varieties of transparency: exploring agency within AI systems

What Are You Hiding? Algorithmic Transparency and User Perceptions

Measuring, Modeling, and Helping People Account for Privacy Risks in Online Self-Disclosures with AI

Enhancing transparency in AI-powered customer engagement

Explainable AI for Cloud-Based Machine Learning Interpretable Models and Transparency in Decision Making.

Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networks

Transparency and the Black Box Problem: Why We Do Not Trust AI