Abstract:Objective: The study aimed to enhance transparency in autonomous systems by automatically generating and visualizing confidence and explanations and assessing their impacts on performance, trust, preference, and eye-tracking behaviors in human-automation interaction. Background: System transparency is vital to maintaining appropriate levels of trust and mission success. Previous studies presented mixed results regarding the impact of displaying likelihood information and explanations, and often relied on hand-created information, limiting scalability and failing to address real-world dynamics. Method: We conducted a dual-task experiment involving 42 university students who operated a simulated surveillance testbed with assistance from intelligent detectors. The study used a 2 (confidence visualization: yes vs. no) × 3 (visual explanations: none, bounding boxes, bounding boxes and keypoints) mixed design. Task performance, human trust, preference for intelligent detectors, and eye-tracking behaviors were evaluated. Results: Visual explanations using bounding boxes and keypoints improved detection task performance when confidence was not displayed. Meanwhile, visual explanations enhanced trust and preference for the intelligent detector, regardless of the explanation type. Confidence visualization did not influence human trust in and preference for the intelligent detector. Moreover, both visual information slowed saccade velocities. Conclusion: The study demonstrated that visual explanations could improve performance, trust, and preference in human-automation interaction without confidence visualization partially by changing the search strategies. However, excessive information might cause adverse effects. Application: These findings provide guidance for the design of transparent automation, emphasizing the importance of context-appropriate and user-centered explanations to foster effective human-machine collaboration.

(Over)Trusting AI Recommendations: How System and Person Variables Affect Dimensions of Complacency

How transparency modulates trust in artificial intelligence

Reliable and transparent in-vehicle agents lead to higher behavioral trust in conditionally automated driving systems

More Is Not Always Better: Impacts of AI-Generated Confidence and Explanations in Human-Automation Interaction

Transparency improves the accuracy of automation use, but automation confidence information does not

Knowing When to Pass: The Effect of AI Reliability in Risky Decision Contexts

Artificial Intelligence Decision-Making Transparency and Employees’ Trust: The Parallel Multiple Mediating Effect of Effectiveness and Discomfort

To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making

Automation transparency: implications of uncertainty communication for human-automation interaction and interfaces

Overconfident and Unconfident AI Hinder Human-AI Collaboration

Overtrust in AI Recommendations About Whether or Not to Kill: Evidence from Two Human-Robot Interaction Studies

Explanations Can Reduce Overreliance on AI Systems During Decision-Making

Psychological Traits and Appropriate Reliance: Factors Shaping Trust in AI

The More You Know: Trust Dynamics and Calibration in Highly Automated Driving and the Effects of Take-Overs, System Malfunction, and System Transparency

Investigating the Role of Explainability and AI Literacy in User Compliance

The Effects of Transparency and Reliability of In-Vehicle Intelligent Agents on Driver Perception, Takeover Performance, Workload and Situation Awareness in Conditionally Automated Vehicles

Guided By AI: Navigating Trust, Bias, and Data Exploration in AI-Guided Visual Analytics

Promise or Peril? When Human Efficacy Meets AI Capability Augmentation

Exploring the effects of human-centered AI explanations on trust and reliance

Do Humans Trust Advice More if it Comes from AI? An Analysis of Human-AI Interactions

Guided By AI: Navigating Trust, Bias, and Data Exploration in AI‐Guided Visual Analytics