Abstract:Recent advances in artificial intelligence (AI) enable AI agents to go beyond simply supporting human activities and, instead, take more control in team decision-making. While significant literature has studied human-AI collaboration through the lens of AI as a "second opinion system," this type of interaction is not fully representative of many human-human team collaboration scenarios, such as scenarios where each decision maker is granted equal voting rights for the team decision. In this research, we explore how imparting AI agents with equal voting rights to the human impacts human-AI decision-making and team performance. Using a human subjects experiment in which participants collaborate with two AI teammates for truss structure (aka, bridge ) design, we manipulate a series of voting scenarios (e.g., AI agents outvoting the human vs. AI agents agreeing with the human) and AI performance levels (high vs. low performing). The results indicate that changes in human self-confidence are not consistent with whether the quality of the final team-voted design action is advantageous or disadvantageous relative to their own actions. The results also show that when humans are outvoted by their AI teammates, they do not show strong negative emotional reactions if the team-voted decision has an advantageous outcome. Additionally, AI performance significantly influences the human-AI team decision-making process and even one low-performing AI (i.e., an AI that is frequently incorrect) on the team can significantly deteriorate team performance. Taken together, this research provides empirical evidence on the effects of AI voting with equal decision authority on human-AI collaboration, as well as valuable insights supporting real-world applications of human-AI collaboration via voting.

Human Designers' Dynamic Confidence and Decision-Making When Working with More than One AI

The Evolution and Impact of Human Confidence in Artificial Intelligence and in Themselves on AI-Assisted Decision-Making in Design

Three Challenges for AI-Assisted Decision-Making

Decision Making Strategies and Team Efficacy in Human-AI Teams

Designing Human-AI Systems: Anthropomorphism and Framing Bias on Human-AI Collaboration

Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Making

Overconfident and Unconfident AI Hinder Human-AI Collaboration

A Framework of Artificial Intelligence Augmented Design Support

How Being Outvoted by AI Teammates Impacts Human-AI Collaboration

When Faced With Increasing Complexity: The Effectiveness of Artificial Intelligence Assistance for Drone Design

The Human in the Infinite Loop: A Case Study on Revealing and Explaining Human-AI Interaction Loop Failures

Give Me a Choice: The Consequences of Restricting Choices Through AI-Support for Perceived Autonomy, Motivational Variables, and Decision Performance

"Are You Really Sure?" Understanding the Effects of Human Self-Confidence Calibration in AI-Assisted Decision Making

Addressing Challenges to Problem Complexity: Effectiveness of AI Assistance During the Design Process

Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making

The Role of Heuristics and Biases During Complex Choices with an AI Teammate

Human Versus Artificial Intelligence: A Data-Driven Approach to Real-Time Process Management During Complex Engineering Design

When and How to Use AI in the Design Process? Implications for Human-AI Design Collaboration

Adaptation Through Communication: Assessing Human–Artificial Intelligence Partnership for the Design of Complex Engineering Systems

AI Knowledge: Improving AI Delegation through Human Enablement

Deciding Fast and Slow: The Role of Cognitive Biases in AI-assisted Decision-making