The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond

Abigail Sellen,Eric Horvitz

DOI: https://doi.org/10.1145/3637865

IF: 22.7

2024-07-01

Communications of the ACM

Abstract:Building on cross-disciplinary insights to shape the future of human-AI interaction.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

Design and evaluation of AI copilots -- case studies of retail copilot templates

Michal Furmakiewicz,Chang Liu,Angus Taylor,Ilya Venger

2024-06-18

Abstract:Building a successful AI copilot requires a systematic approach. This paper is divided into two sections, covering the design and evaluation of a copilot respectively. A case study of developing copilot templates for the retail domain by Microsoft is used to illustrate the role and importance of each aspect. The first section explores the key technical components of a copilot's architecture, including the LLM, plugins for knowledge retrieval and actions, orchestration, system prompts, and responsible AI guardrails. The second section discusses testing and evaluation as a principled way to promote desired outcomes and manage unintended consequences when using AI in a business context. We discuss how to measure and improve its quality and safety, through the lens of an end-to-end human-AI decision loop framework. By providing insights into the anatomy of a copilot and the critical aspects of testing and evaluation, this paper provides concrete evidence of how good design and evaluation practices are essential for building effective, human-centered AI assistants.

Human-Computer Interaction,Artificial Intelligence
Artificial Intelligence in Adaptive In-Cab Interfaces

DOI: https://doi.org/10.30987/2658-4026-2023-4-351-360

2023-11-17

Ergodesign

Abstract:The principles of developing adaptive in-cabin control interfaces for advanced aviation systems based on the methodology of integrated modular avionics (IMA), which change their functionality depending on the situation and flight conditions, are considered. Existing and promising solutions and technologies for making in-cabin interfaces are described, such as gesture recognition systems, voice commands and other methods of interaction with the pilot, including the use of induced virtual reality and artificial intelligence technologies. The problems of piloting in conditions of increased automation of aircraft control processes are shown. Proposals are considered to create even more efficient and secure interfaces in the near future, which will improve the aviation system performance, the aircraft control quality and reduce the likelihood of pilots’ operational errors.
Cooperative AI: machines must learn to find common ground

Allan Dafoe,Yoram Bachrach,Gillian Hadfield,Eric Horvitz,Kate Larson,Thore Graepel,Allan Dafoe,Yoram Bachrach,Gillian Hadfield,Eric Horvitz,Kate Larson,Thore Graepel

DOI: https://doi.org/10.1038/d41586-021-01170-0

IF: 64.8

2021-05-04

Nature

Abstract:Artificial-intelligence assistants and recommendation algorithms interact with billions of people every day, influencing lives in myriad ways, yet they still have little understanding of humans. Self-driving vehicles controlled by artificial intelligence (AI) are gaining mastery of their interactions with the natural world, but they are still novices when it comes to coordinating with other cars and pedestrians or collaborating with their human operators.

multidisciplinary sciences
Human-AI Teamwork Interface Design Using Patterns of Interactions

Kazuhiko Momose,Rahul Mehta,Josias Moukpe,Troy R. Weekes,Thomas C. Eskridge

DOI: https://doi.org/10.1080/10447318.2024.2389350

IF: 4.92

2024-08-28

International Journal of Human-Computer Interaction

Abstract:Increasingly capable Artificial Intelligence (AI) agents are reaching new performance levels and humans need to work effectively with them in a variety of collaborative team structures. Of particular interest is "shared control collaboration", where actions taken by the team depend on the blended combination of inputs from all team entities. We conducted an experiment where participants played a game and maneuvered a spacecraft while working in concert with an AI agent and simultaneously performing a secondary task. The experiment results (i) show different patterns of interactions across user interface designs, agent capabilities, and participants' game experience, (ii) underscore the importance of providing information about the shared control collaborative task to humans who are working with a less-capable agent, and (iii) imply the potential of real-time communication about agent's state to achieve better teamwork. Our findings are expected to be transferable to other shared control collaboration settings, including AI-enabled autopilots.

computer science, cybernetics,ergonomics
Building Your Own Product Copilot: Challenges, Opportunities, and Needs

Chris Parnin,Gustavo Soares,Rahul Pandita,Sumit Gulwani,Jessica Rich,Austin Z. Henley

DOI: https://doi.org/10.48550/arXiv.2312.14231

2023-12-22

Abstract:A race is underway to embed advanced AI capabilities into products. These product copilots enable users to ask questions in natural language and receive relevant responses that are specific to the user's context. In fact, virtually every large technology company is looking to add these capabilities to their software products. However, for most software engineers, this is often their first encounter with integrating AI-powered technology. Furthermore, software engineering processes and tools have not caught up with the challenges and scale involved with building AI-powered applications. In this work, we present the findings of an interview study with 26 professional software engineers responsible for building product copilots at various companies. From our interviews, we found pain points at every step of the engineering process and the challenges that strained existing development practices. We then conducted group brainstorming sessions to collaborative on opportunities and tool designs for the broader software engineering community.

Software Engineering
The rise of AI copilots: How LLMs turn data into actions, advance the business intelligence industry and make data accessible company-wide

Jeff Coyle,Stephen Jeske

DOI: https://doi.org/10.69554/sjei6374

2023-12-01

Abstract:AI-powered collaboration is quickly advancing due to a convergence of technologies like large language models and language model programming. These developments have spawned the rise of AI (artificial intelligence) copilots, which are changing the way marketing analysts make decisions and boost productivity. This paper explores the capabilities of AI copilots and delves into the challenges, ethical considerations and data privacy issues that come with their adoption. It discusses real-world applications and future trends in the AI copilot landscape. The paper also emphasises the importance of data integration and personalisation in marketing strategies and offers insights into training and skill development for effective collaboration with AI copilots. This comprehensive analysis aims to equip marketing analytics professionals for the future of AI-powered collaboration.
The AI Interface: Designing for the Ideal Machine-Human Experience (Editorial)

Aparna Sundar,Tony Russell-Rose,Udo Kruschwitz,Karen Machleit

2024-11-29

Abstract:As artificial intelligence (AI) becomes increasingly embedded in daily life, designing intuitive, trustworthy, and emotionally resonant AI-human interfaces has emerged as a critical challenge. This editorial introduces a Special Issue that explores the psychology of AI experience design, focusing on how interfaces can foster seamless collaboration between humans and machines. Drawing on insights from diverse fields (healthcare, consumer technology, workplace dynamics, and cultural sector), the papers in this collection highlight the complexities of trust, transparency, and emotional sensitivity in human-AI interaction. Key themes include designing AI systems that align with user perceptions and expectations, overcoming resistance through transparency and trust, and framing AI capabilities to reduce user anxiety. By synthesizing findings from eight diverse studies, this editorial underscores the need for AI interfaces to balance efficiency with empathy, addressing both functional and emotional dimensions of user experience. Ultimately, it calls for actionable frameworks to bridge research and practice, ensuring that AI systems enhance human lives through thoughtful, human-centered design.

Human-Computer Interaction,Artificial Intelligence
Intelligent Cockpits for Connected Vehicles: Taxonomy, Architecture, Interaction Technologies, and Future Directions

Fei Gao,Xiaojun Ge,Jinyu Li,Yuze Fan,Yun Li,Rui Zhao

DOI: https://doi.org/10.3390/s24165172

2024-08-10

Abstract:Highly integrated information sharing among people, vehicles, roads, and cloud systems, along with the rapid development of autonomous driving technologies, has spurred the evolution of automobiles from simple "transportation tools" to interconnected "intelligent systems". The intelligent cockpit is a comprehensive application space for various new technologies in intelligent vehicles, encompassing the domains of driving control, riding comfort, and infotainment. It provides drivers and passengers with safety, comfort, and pleasant driving experiences, serving as the gateway for traditional automobile manufacturing to upgrade towards an intelligent automotive industry ecosystem. This is the optimal convergence point for the intelligence, connectivity, electrification, and sharing of automobiles. Currently, the form, functions, and interaction methods of the intelligent cockpit are gradually changing, transitioning from the traditional "human adapts to the vehicle" viewpoint to the "vehicle adapts to human", and evolving towards a future of natural interactive services where "humans and vehicles mutually adapt". This article reviews the definitions, intelligence levels, functional domains, and technical frameworks of intelligent automotive cockpits. Additionally, combining the core mechanisms of human-machine interactions in intelligent cockpits, this article proposes an intelligent-cockpit human-machine interaction process and summarizes the current state of key technologies in intelligent-cockpit human-machine interactions. Lastly, this article analyzes the current challenges faced in the field of intelligent cockpits and forecasts future trends in intelligent cockpit technologies.
Designing the Future: A Case Study on Human-AI Co-Innovation

Chen Jen-Feng,Ni Chien-Chih,Lin Po-Hsien,Lin Rungtai,Jen-Feng Chen,Chien-Chih Ni,Po-Hsien Lin,Rungtai Lin

DOI: https://doi.org/10.4236/ce.2024.153028

2024-01-01

Creative Education

Abstract:Artificial intelligence (AI) has sparked widespread discussion across various sectors globally while triggering a transformation in the design industry. In recent years, the evolution of AI has started to reshape how people work and live. As such, the human-robot collaboration model is gradually emerging as a pivotal force driving innovation and boosting efficiency. As it rapidly advances, AI technology can process a vast amount of data while performing complex tasks and assisting designers with intricate and creative work. By automating repetitive, low-value tasks using AI technology, designers can focus on activities that require intensive creativity, critical thinking, and emotional intelligence. The present case study examines how human-robot collaboration elicits advantages in creative design. An analysis of the AI-assisted visual design project “ZhuoluFantasie” indicates that complementary human-AI collaboration can enhance design efficiency and assist designers in transcending creative boundaries. Through the process of content planning, text generation, graphics generation, graphics selection, confirmation, and finalization, the 7000 images were ultimately condensed into 27 AI-assisted visual designs. This provides opportunities for cross-field collaboration while introducing new possibilities into the creative design field.
Artificial Intelligence & Cooperation

Elisa Bertino,Finale Doshi-Velez,Maria Gini,Daniel Lopresti,David Parkes

DOI: https://doi.org/10.48550/arXiv.2012.06034

2020-12-11

Abstract:The rise of Artificial Intelligence (AI) will bring with it an ever-increasing willingness to cede decision-making to machines. But rather than just giving machines the power to make decisions that affect us, we need ways to work cooperatively with AI systems. There is a vital need for research in "AI and Cooperation" that seeks to understand the ways in which systems of AIs and systems of AIs with people can engender cooperative behavior. Trust in AI is also key: trust that is intrinsic and trust that can only be earned over time. Here we use the term "AI" in its broadest sense, as employed by the recent 20-Year Community Roadmap for AI Research (Gil and Selman, 2019), including but certainly not limited to, recent advances in deep learning. With success, cooperation between humans and AIs can build society just as human-human cooperation has. Whether coming from an intrinsic willingness to be helpful, or driven through self-interest, human societies have grown strong and the human species has found success through cooperation. We cooperate "in the small" -- as family units, with neighbors, with co-workers, with strangers -- and "in the large" as a global community that seeks cooperative outcomes around questions of commerce, climate change, and disarmament. Cooperation has evolved in nature also, in cells and among animals. While many cases involving cooperation between humans and AIs will be asymmetric, with the human ultimately in control, AI systems are growing so complex that, even today, it is impossible for the human to fully comprehend their reasoning, recommendations, and actions when functioning simply as passive observers.

Computers and Society,Artificial Intelligence
The AI Imperative: On Becoming Quintessentially Human

Steven H. Cady,Jari G. Willing,Deakon A. Cady

DOI: https://doi.org/10.1177/00218863241284310

2024-10-04

The Journal of Applied Behavioral Science

Abstract:The Journal of Applied Behavioral Science, Ahead of Print. As artificial intelligence (AI) rapidly automates routine tasks and job roles, organizations must prioritize developing quintessentially human skills that machines cannot easily replicate, such as creativity, empathy, collaboration, and complex problem-solving. Drawing from neuroscience, this article examines how industrial-era education and management practices, with their emphasis on structured, repetitive environments, have historically prioritized crystallized intelligence over fluid intelligence. This focus limits adaptability and innovation, which are essential human qualities in an AI-driven world. Our recommendations include stimulating cognitive flexibility, reimagining strategic planning, optimizing team meetings, redesigning jobs, promoting experiential learning, and fostering human relations. By adopting these strategies, organizations can prepare their workforce for more complex, cognitively demanding tasks, ensuring resilience and innovation in the age of AI.

psychology, applied,management
Advances of Artificial Intelligence in Aeronautics

Byron Sanchez,Daniel Duran,Kevin Martinez,Washington Viera

DOI: https://doi.org/10.47460/athenea.v4i12.56

2023-06-15

Athenea

Abstract:The use of artificial intelligence (AI) in recent years has allowed the development of a large number of applications in practically all areas of human knowledge. However, the application is relatively new in aeronautics, and products are already optimizing the skills and capabilities of the personnel who command it. This paper reviews the scientific literature on the advantages, disadvantages, and aspects to consider regarding the application of AI techniques in aeronautical processes ranging from construction, navigation, and security against attacks on communications and climate changes that may affect the navigation system. AI developments provide new advantages and challenges for navigation every day. On the one hand, these techniques support flight independence until achieving absolute autonomy. Still, on the other hand, they also incorporate specific vulnerabilities and concerns about the increased use of computer and digital communication media that are prone to attacks by malicious individuals or organizations.
Human-Centric AI: Understanding and Enhancing Collaboration between Humans and Intelligent Systems

Ester Marliani Lase,Fatima Nkosi

DOI: https://doi.org/10.61963/jaa.v1i1.49

2023-08-29

Abstract:This research explores the field of human-centered AI cooperation to learn more about its dynamics, ethical issues, and design principles that put the user first. Our study analyzes cross-sector cooperation using a mixed-methods approach that combines qualitative analysis and empirical case studies, coinciding with the idea of "cobotics (collaborative robotics)." Transparency in ethics becomes a crucial issue, reflecting the development of the AI ethical debate. Quantitative measurements show how AI has the power to revolutionize businesses by improving accuracy, effectiveness, and user engagement. To capture changing dynamics and broaden the boundaries of collaboration, we advise longitudinal studies and multidisciplinary research. Our research essentially emphasizes the mutually beneficial interaction between people and AI, paving the path for technology that places a high priority on user values and ethical integrity.
FOCUS AND MODALITY: DEFINING A ROADMAP TO FUTURE AI-HUMAN TEAMING IN DESIGN

Christopher McComb,Peter Boatwright,Jonathan Cagan

DOI: https://doi.org/10.1017/pds.2023.191

2023-06-19

Proceedings of the Design Society

Abstract:Abstract The evolution of Artificial Intelligence (AI) and Machine Learning (ML) enables new ways to envision how computer tools will aid, work with, and even guide human teams. This paper explores this new paradigm of design by considering emerging variations of AI-Human collaboration: AI used as a design tool versus AI employed as a guide to human problem solvers, and AI agents which only react to their human counterparts versus AI agents which proactively identify and address needs. The different combinations can be mapped onto a 2×2 AI-Human Teaming Matrix which isolates and highlights these different AI capabilities in teaming. The paper introduces the matrix and its quadrants, illustrating these different AI agents and their application and impact, and then provides a road map to researching and developing effective AI team collaborators.
Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation

Priyan Vaithilingam, Ian Arawjo, Elena L. Glassman

2024-02-12

Abstract:We ideate a future design workflow that involves AI technology. Drawing from activity and communication theory, we attempt to isolate the new value large AI models can provide design compared to past technologies. We arrive at three affordances -- dynamic grounding, constructive negotiation, and sustainable motivation -- that summarize latent qualities of natural language-enabled foundation models that, if explicitly designed for, can support the process of design. Through design fiction, we then imagine a future interface as a diegetic prototype, the story of Squirrel Game, that demonstrates each of our three affordances in a realistic usage scenario. Our design process, terminology, and diagrams aim to contribute to future discussions about the relative affordances of AI technology with regard to collaborating with human designers.

Artificial Intelligence,Human-Computer Interaction
AI in Autonomous Vehicles

Sharique Masood Khan

DOI: https://doi.org/10.48175/ijarsct-15237

2024-01-24

Abstract:The integration of Artificial Intelligence (AI) in autonomous vehicles represents a transformative leap towards safer, more efficient, and technologically advanced transportation systems. This abstract provides a comprehensive overview of the dynamic landscape where AI converges with autonomous vehicles, examining the synergies, challenges, and far-reaching implications of this groundbreaking integration AI-Powered Perception and Decision-Making: Delving into the technological core, the abstract explores how AI empowers autonomous vehicles with sophisticated perception systems, such as computer vision and sensor fusion. It discusses the role of machine learning algorithms in real-time decision-making, enabling vehicles to adapt to dynamic road conditions and unforeseen circumstances. Challenges in Autonomy: Recognizing the complexity of autonomous systems, the abstract addresses challenges such as handling edge cases, ensuring robustness against adversarial attacks, and navigating regulatory and ethical considerations. It emphasizes the importance of addressing these challenges to foster public trust and acceptance of autonomous vehicles. Human-AI Interaction in Autonomous Vehicles: Examining the interface between humans and AI-driven vehicles, the abstract discusses the importance of designing intuitive and trustworthy communication channels. It explores advancements in natural language processing and gesture recognition, fostering seamless collaboration between humans and autonomous systems. Regulatory Landscape and Ethical Considerations: Recognizing the pivotal role of regulations, the abstract discusses the evolving regulatory landscape for autonomous vehicles. It delves into ethical considerations surrounding AI decisions in critical situations, underscoring the need for a harmonized approach to ensure responsible AI deployment in autonomous driving scenarios.
Editorial Introduction to Responsible Artificial Intelligence for Autonomous Driving

Huimin Lu,Mohsen Guizani,Pin-Han Ho

DOI: https://doi.org/10.1109/tits.2022.3221169

IF: 8.5

2022-12-10

IEEE Transactions on Intelligent Transportation Systems

Abstract:Artificial Intelligence is in transition as the fast convergence of digital technologies and data science holds the promise to liberate consumer data and provide a faster and more cost-effective way of improving human initiatives. Particularly, artificial intelligence (AI) is heavily influencing autonomous vehicles nowadays. The data driven-based AI autonomous vehicles have the potential to reshape the expectations of human's actions, the way that companies' stakeholders collaborate, and revamp business models in the various industries.
Artificial Intelligence as a Dynamic Copilot in Entrepreneurship Education

Joseph D. Fox,Luke Pittaway,Ikenna Uzuegbunam

DOI: https://doi.org/10.1177/25151274241256307

2024-06-04

Entrepreneurship Education and Pedagogy

Abstract:How will instructors effectively manage the use of artificial intelligence (AI) with generative capabilities in entrepreneurship education? This paper introduces a framework to help instructors understand the different roles played by AI and learners as they move through different phases of a learning task. We describe the Artificial Intelligence in Entrepreneurship Education (AIEE) framework to outline the roles and relationships that instructors, students, and AI systems may play as part of a learning task in the classroom. We articulate key takeaways for instructors to recognize the responsibilities that are associated with different roles at different phases of a learning task.
Augmenting Flight Training with AI to Efficiently Train Pilots

Michael Guevarra,Srijita Das,Christabel Wayllace,Carrie Demmans Epp,Matthew Taylor,Alan Tay

DOI: https://doi.org/10.1609/aaai.v37i13.27071

2023-06-26

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:We propose an AI-based pilot trainer to help students learn how to fly aircraft. First, an AI agent uses behavioral cloning to learn flying maneuvers from qualified flight instructors. Later, the system uses the agent's decisions to detect errors made by students and provide feedback to help students correct their errors. This paper presents an instantiation of the pilot trainer. We focus on teaching straight and level flying maneuvers by automatically providing formative feedback to the human student.

English Else
Human Autonomy in Future Drone Traffic: Joint Human–AI Control in Temporal Cognitive Work

Jonas Lundberg,Mattias Arvola,Karljohan Lundin Palmerius

DOI: https://doi.org/10.3389/frai.2021.704082

2021-07-20

Frontiers in Artificial Intelligence

Abstract:The roles of human operators are changing due to increased intelligence and autonomy of computer systems. Humans will interact with systems at a more overarching level or only in specific situations. This involves learning new practices and changing habitual ways of thinking and acting, including reconsidering human autonomy in relation to autonomous systems. This paper describes a design case of a future autonomous management system for drone traffic in cities in a key scenario we call The Computer in Brussels. Our approach to designing for human collaboration with autonomous systems builds on scenario-based design and cognitive work analysis facilitated by computer simulations. We use a temporal method, called the Joint Control Framework to describe human and automated work in an abstraction hierarchy labeled Levels of Autonomy in Cognitive Control. We use the Score notation to analyze patterns of temporal developments that span levels of the abstraction hierarchy and discuss implications for human-automation communication in traffic management. We discuss how autonomy at a lower level can prevent autonomy on higher levels, and vice versa. We also discuss the temporal nature of autonomy in minute-to-minute operative work. Our conclusion is that human autonomy in relation to autonomous systems is based on fundamental trade-offs between technological opportunities to automate and values of what human actors find meaningful.

The Rise of the AI Co-Pilot: Lessons for Design from Aviation and Beyond

Design and evaluation of AI copilots -- case studies of retail copilot templates

Artificial Intelligence in Adaptive In-Cab Interfaces

Cooperative AI: machines must learn to find common ground

Human-AI Teamwork Interface Design Using Patterns of Interactions

Building Your Own Product Copilot: Challenges, Opportunities, and Needs

The rise of AI copilots: How LLMs turn data into actions, advance the business intelligence industry and make data accessible company-wide

The AI Interface: Designing for the Ideal Machine-Human Experience (Editorial)

Intelligent Cockpits for Connected Vehicles: Taxonomy, Architecture, Interaction Technologies, and Future Directions

Designing the Future: A Case Study on Human-AI Co-Innovation

Artificial Intelligence & Cooperation

The AI Imperative: On Becoming Quintessentially Human

Advances of Artificial Intelligence in Aeronautics

Human-Centric AI: Understanding and Enhancing Collaboration between Humans and Intelligent Systems

FOCUS AND MODALITY: DEFINING A ROADMAP TO FUTURE AI-HUMAN TEAMING IN DESIGN

Imagining a Future of Designing with AI: Dynamic Grounding, Constructive Negotiation, and Sustainable Motivation

AI in Autonomous Vehicles

Editorial Introduction to Responsible Artificial Intelligence for Autonomous Driving

Artificial Intelligence as a Dynamic Copilot in Entrepreneurship Education

Augmenting Flight Training with AI to Efficiently Train Pilots

Human Autonomy in Future Drone Traffic: Joint Human–AI Control in Temporal Cognitive Work