Abstract:Humans make decisions and act alongside other humans to pursue both short-term and long-term goals. As a result of ongoing progress in areas such as computing science and automation, humans now also interact with non-human agents of varying complexity as part of their day-to-day activities; substantial work is being done to integrate increasingly intelligent machine agents into human work and play. With increases in the cognitive, sensory, and motor capacity of these agents, intelligent machinery for human assistance can now reasonably be considered to engage in joint action with humans---i.e., two or more agents adapting their behaviour and their understanding of each other so as to progress in shared objectives or goals. The mechanisms, conditions, and opportunities for skillful joint action in human-machine partnerships is of great interest to multiple communities. Despite this, human-machine joint action is as yet under-explored, especially in cases where a human and an intelligent machine interact in a persistent way during the course of real-time, daily-life experience. In this work, we contribute a virtual reality environment wherein a human and an agent can adapt their predictions, their actions, and their communication so as to pursue a simple foraging task. In a case study with a single participant, we provide an example of human-agent coordination and decision-making involving prediction learning on the part of the human and the machine agent, and control learning on the part of the machine agent wherein audio communication signals are used to cue its human partner in service of acquiring shared reward. These comparisons suggest the utility of studying human-machine coordination in a virtual reality environment, and identify further research that will expand our understanding of persistent human-machine joint action.

A Novel Mirror Neuron Inspired Decision-Making Architecture for Human–Robot Interaction

Ancillary Mechanism for Autonomous Decision-Making Process in Asymmetric Confrontation: a View from Gomoku

Human-robot Negotiation of Intentions Based on Virtual Fixtures for Shared Task Execution

Neuro-cognitive mechanisms of decision making in joint action: a human-robot interaction study

Learning from Evolution: Improving Collective Decision-Making Mechanisms using Insights from Evolutionary Robotics

Affective Goal and Task Selection for Social Robots

Decision-Oriented Dialogue for Human-AI Collaboration

Face-work for Human-Agent Joint Decision-Making

Neural Mechanisms of Human Decision-Making

A Novel Model for Arbitration between Planning and Habitual Control Systems

Human-Robot Collaborative Decision Method of Hexapod Robot Based on Prior Knowledge and Negotiation Strategy

Learned human-agent decision-making, communication and joint action in a virtual reality environment

From DDMs to DNNs: Using process data and models of decision-making to improve human-AI interactions

Can Robotic Cues Manipulate Human Decisions? Exploring Consensus Building via Bias-Controlled Non-linear Opinion Dynamics and Robotic Eye Gaze Mediated Interaction in Human-Robot Teaming

Affect-Driven Learning of Robot Behaviour for Collaborative Human-Robot Interactions

Cognitive Architecture for Mutual Modelling

Integrated Commonsense Reasoning and Deep Learning for Transparent Decision Making in Robotics

Reinforcement Learning on Human Decision Models for Uniquely Collaborative AI Teammates

A Bio-Inspired Dopamine Model for Robots with Autonomous Decision-Making

Automated optimisation of multi-level models of collective behaviour in a mixed society of animals and robots

Building Human-Like Artificial Agents: A General Cognitive Algorithm for Emulating Human Decision-Making in Dynamic Environments