Abstract:Humans make decisions and act alongside other humans to pursue both short-term and long-term goals. As a result of ongoing progress in areas such as computing science and automation, humans now also interact with non-human agents of varying complexity as part of their day-to-day activities; substantial work is being done to integrate increasingly intelligent machine agents into human work and play. With increases in the cognitive, sensory, and motor capacity of these agents, intelligent machinery for human assistance can now reasonably be considered to engage in joint action with humans---i.e., two or more agents adapting their behaviour and their understanding of each other so as to progress in shared objectives or goals. The mechanisms, conditions, and opportunities for skillful joint action in human-machine partnerships is of great interest to multiple communities. Despite this, human-machine joint action is as yet under-explored, especially in cases where a human and an intelligent machine interact in a persistent way during the course of real-time, daily-life experience. In this work, we contribute a virtual reality environment wherein a human and an agent can adapt their predictions, their actions, and their communication so as to pursue a simple foraging task. In a case study with a single participant, we provide an example of human-agent coordination and decision-making involving prediction learning on the part of the human and the machine agent, and control learning on the part of the machine agent wherein audio communication signals are used to cue its human partner in service of acquiring shared reward. These comparisons suggest the utility of studying human-machine coordination in a virtual reality environment, and identify further research that will expand our understanding of persistent human-machine joint action.

Visual-spatial dynamics drive adaptive social learning in immersive environments

Collective incentives reduce over-exploitation of social information in unconstrained human groups

Learned human-agent decision-making, communication and joint action in a virtual reality environment

AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making

A computational approach to visual ecology with deep reinforcement learning

Behavioral anatomy of a hunt : Using dynamic real-world paradigm and computer vision to compare human user-generated strategies with prey movement varying in predictability

The evolution of social learning mechanisms and cultural phenomena in group foragers

Using Features at Multiple Temporal and Spatial Resolutions to Predict Human Behavior in Real Time

Learning Complex Spatial Behaviours in ABM: An Experimental Observational Study

Beyond the matrix: Experimental approaches to studying cognitive agents in social-ecological systems

Spatiotemporal organization of ant foraging from a complex systems perspective

Unveiling the latent dynamics in social cognition with multi-agent inverse reinforcement learning

Learning enables adaptation in cooperation for multi-player stochastic games

Visuo-frontal interactions during social learning in freely moving macaques

Collective Adaptation in Multi-Agent Systems: How Predator Confusion Shapes Swarm-Like Behaviors

Structure and influence in an interconnected world: neurocomputational mechanism of real-time distributed learning on social networks

Asymmetric Adaption in Social Learning: Understanding the Dilemma of Competition and Cooperation

Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement

Supporting Youth With Autism Learning Social Competence: A Comparison of Game-and Nongame-Based Activities in 3D Virtual World

Learning from humans to build social cognition among robots