Abstract:Videogames provide a promising framework to understand brain activity in a rich, engaging, and active environment, in contrast to mostly passive tasks currently dominating the field, such as image viewing. Analyzing videogames neuroimaging data is however challenging, and relies on time-intensive manual annotations of game events, based on somewhat arbitrary rules. Here, we introduce an innovative approach using Artificial Neural networks (ANN) and brain encoding techniques to generate activation maps associated with videogame behaviour using functional magnetic resonance imaging (fMRI). As individual behavior is highly variable across subjects in complex environments, we hypothesized that ANNs need to account for subject-specific behavior to properly capture brain dynamics. In this study, we used data collected while subjects played Shinobi III: Return of the Ninja Master (Sega, 1993), an action-platformer videogame. Using imitation learning, we trained an ANN to play the game while closely replicating the unique gameplay style of individual participants. We found that hidden layers of our imitation learning model successfully encoded task-relevant neural representations, and predicted individual brain dynamics with higher accuracy than models trained on other subjects' gameplay. Individual-specific models also outperformed a number of baselines to predict brain activity, such as pixel inputs, or button presses. The highest correlations between layer activations and brain signals were observed in biologically plausible brain areas, i.e. somatosensory, attention, and visual networks. Our results demonstrate that training subject-specific ANNs can successfully uncover brain correlates of complex behaviour. This new method combining imitation learning, brain imaging, and videogames opens new research avenues to study decision-making and psychomotor task solving in naturalistic and complex environments.

On computational models of theory of mind and the imitative reinforcement learning in spiking neural networks

Think That Attackers Think: Using First-Order Theory of Mind in Intrusion Response System.

A brain-inspired theory of mind spiking neural network improves multi-agent cooperation and competition

Modeling Theory of Mind in Multi-Agent Games Using Adaptive Feedback Control

Inverse Reinforcement Learning as the Algorithmic Basis for Theory of Mind: Current Methods and Open Problems

A Brain-Inspired Model of Theory of Mind

Theory of Mind From Observation in Cognitive Models and Humans

Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning

On Learning to Think: Algorithmic Information Theory for Novel Combinations of Reinforcement Learning Controllers and Recurrent Neural World Models

Computational Language Acquisition with Theory of Mind

Towards biologically plausible model-based reinforcement learning in recurrent spiking networks by dreaming new experiences

Memory-Augmented Theory of Mind Network

Unveiling the latent dynamics in social cognition with multi-agent inverse reinforcement learning

Experiments with a Social Learning Model

Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs

Experiments in Artificial Theory of Mind: From Safety to Story-Telling

A Brain-inspired Theory of Collective Mind Model for Efficient Social Cooperation

Cognitive Models for Machine Theory of Mind

A Spiking Neural Network Model of Model-Free Reinforcement Learning with High-Dimensional Sensory Input and Perceptual Ambiguity

Behavioral Imitation with Artificial Neural Networks Leads to Personalized Models of Brain Dynamics During Videogame Play