Abstract:Modeling human cognitive processes in dynamic decision-making tasks has been an endeavor in AI for a long time because such models can help make AI systems more intuitive, personalized, mitigate any human biases, and enhance training in simulation. Some initial work has attempted to utilize neural networks (and large language models) but often assumes one common model for all humans and aims to emulate human behavior in aggregate. However, the behavior of each human is distinct, heterogeneous, and relies on specific past experiences in certain tasks. For instance, consider two individuals responding to a phishing email: one who has previously encountered and identified similar threats may recognize it quickly, while another without such experience might fall for the scam. In this work, we build on Instance Based Learning (IBL) that posits that human decisions are based on similar situations encountered in the past. However, IBL relies on simple fixed form functions to capture the mapping from past situations to current decisions. To that end, we propose two new attention-based neural network models to have open form non-linear functions to model distinct and heterogeneous human decision-making in dynamic settings. We experiment with two distinct datasets gathered from human subject experiment data, one focusing on detection of phishing email by humans and another where humans act as attackers in a cybersecurity setting and decide on an attack option. We conducted extensive experiments with our two neural network models, IBL, and GPT3.5, and demonstrate that the neural network models outperform IBL significantly in representing human decision-making, while providing similar interpretability of human decisions as IBL. Overall, our work yields promising results for further use of neural networks in cognitive modeling of human decision making.

Discovering Cognitive Strategies with Tiny Recurrent Neural Networks

Predictive and Interpretable: Combining Artificial Neural Networks and Classic Cognitive Models to Understand Human Learning and Decision Making

Using recurrent neural network to estimate irreducible stochasticity in human choice behavior

Biomimetic model of corticostriatal micro-assemblies discovers new neural code

Predicting human decision making in psychological tasks with recurrent neural networks.

Predicting human decision making in psychological tasks with recurrent neural networks

Neurocomputations of strategic behavior: From iterated to novel interactions

A recurrent neural network framework for flexible and adaptive decision making based on sequence learning

Towards Neural Network based Cognitive Models of Dynamic Decision-Making by Humans

A computational model of behavioral adaptation to solve the credit assignment problem

Exploration-exploitation mechanisms in recurrent neural networks and human learners in restless bandit problems

Episodic memory governs choices: An RNN-based reinforcement learning model for decision-making task

A vast space of compact strategies for effective decisions

Neuron-level prediction and noise can implement flexible reward-seeking behavior

Towards biologically plausible model-based reinforcement learning in recurrent spiking networks by dreaming new experiences

Neural Dynamics Model of Visual Decision-Making: Learning from Human Experts

Humans rationally balance detailed and temporally abstract world models

Latent Variable Sequence Identification for Cognitive Models with Neural Network Estimators

Capturing the Complexity of Human Strategic Decision-Making with Machine Learning

Recurrent networks endowed with structural priors explain suboptimal animal behavior

RTify: Aligning Deep Neural Networks with Human Behavioral Decisions