Abstract:Decision-making is a high-level cognitive process based on cognitive processes like perception, attention, and memory. Real-life situations require series of decisions to be made, with each decision depending on previous feedback from a potentially changing environment. To gain a better understanding of the underlying processes of dynamic decision-making, we applied the method of cognitive modeling on a complex rule-based category learning task. Here, participants first needed to identify the conjunction of two rules that defined a target category and later adapt to a reversal of feedback contingencies. We developed an ACT-R model for the core aspects of this dynamic decision-making task. An important aim of our model was that it provides a general account of how such tasks are solved and, with minor changes, is applicable to other stimulus materials. The model was implemented as a mixture of an exemplar-based and a rule-based approach which incorporates perceptual-motor and metacognitive aspects as well. The model solves the categorization task by first trying out one-feature strategies and then, as a result of repeated negative feedback, switching to two-feature strategies. Overall, this model solves the task in a similar way as participants do, including generally successful initial learning as well as reversal learning after the change of feedback contingencies. Moreover, the fact that not all participants were successful in the two learning phases is also reflected in the modeling data. However, we found a larger variance and a lower overall performance of the modeling data as compared to the human data which may relate to perceptual preferences or additional knowledge and rules applied by the participants. In a next step, these aspects could be implemented in the model for a better overall fit. In view of the large interindividual differences in decision performance between participants, additional information about the underlying cognitive processes from behavioral, psychobiological and neurophysiological data may help to optimize future applications of this model such that it can be transferred to other domains of comparable dynamic decision tasks.

Applying Generative Artificial Intelligence to cognitive models of decision making

Generative Artificial Intelligence: A Historical and Future Perspective

Towards Neural Network based Cognitive Models of Dynamic Decision-Making by Humans

Cognitive Models as Simulators: The Case of Moral Decision-Making

Generative AI for Consumer Behavior Prediction: Techniques and Applications

A Neuro-mimetic Realization of the Common Model of Cognition via Hebbian Learning and Free Energy Minimization

Building Human-Like Artificial Agents: A General Cognitive Algorithm for Emulating Human Decision-Making in Dynamic Environments

From DDMs to DNNs: Using process data and models of decision-making to improve human-AI interactions

Is Conditional Generative Modeling all you need for Decision-Making?

Generative Agent-Based Modeling: Unveiling Social System Dynamics through Coupling Mechanistic Models with Generative Artificial Intelligence

The Memory Systems of the Human Brain and Generative Artificial Intelligence

Modeling agent decision and behavior in the light of data science and artificial intelligence

Predictive and Interpretable: Combining Artificial Neural Networks and Classic Cognitive Models to Understand Human Learning and Decision Making

Predicting the Impact of Generative AI Using an Agent-Based Model

Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AI

Predicting and Understanding Human Action Decisions: Insights from Large Language Models and Cognitive Instance-Based Learning

Generative Models for the Psychology of Art and Aesthetics

Generative AI as Economic Agents

A Study on the Application of Artificial Intelligence in Conceptual Design

Generative Artificial Intelligence: A Systematic Review and Applications

A Cognitive Modeling Approach to Strategy Formation in Dynamic Decision Making