Abstract:Decision-making is a high-level cognitive process based on cognitive processes like perception, attention, and memory. Real-life situations require series of decisions to be made, with each decision depending on previous feedback from a potentially changing environment. To gain a better understanding of the underlying processes of dynamic decision-making, we applied the method of cognitive modeling on a complex rule-based category learning task. Here, participants first needed to identify the conjunction of two rules that defined a target category and later adapt to a reversal of feedback contingencies. We developed an ACT-R model for the core aspects of this dynamic decision-making task. An important aim of our model was that it provides a general account of how such tasks are solved and, with minor changes, is applicable to other stimulus materials. The model was implemented as a mixture of an exemplar-based and a rule-based approach which incorporates perceptual-motor and metacognitive aspects as well. The model solves the categorization task by first trying out one-feature strategies and then, as a result of repeated negative feedback, switching to two-feature strategies. Overall, this model solves the task in a similar way as participants do, including generally successful initial learning as well as reversal learning after the change of feedback contingencies. Moreover, the fact that not all participants were successful in the two learning phases is also reflected in the modeling data. However, we found a larger variance and a lower overall performance of the modeling data as compared to the human data which may relate to perceptual preferences or additional knowledge and rules applied by the participants. In a next step, these aspects could be implemented in the model for a better overall fit. In view of the large interindividual differences in decision performance between participants, additional information about the underlying cognitive processes from behavioral, psychobiological and neurophysiological data may help to optimize future applications of this model such that it can be transferred to other domains of comparable dynamic decision tasks.

Markov Decision Process Measurement Model

A hybrid approach to dynamic cognitive psychometrics

The assessment of affective decision‐making: Exploring alternative scoring methods for the Balloon Analog Risk Task and Columbia Card Task

Multidimensional Latent Markov Models in a Developmental Study of Inhibitory Control and Attentional Flexibility in Early Childhood

A latent process model for monitoring progress towards hard-to-measure targets, with applications to mental health and online educational assessments

MOOCs Meet Measurement Theory: A Topic-Modelling Approach

Markov chain models for inspecting response dynamics in psychological testing

Can we infer player behavior tendencies from a player's decision-making data? Integrating Theory of Mind to Player Modeling

Game Theoretic Markov Decision Processes for Optimal Decision Making in Social Systems

A Model of Risk and Mental State Shifts during Social Interaction

Robust Active Measuring under Model Uncertainty

A Sequential Response Model for Analyzing Process Data on Technology-Based Problem-Solving Tasks

Learning Cost-Effective Treatment Regimes using Markov Decision Processes

A Cognitive Modeling Approach to Strategy Formation in Dynamic Decision Making

Sufficient Markov Decision Processes with Alternating Deep Neural Networks

Sociocognitive and Argumentation Perspectives on Psychometric Modeling in Educational Assessment

Polytomous Effectiveness Indicators in Complex Problem-Solving Tasks and Their Applications in Developing Measurement Model

A Latent Hidden Markov Model for Process Data

Modeling Player Personality Factors from In-Game Behavior and Affective Expression

Exploring Multiple Strategic Problem Solving Behaviors in Educational Psychology Research by Using Mixture Cognitive Diagnosis Model

A Mixture Model for Random Responding Behavior in Forced-Choice Noncognitive Assessment: Implication and Application in Organizational Research