Abstract:This paper reviews research on dynamic decision making, i.e., decision making under conditions which require a series of decisions, where the decisions are not independent, where the state of the world changes, both autonomously and as a consequence of the decision maker's actions, and where the decisions have to be made in real time. It is difficult to find useful normative theories for these kinds of decisions, and research thus has to focus on descriptive issues. A general approach, based on control theory, is proposed as a means to organize research in the area. An experimental paradigm for the study of dynamic decision making, that of computer simulated microworlds, is discussed, and two approaches using this paradigm are described: the individual differences approach, typical of German work in the tradition of research on complex problem solving, and the experimental approach. In studies following the former approach, the behaviour of groups differing in performance is compared, either with respect to strategies or with respect to performance on psychological tests. The results show that there are wide interindividual differences in performance, but no stable correlations between performance in microworlds and scores on traditional psychological tests have been found. Experimental research studying the effects of system characteristics, such as complexity and feedback delays, on dynamic decision making has shown that decision performance in dynamic tasks is strongly affected by feedback delays and whether or not the decisions have side effects. Although neither approach has led to any well-developed theory of dynamic decision making so far, the results nevertheless indicate that we are now able to produce highly reliable experimental results in the laboratory, results that agree with those found in field studies of dynamic decision making. This shows that an important first step towards a better understanding of these phenomena has been taken.

Control-theoretic results on dynamic decision making

Models of Strategic Decision-Making under Informational Control

Dynamic Modeling And Nonlinear Predictive Control Based On Partitioned Model And Nonlinear Optimization

Direct control method for improving stability and reliability of nonlinear stochastic dynamical systems

Human Trust-based Feedback Control: Dynamically varying automation transparency to optimize human-machine interactions

Model-free Adaptive Dynamic Programming for Optimal Control of Discrete-time Affine Nonlinear System

Trust, control strategies and allocation of function in human-machine systems

Dynamic decision making: Human control of complex systems

Dynamic management of resources and workloads for RDBMS in cloud: a control-theoretic approach

Mathematical Modeling of the Dynamics of Trust in Automation

Human operator decision support for highly transient industrial processes: a reinforcement learning approach

Optimal control of discrete event systems under uncertain environment based on supervisory control theory and reinforcement learning

Optimal control model and theoretical analysis for organizational learning in manufacturing firms

Dynamics of Trust in Automation and Interactive Decision Making During Driving Simulation Tasks

The Impact of Automation Conditions on Reliance Dynamics and Decision-Making

Controlling uncertainty: A review of human behavior in complex dynamic environments.

Generalized Conditional Feedback System with Model Uncertainty

A Model Predictive Control Framework for Improving Risk-Tolerance of Manufacturing Systems

An Approach to Controlling Context by Combining Game Theory and Control Theory for Self-Adaptive Software in Creative Computing

Toward Quantifying Trust Dynamics: How People Adjust Their Trust After Moment-to-Moment Interaction With Automation

Analyzing Operator States and the Impact of AI-Enhanced Decision Support in Control Rooms: A Human-in-the-Loop Specialized Reinforcement Learning Framework for Intervention Strategies