Abstract:We investigate a new type of decision under risk where-to succeed-participants must generalize their experience in one set of tasks to a novel set of tasks. We asked participants to trade distance for reward in a virtual minefield where each successive step incurred the same fixed probability of failure (referred to as hazard). With constant hazard, the probability of success (the survival function) decreases exponentially with path length. On each trial, participants chose between a shorter path with smaller reward and a longer (more dangerous) path with larger reward. They received feedback in 160 training trials: encountering a mine along their chosen path resulted in zero reward and successful completion of the path led to the reward associated with the path chosen. They then completed 600 no-feedback test trials with novel combinations of path length and rewards. To maximize expected gain, participants had to learn the correct exponential model in training and generalize it to the test conditions. We compared how participants discounted reward with increasing path length to the predictions of nine choice models including the correct exponential model. The choices of a majority of the participants were best accounted for by a model of the correct exponential form although with marked overestimation of the hazard rate. The decision-from-models paradigm differs from experience-based decision paradigms such as decision-from-sampling in the importance assigned to generalizing experience-based information to novel tasks. The task itself is representative of everyday tasks involving repeated decisions in stochastically invariant environments.

Decision making in stochastic extensive form I: Stochastic decision forests

Decision Theory with Resource-Bounded Agents

Decision Forest: A Nonparametric Approach to Modeling Irrational Choice

Decision making with dynamic probabilistic forecasts

Exceeding Expectations: Stochastic Dominance as a General Decision Theory

A multi-agent model of hierarchical decision dynamics

Stochastic Optimization Forests

Constructing rough decision forests

A Successive Refinement for Solving Stochastic Programs with Decision-Dependent Random Capacities

Decision-Making by Hierarchies of Discordant Agents

A decision-making Fokker-Planck model in computational neuroscience

(De-)Randomized Smoothing for Decision Stump Ensembles

Bandit Linear Optimization for Sequential Decision Making and Extensive-Form Games

Decision-Making with Complex Data Structures using Probabilistic Programming

Solving decision problems with endogenous uncertainty and conditional information revelation using influence diagrams

Machine learning for decision-making under uncertainty

The random subspace method for constructing decision forests

Decision from Models: Generalizing Probability Information to Novel Tasks.

Decision-Making Under Uncertainty: Beyond Probabilities

Buying Data Over Time: Approximately Optimal Strategies for Dynamic Data-Driven Decisions

A Unified Approach to Dynamic Decision Problems with Asymmetric Information - Part I: Non-Strategic Agents