Sequential Decision Learning Models with Balloon Analogy Risk Task

Lin Nie,Hongjing Lu,Yingnian Wu,Song-Chun Zhu

2009-01-01

Abstract:of the Thesis Sequential Decision Learning Models with Balloon Analogy Risk Task

What problem does this paper attempt to address?

Dual-process modeling of sequential decision making in the balloon analogue risk task

Ran Zhou,Mark A. Pitt

DOI: https://doi.org/10.1016/j.cogpsych.2023.101629

IF: 3.746

2024-01-13

Cognitive Psychology

Abstract:People are often faced with repeated risky decisions that involve uncertainty. In sequential risk-taking tasks, like the Balloon Analogue Risk Task (BART), the underlying decision process is not yet fully understood. Dual-process theory proposes that human cognition involves two main families of processes, often referred to as System 1 (fast and automatic) and System 2 (slow and conscious). We cross models of the BART with different architectures of the two systems to yield a pool of...

psychology, experimental
Distinctive Neural Substrates of low and high Risky Decision Making: Evidence from the Balloon Analog Risk Task

Zhenlan Jin,Simeng Li,Changan Wang,Xiaoqian Chai,Junjun Zhang,Ling Li

DOI: https://doi.org/10.1007/s10548-024-01094-8

IF: 4.275

2024-12-05

Brain Topography

Abstract:Human beings exhibit varying risk-taking behaviors in response to different risk levels. Despite numerous studies on risk-taking in decision-making, the neural mechanisms of decision-making regarding risk levels remains unclear. To investigate the neural correlates of individual differences in risk-taking under different risk-levels, we analyzed behavioral data of the Balloon Analogue Risk Task (BART) and resting-state functional Magnetic Resonance Imaging (rs-fMRI) data of healthy participants (22–39 years, N = 93) from the University of California, Los Angeles Consortium for Neuropsychiatric Phenomics dataset. In the BART, the participants decided to pump for more points or stop pumping to avoid explosion of the balloons, where the risk level was manipulated by the explosion likelihood which was distinguished by the balloon color (blue for low-, red for high- risk condition). Compared with low-risk condition, the participants pumped less number, exploded more balloons, and showed more variability in pump numbers in high-risk condition, demonstrating the effective manipulation of the risky level. Next, resting state features and functional connectivity (rsFC) strength were associated with behavioral measures in low- and high-risk conditions. We found that the explosion number of balloons were correlated with the low frequency fluctuations (ALFF) in the left dorsolateral prefrontal cortex (L. DLPFC), the rsFC strength between L. DLPFC and the left anterior orbital gyrus in the low-risk condition. In the high-risk condition, we found variability in pump numbers was correlated with the ALFF in the left middle/superior frontal gyrus, the fractional ALFF (fALFF) in the medial segment of precentral gyrus (M. PrG), and the rsFC strength between the M. PrG and bilateral precentral gyrus. Our results highlighted significance of the L. DLPFC in lower risky decision making and the precentral gyrus in higher risky decision making, suggesting that distinctive neural correlates underlie the individual differences of decision-making under different risk level.

neurosciences,clinical neurology
Sequential Decision Making with Expert Demonstrations under Unobserved Heterogeneity

Vahid Balazadeh,Keertana Chidambaram,Viet Nguyen,Rahul G. Krishnan,Vasilis Syrgkanis

2024-04-11

Abstract:We study the problem of online sequential decision-making given auxiliary demonstrations from experts who made their decisions based on unobserved contextual information. These demonstrations can be viewed as solving related but slightly different tasks than what the learner faces. This setting arises in many application domains, such as self-driving cars, healthcare, and finance, where expert demonstrations are made using contextual information, which is not recorded in the data available to the learning agent. We model the problem as a zero-shot meta-reinforcement learning setting with an unknown task distribution and a Bayesian regret minimization objective, where the unobserved tasks are encoded as parameters with an unknown prior. We propose the Experts-as-Priors algorithm (ExPerior), a non-parametric empirical Bayes approach that utilizes the principle of maximum entropy to establish an informative prior over the learner's decision-making problem. This prior enables the application of any Bayesian approach for online decision-making, such as posterior sampling. We demonstrate that our strategy surpasses existing behaviour cloning and online algorithms for multi-armed bandits and reinforcement learning, showcasing the utility of our approach in leveraging expert demonstrations across different decision-making setups.

Machine Learning
Decision from Models: Generalizing Probability Information to Novel Tasks.

Hang Zhang,Jacienta T Paily,Laurence T Maloney

DOI: https://doi.org/10.1037/dec0000022

2014-01-01

Decision

Abstract:We investigate a new type of decision under risk where-to succeed-participants must generalize their experience in one set of tasks to a novel set of tasks. We asked participants to trade distance for reward in a virtual minefield where each successive step incurred the same fixed probability of failure (referred to as hazard). With constant hazard, the probability of success (the survival function) decreases exponentially with path length. On each trial, participants chose between a shorter path with smaller reward and a longer (more dangerous) path with larger reward. They received feedback in 160 training trials: encountering a mine along their chosen path resulted in zero reward and successful completion of the path led to the reward associated with the path chosen. They then completed 600 no-feedback test trials with novel combinations of path length and rewards. To maximize expected gain, participants had to learn the correct exponential model in training and generalize it to the test conditions. We compared how participants discounted reward with increasing path length to the predictions of nine choice models including the correct exponential model. The choices of a majority of the participants were best accounted for by a model of the correct exponential form although with marked overestimation of the hazard rate. The decision-from-models paradigm differs from experience-based decision paradigms such as decision-from-sampling in the importance assigned to generalizing experience-based information to novel tasks. The task itself is representative of everyday tasks involving repeated decisions in stochastically invariant environments.
UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

Zhanyue Qin,Haochuan Wang,Deyuan Liu,Ziyang Song,Cunhang Fan,Zhao Lv,Jinlin Wu,Zhen Lei,Zhiying Tu,Dianhui Chu,Xiaoyan Yu,Dianbo Sui

2024-06-24

Abstract:Sequential decision-making refers to algorithms that take into account the dynamics of the environment, where early decisions affect subsequent decisions. With large language models (LLMs) demonstrating powerful capabilities between tasks, we can't help but ask: Can Current LLMs Effectively Make Sequential Decisions? In order to answer this question, we propose the UNO Arena based on the card game UNO to evaluate the sequential decision-making capability of LLMs and explain in detail why we choose UNO. In UNO Arena, We evaluate the sequential decision-making capability of LLMs dynamically with novel metrics based Monte Carlo methods. We set up random players, DQN-based reinforcement learning players, and LLM players (e.g. GPT-4, Gemini-pro) for comparison testing. Furthermore, in order to improve the sequential decision-making capability of LLMs, we propose the TUTRI player, which can involves having LLMs reflect their own actions wtih the summary of game history and the game strategy. Numerous experiments demonstrate that the TUTRI player achieves a notable breakthrough in the performance of sequential decision-making compared to the vanilla LLM player.

Computation and Language
A Novel Sequential Three-Way Decision Model for Medical Diagnosis

Junhua Hu,Wanying Cao,Pei Liang

DOI: https://doi.org/10.3390/sym14051004

2022-05-16

Symmetry

Abstract:In the sequential three-way decision model (S3WD), conditional probability and decision threshold pair are two key elements affecting the classification results. The classical model calculates the conditional probability based on the strict equivalence relationship, which limits its application in reality. In addition, little research has studied the relationship between the threshold change and its cause at different granularity levels. To deal with these deficiencies, we propose a novel sequential three-way decision model and apply it to medical diagnosis. Firstly, we propose two methods of calculating conditional probability based on similarity relation, which satisfies the property of symmetry. Then, we construct an S3WD model for a medical information system and use three different kinds of cost functions as the basis for modifying the threshold pair at each level. Subsequently, the rule of the decision threshold pair change is explored. Furthermore, two algorithms used for implementing the proposed S3WD model are introduced. Finally, extensive experiments are carried out to validate the feasibility and effectiveness of the proposed model, and the results show that the model can achieve better classification performance.
Description of Sequential Risky Decision-Making Choices in Human-Machine Teams Using Eye-Tracking and Decision Tree.

Wei Xiong,Chen Wang,Liang Ma

DOI: https://doi.org/10.1007/978-3-031-35741-1_35

2023-01-01

Abstract:Human-machine collaboration has shown great potential in sequential risky decision-making (SRDM). Human decision-makers made their decisions depending on the condition and their machine teammates. This paper aimed to explore attentional behaviors and decision-making processes under two human-machine collaboration contexts. To this end, 25 participants were asked to complete a modified Balloon Analog Risk Task with a highly accurate machine under different human-machine teams (HMTs). We collected and analyzed task performance, decision-making choices, eye-tracking data and subjective data. We employed the decision tree algorithm to describe decision-making processes and tested the performance through resubstitution validation and train-test validation. We found that both HMTs achieved comparable performance. Participants in the human-dominated team paid more attention to the machine-recommended value while participants in the human-machine joint team paid more attention to the inflation information of the machine. There were significant associations between choice ratios of inflation alternatives and decision choices for most subjects in both HMTs. In the human-machine joint team, we found a correlation between task profits and the fixation count on machine recommended value (r = 0.40, p = 0.05), and a correlation between the number of total explosions and the fixation count on whether the machine recommending to pump or not (r = -0.36, p = 0.07). Decision tree algorithm could cover and describe at least 67% of the decision-making choices and performed differently when subjects took different strategies. Our results revealed that eye-tracking and decision tree can be potential tools to describe and understand human SRDM behaviors.
One-shot learning and behavioral eligibility traces in sequential decision making

Marco Lehmann,He Xu,Vasiliki Liakoni,Michael Herzog,Wulfram Gerstner,Kerstin Preuschoff

DOI: https://doi.org/10.7554/eLife.47463

2019-11-12

Abstract:In many daily tasks we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning theory suggests two classes of algorithms solving this credit assignment problem: In classic temporal-difference learning, earlier actions receive reward information only after multiple repetitions of the task, whereas models with eligibility traces reinforce entire sequences of actions from a single experience (one-shot). Here we asked whether humans use eligibility traces. We developed a novel paradigm to directly observe which actions and states along a multi-step sequence are reinforced after a single reward. By focusing our analysis on those states for which RL with and without eligibility trace make qualitatively distinct predictions, we find direct behavioral (choice probability) and physiological (pupil dilation) signatures of reinforcement learning with eligibility trace across multiple sensory modalities.

Neurons and Cognition
Risk-Sensitive and Robust Model-Based Reinforcement Learning and Planning

Marc Rigter

2023-04-03

Abstract:Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and researchers attempt to deploy autonomous systems in less constrained environments, it is increasingly important that we endow sequential decision-making algorithms with the ability to reason about uncertainty and risk. In this thesis, we will address both planning and reinforcement learning (RL) approaches to sequential decision-making. In the planning setting, it is assumed that a model of the environment is provided, and a policy is optimised within that model. Reinforcement learning relies upon extensive random exploration, and therefore usually requires a simulator in which to perform training. In many real-world domains, it is impossible to construct a perfectly accurate model or simulator. Therefore, the performance of any policy is inevitably uncertain due to the incomplete knowledge about the environment. Furthermore, in stochastic domains, the outcome of any given run is also uncertain due to the inherent randomness of the environment. These two sources of uncertainty are usually classified as epistemic, and aleatoric uncertainty, respectively. The over-arching goal of this thesis is to contribute to developing algorithms that mitigate both sources of uncertainty in sequential decision-making problems. We make a number of contributions towards this goal, with a focus on model-based algorithms...

Machine Learning,Artificial Intelligence
Learning to Generalize for Sequential Decision Making

Xusen Yin,Ralph Weischedel,Jonathan May

DOI: https://doi.org/10.48550/arXiv.2010.02229

2020-10-06

Abstract:We consider problems of making sequences of decisions to accomplish tasks, interacting via the medium of language. These problems are often tackled with reinforcement learning approaches. We find that these models do not generalize well when applied to novel task domains. However, the large amount of computation necessary to adequately train and explore the search space of sequential decision making, under a reinforcement learning paradigm, precludes the inclusion of large contextualized language models, which might otherwise enable the desired generalization ability. We introduce a teacher-student imitation learning methodology and a means of converting a reinforcement learning model into a natural language understanding model. Together, these methodologies enable the introduction of contextualized language models into the sequential decision making problem space. We show that models can learn faster and generalize more, leveraging both the imitation learning and the reformulation. Our models exceed teacher performance on various held-out decision problems, by up to 7% on in-domain problems and 24% on out-of-domain problems.

Computation and Language,Artificial Intelligence
Sequential Learning And Decision-Making In Wireless Resource Management Introduction

Rong Zheng,Cunqing Hua

DOI: https://doi.org/10.1007/978-3-319-50502-2_1

2016-01-01

Abstract:Sequential learning provides a rigorous framework to address the tradeoffs between exploration and exploitation in face of uncertainty, vividly captured in the multi-armed bandit problem. In this chapter, we provide an overview of the sequential learning framework and a taxonomy of the types of problems where the framework applies.
Model and Reinforcement Learning for Markov Games with Risk Preferences

Wenjie Huang,Viet Hai Pham,William Benjamin Haskell

DOI: https://doi.org/10.1609/aaai.v34i02.5574

2020-04-03

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:We motivate and propose a new model for non-cooperative Markov game which considers the interactions of risk-aware players. This model characterizes the time-consistent dynamic “risk” from both stochastic state transitions (inherent to the game) and randomized mixed strategies (due to all other players). An appropriate risk-aware equilibrium concept is proposed and the existence of such equilibria is demonstrated in stationary strategies by an application of Kakutani's fixed point theorem. We further propose a simulation-based Q-learning type algorithm for risk-aware equilibrium computation. This algorithm works with a special form of minimax risk measures which can naturally be written as saddle-point stochastic optimization problems, and covers many widely investigated risk measures. Finally, the almost sure convergence of this simulation-based algorithm to an equilibrium is demonstrated under some mild conditions. Our numerical experiments on a two player queuing game validate the properties of our model and algorithm, and demonstrate their worth and applicability in real life competitive decision-making.
Modeling and Interpreting Real-world Human Risk Decision Making with Inverse Reinforcement Learning

Quanying Liu,Haiyan Wu,Anqi Liu

DOI: https://doi.org/10.48550/arXiv.1906.05803

2019-06-14

Abstract:We model human decision-making behaviors in a risk-taking task using inverse reinforcement learning (IRL) for the purposes of understanding real human decision making under risk. To the best of our knowledge, this is the first work applying IRL to reveal the implicit reward function in human risk-taking decision making and to interpret risk-prone and risk-averse decision-making policies. We hypothesize that the state history (e.g. rewards and decisions in previous trials) are related to the human reward function, which leads to risk-averse and risk-prone decisions. We design features that reflect these factors in the reward function of IRL and learn the corresponding weight that is interpretable as the importance of features. The results confirm the sub-optimal risk-related decisions of human-driven by the personalized reward function. In particular, the risk-prone person tends to decide based on the current pump number, while the risk-averse person relies on burst information from the previous trial and the average end status. Our results demonstrate that IRL is an effective tool to model human decision-making behavior, as well as to help interpret the human psychological process in risk decision-making.

Machine Learning,Neurons and Cognition
CM-DQN: A Value-Based Deep Reinforcement Learning Model to Simulate Confirmation Bias

Jiacheng Shen,Lihan Feng

DOI: https://doi.org/10.47191/etj/v9i07.31

2024-08-08

Abstract:In human decision-making tasks, individuals learn through trials and prediction errors. When individuals learn the task, some are more influenced by good outcomes, while others weigh bad outcomes more heavily. Such confirmation bias can lead to different learning effects. In this study, we propose a new algorithm in Deep Reinforcement Learning, CM-DQN, which applies the idea of different update strategies for positive or negative prediction errors, to simulate the human decision-making process when the task's states are continuous while the actions are discrete. We test in Lunar Lander environment with confirmatory, disconfirmatory bias and non-biased to observe the learning effects. Moreover, we apply the confirmation model in a multi-armed bandit problem (environment in discrete states and discrete actions), which utilizes the same idea as our proposed algorithm, as a contrast experiment to algorithmically simulate the impact of different confirmation bias in decision-making process. In both experiments, confirmatory bias indicates a better learning effect.

Machine Learning
Sequential Probability Assignment with Contexts: Minimax Regret, Contextual Shtarkov Sums, and Contextual Normalized Maximum Likelihood

Ziyi Liu,Idan Attias,Daniel M. Roy

2024-10-05

Abstract:We study the fundamental problem of sequential probability assignment, also known as online learning with logarithmic loss, with respect to an arbitrary, possibly nonparametric hypothesis class. Our goal is to obtain a complexity measure for the hypothesis class that characterizes the minimax regret and to determine a general, minimax optimal algorithm. Notably, the sequential $\ell_{\infty}$ entropy, extensively studied in the literature (Rakhlin and Sridharan, 2015, Bilodeau et al., 2020, Wu et al., 2023), was shown to not characterize minimax risk in general. Inspired by the seminal work of Shtarkov (1987) and Rakhlin, Sridharan, and Tewari (2010), we introduce a novel complexity measure, the \emph{contextual Shtarkov sum}, corresponding to the Shtarkov sum after projection onto a multiary context tree, and show that the worst case log contextual Shtarkov sum equals the minimax regret. Using the contextual Shtarkov sum, we derive the minimax optimal strategy, dubbed \emph{contextual Normalized Maximum Likelihood} (cNML). Our results hold for sequential experts, beyond binary labels, which are settings rarely considered in prior work. To illustrate the utility of this characterization, we provide a short proof of a new regret upper bound in terms of sequential $\ell_{\infty}$ entropy, unifying and sharpening state-of-the-art bounds by Bilodeau et al. (2020) and Wu et al. (2023).

Machine Learning
Anomalous State Sequence Modeling to Enhance Safety in Reinforcement Learning

Leen Kweider,Maissa Abou Kassem,Ubai Sandouk

2024-07-29

Abstract:The deployment of artificial intelligence (AI) in decision-making applications requires ensuring an appropriate level of safety and reliability, particularly in changing environments that contain a large number of unknown observations. To address this challenge, we propose a novel safe reinforcement learning (RL) approach that utilizes an anomalous state sequence to enhance RL safety. Our proposed solution Safe Reinforcement Learning with Anomalous State Sequences (AnoSeqs) consists of two stages. First, we train an agent in a non-safety-critical offline 'source' environment to collect safe state sequences. Next, we use these safe sequences to build an anomaly detection model that can detect potentially unsafe state sequences in a 'target' safety-critical environment where failures can have high costs. The estimated risk from the anomaly detection model is utilized to train a risk-averse RL policy in the target environment; this involves adjusting the reward function to penalize the agent for visiting anomalous states deemed unsafe by our anomaly model. In experiments on multiple safety-critical benchmarking environments including self-driving cars, our solution approach successfully learns safer policies and proves that sequential anomaly detection can provide an effective supervisory signal for training safety-aware RL agents

Machine Learning,Artificial Intelligence
Learning Multiple Probabilistic Decisions from Latent World Model in Autonomous Driving

Lingyu Xiao,Jiang-Jiang Liu,Sen Yang,Xiaofan Li,Xiaoqing Ye,Wankou Yang,Jingdong Wang

2024-09-24

Abstract:The autoregressive world model exhibits robust generalization capabilities in vectorized scene understanding but encounters difficulties in deriving actions due to insufficient uncertainty modeling and self-delusion. In this paper, we explore the feasibility of deriving decisions from an autoregressive world model by addressing these challenges through the formulation of multiple probabilistic hypotheses. We propose LatentDriver, a framework models the environment's next states and the ego vehicle's possible actions as a mixture distribution, from which a deterministic control signal is then derived. By incorporating mixture modeling, the stochastic nature of decisionmaking is captured. Additionally, the self-delusion problem is mitigated by providing intermediate actions sampled from a distribution to the world model. Experimental results on the recently released close-loop benchmark Waymax demonstrate that LatentDriver surpasses state-of-the-art reinforcement learning and imitation learning methods, achieving expert-level performance. The code and models will be made available at <a class="link-external link-https" href="https://github.com/Sephirex-X/LatentDriver" rel="external noopener nofollow">this https URL</a>.

Robotics,Artificial Intelligence
Overt visual attention and value computation in complex risky choice

Xinhao Fan,Jacob Elsey,Aurelien Wyngaard,Youping Yang,Aaron Sampson,Erik Emeric,Moshe Glickman,Marius Usher,Dino Levy,Veit Stuphorn,Ernst Niebur

DOI: https://doi.org/10.1101/2020.12.08.416313

2020-12-09

Abstract:Abstract Traditional models of decision making under uncertainty explain human behavior in simple situations with a minimal set of alternatives and attributes. Some of them, such as prospect theory, have been proven successful and robust in such simple situations. Yet, less is known about the preference formation during decision making in more complex cases. Furthermore, it is generally accepted that attention plays a role in the decision process but most theories make simplifying assumptions about where attention is deployed. In this study, we replace these assumptions by measuring where humans deploy overt attention, i.e. where they fixate. To assess the influence of task complexity, participants perform two tasks. The simpler of the two requires participants to choose between two alternatives with two attributes each (four items to consider). The more complex one requires a choice between four alternatives with four attributes each (16 items to consider). We then compare a large set of model classes, of different levels of complexity, by considering the dynamic interactions between uncertainty, attention and pairwise comparisons between attribute values. The task of all models is to predict what choices humans make, using the sequence of observed eye movements for each participant as input to the model. We find that two models outperform all others. The first is the two-layer leaky accumulator which predicts human choices on the simpler task better than any other model. We call the second model, which is introduced in this study, TNPRO. It is modified from a previous model from management science and designed to deal with highly complex decision problems. Our results show that this model performs well in the simpler of our two tasks (second best, after the accumulator model) and best for the complex task. Our results suggest that, when faced with complex choice problems, people prefer to accumulate preference based on attention-guided pairwise comparisons.
Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes

Baiting Luo,Yunuo Zhang,Abhishek Dubey,Ayan Mukhopadhyay

2024-01-22

Abstract:A fundamental (and largely open) challenge in sequential decision-making is dealing with non-stationary environments, where exogenous environmental conditions change over time. Such problems are traditionally modeled as non-stationary Markov decision processes (NSMDP). However, existing approaches for decision-making in NSMDPs have two major shortcomings: first, they assume that the updated environmental dynamics at the current time are known (although future dynamics can change); and second, planning is largely pessimistic, i.e., the agent acts ``safely'' to account for the non-stationary evolution of the environment. We argue that both these assumptions are invalid in practice -- updated environmental conditions are rarely known, and as the agent interacts with the environment, it can learn about the updated dynamics and avoid being pessimistic, at least in states whose dynamics it is confident about. We present a heuristic search algorithm called \textit{Adaptive Monte Carlo Tree Search (ADA-MCTS)} that addresses these challenges. We show that the agent can learn the updated dynamics of the environment over time and then act as it learns, i.e., if the agent is in a region of the state space about which it has updated knowledge, it can avoid being pessimistic. To quantify ``updated knowledge,'' we disintegrate the aleatoric and epistemic uncertainty in the agent's updated belief and show how the agent can use these estimates for decision-making. We compare the proposed approach with the multiple state-of-the-art approaches in decision-making across multiple well-established open-source problems and empirically show that our approach is faster and highly adaptive without sacrificing safety.

Artificial Intelligence,Machine Learning
Sequential sampling without comparison to boundary through model-free reinforcement learning

Jamal Esmaily,Rani Moran,Yasser Roudi,Bahador Bahrami

2024-08-12

Abstract:Although evidence integration to the boundary model has successfully explained a wide range of behavioral and neural data in decision making under uncertainty, how animals learn and optimize the boundary remains unresolved. Here, we propose a model-free reinforcement learning algorithm for perceptual decisions under uncertainty that dispenses entirely with the concepts of decision boundary and evidence accumulation. Our model learns whether to commit to a decision given the available evidence or continue sampling information at a cost. We reproduced the canonical features of perceptual decision-making such as dependence of accuracy and reaction time on evidence strength, modulation of speed-accuracy trade-off by payoff regime, and many others. By unifying learning and decision making within the same framework, this model can account for unstable behavior during training as well as stabilized post-training behavior, opening the door to revisiting the extensive volumes of discarded training data in the decision science literature.

Neural and Evolutionary Computing

Sequential Decision Learning Models with Balloon Analogy Risk Task

Dual-process modeling of sequential decision making in the balloon analogue risk task

Distinctive Neural Substrates of low and high Risky Decision Making: Evidence from the Balloon Analog Risk Task

Sequential Decision Making with Expert Demonstrations under Unobserved Heterogeneity

Decision from Models: Generalizing Probability Information to Novel Tasks.

UNO Arena for Evaluating Sequential Decision-Making Capability of Large Language Models

A Novel Sequential Three-Way Decision Model for Medical Diagnosis

Description of Sequential Risky Decision-Making Choices in Human-Machine Teams Using Eye-Tracking and Decision Tree.

One-shot learning and behavioral eligibility traces in sequential decision making

Risk-Sensitive and Robust Model-Based Reinforcement Learning and Planning

Learning to Generalize for Sequential Decision Making

Sequential Learning And Decision-Making In Wireless Resource Management Introduction

Model and Reinforcement Learning for Markov Games with Risk Preferences

Modeling and Interpreting Real-world Human Risk Decision Making with Inverse Reinforcement Learning

CM-DQN: A Value-Based Deep Reinforcement Learning Model to Simulate Confirmation Bias

Sequential Probability Assignment with Contexts: Minimax Regret, Contextual Shtarkov Sums, and Contextual Normalized Maximum Likelihood

Anomalous State Sequence Modeling to Enhance Safety in Reinforcement Learning

Learning Multiple Probabilistic Decisions from Latent World Model in Autonomous Driving

Overt visual attention and value computation in complex risky choice

Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes

Sequential sampling without comparison to boundary through model-free reinforcement learning