Abstract:Learning in a stochastic environment consists of estimating a model from a limited amount of noisy data, and is therefore inherently uncertain. However, many classical models reduce the learning process to the updating of parameter estimates and neglect the fact that learning is also frequently accompanied by a variable "feeling of knowing" or confidence. The characteristics and the origin of these subjective confidence estimates thus remain largely unknown. Here we investigate whether, during learning, humans not only infer a model of their environment, but also derive an accurate sense of confidence from their inferences. In our experiment, humans estimated the transition probabilities between two visual or auditory stimuli in a changing environment, and reported their mean estimate and their confidence in this report. To formalize the link between both kinds of estimate and assess their accuracy in comparison to a normative reference, we derive the optimal inference strategy for our task. Our results indicate that subjects accurately track the likelihood that their inferences are correct. Learning and estimating confidence in what has been learned appear to be two intimately related abilities, suggesting that they arise from a single inference process. We show that human performance matches several properties of the optimal probabilistic inference. In particular, subjective confidence is impacted by environmental uncertainty, both at the first level (uncertainty in stimulus occurrence given the inferred stochastic characteristics) and at the second level (uncertainty due to unexpected changes in these stochastic characteristics). Confidence also increases appropriately with the number of observations within stable periods. Our results support the idea that humans possess a quantitative sense of confidence in their inferences about abstract non-sensory parameters of the environment. This ability cannot be reduced to simple heuristics, it seems instead a core property of the learning process.

Confidence is detection-like in high-dimensional spaces

Re-evaluating frontopolar and temporoparietal contributions to detection and discrimination confidence

Confidence control for efficient behaviour in dynamic environments

A decision-congruent heuristic gives superior metacognitive sensitivity under realistic variance assumptions.

Long-term perceptual priors drive confidence bias which favors prior-congruent evidence

Modeling confidence judgments, response times, and multiple choices in decision making: Recognition memory and motion discrimination.

On the assumptions behind metacognitive measurements: Implications for theory and practice

Confidence Is the Bridge between Multi-stage Decisions

Generalized Gaussian signal detection theory: A unified signal detection framework for confidence data analysis.

The conditional approach to evaluating detection performance

When temporal attention lacks confidence

A confidence framing effect: Flexible use of evidence in metacognitive monitoring

Priors for natural image statistics inform confidence in perceptual decisions

The Sense of Confidence during Probabilistic Learning: A Normative Account

Which statistical hypotheses are afflicted with false confidence?

The effects of non-diagnostic information on confidence and decision making

Modeling perceptual confidence and the confidence forced-choice paradigm.

Confidence judgments interfere with perceptual decision making

Metacognitive evaluation of postdecisional perceptual representations

On the relationship between subjective decision criteria and paranoid ideations

Decision-making, Errors, and Confidence in the Brain.