Abstract:Confirmation bias, the tendency to interpret information in a way that aligns with one's preconceptions, can profoundly impact scientific research, leading to conclusions that reflect the researcher's hypotheses even when the observational data do not support them. This issue is especially critical in scientific fields involving highly noisy observations, such as cryo-electron microscopy. This study investigates confirmation bias in Gaussian mixture models. We consider the following experiment: A team of scientists assumes they are analyzing data drawn from a Gaussian mixture model with known signals (hypotheses) as centroids. However, in reality, the observations consist entirely of noise without any informative structure. The researchers use a single iteration of the K-means or expectation-maximization algorithms, two popular algorithms to estimate the centroids. Despite the observations being pure noise, we show that these algorithms yield biased estimates that resemble the initial hypotheses, contradicting the unbiased expectation that averaging these noise observations would converge to zero. Namely, the algorithms generate estimates that mirror the postulated model, although the hypotheses (the presumed centroids of the Gaussian mixture) are not evident in the observations. Specifically, among other results, we prove a positive correlation between the estimates produced by the algorithms and the corresponding hypotheses. We also derive explicit closed-form expressions of the estimates for a finite and infinite number of hypotheses. This study underscores the risks of confirmation bias in low signal-to-noise environments, provides insights into potential pitfalls in scientific methodologies, and highlights the importance of prudent data interpretation.

Mathematical models of confirmation bias

Confirmation bias emerges from an approximation to Bayesian reasoning

Moderate confirmation bias enhances decision-making in groups of reinforcement-learning agents

Moderate confirmation bias enhances collective decision-making in reinforcement-learning agents

Modeling confirmation bias and peer pressure in opinion dynamics

Opinion dynamics model based on cognitive biases

Dynamics of Public Opinion Evolution with Asymmetric Cognitive Bias

Confirmation Bias in Gaussian Mixture Models

Cognitive biases can move opinion dynamics from consensus to signatures of transient chaos

Confirmation Bias: A Ubiquitous Phenomenon in Many Guises

Mean-field analysis for cognitively-grounded opinion dynamics with confirmation bias

A common factor underlying individual differences in confirmation bias

A newly detected bias in self-evaluation

Ideologically Motivated Biases in a Multiple Issues Opinion Model

Deliberation, mood response, and the confirmation bias in the religious belief domain.

Over-representation of Extreme Events in Decision-Making: A Rational Metacognitive Account

CM-DQN: A Value-Based Deep Reinforcement Learning Model to Simulate Confirmation Bias

Shifting Consensus in a Biased Compromise Model

Mice-side bias: Deliberative decision making in a model of rule revision reveals 'myside' confirmation bias-like cognitive processes in mice.

Theoretical Model of Stock Trading Behavior with Biases

9. Polarization and Radicalization in the Bounded Confidence Model: A Computer-Aided Speculation