Abstract:Confirmation bias, the tendency to interpret information in a way that aligns with one's preconceptions, can profoundly impact scientific research, leading to conclusions that reflect the researcher's hypotheses even when the observational data do not support them. This issue is especially critical in scientific fields involving highly noisy observations, such as cryo-electron microscopy. This study investigates confirmation bias in Gaussian mixture models. We consider the following experiment: A team of scientists assumes they are analyzing data drawn from a Gaussian mixture model with known signals (hypotheses) as centroids. However, in reality, the observations consist entirely of noise without any informative structure. The researchers use a single iteration of the K-means or expectation-maximization algorithms, two popular algorithms to estimate the centroids. Despite the observations being pure noise, we show that these algorithms yield biased estimates that resemble the initial hypotheses, contradicting the unbiased expectation that averaging these noise observations would converge to zero. Namely, the algorithms generate estimates that mirror the postulated model, although the hypotheses (the presumed centroids of the Gaussian mixture) are not evident in the observations. Specifically, among other results, we prove a positive correlation between the estimates produced by the algorithms and the corresponding hypotheses. We also derive explicit closed-form expressions of the estimates for a finite and infinite number of hypotheses. This study underscores the risks of confirmation bias in low signal-to-noise environments, provides insights into potential pitfalls in scientific methodologies, and highlights the importance of prudent data interpretation.

Efficiency of the Method for Detecting Normal Mixture Signals with Pre-Estimated Gaussian Mixture Noise

Approximate MMSE Estimator for Linear Dynamic Systems With Gaussian Mixture Noise

Gating technique for the Gaussian mixture multi-Bernoulli filter

Analysis of Statistical Characteristics of Probability Density Distribution of the Signal Mixture and Additive-multiplicative non-Gaussian Noise

Exact Consistency Tests for Gaussian Mixture Filters using Normalized Deviation Squared Statistics

Parameter identification based on adaptive density estimation

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

A Bayesian Filtering Algorithm for Gaussian Mixture Models

Confirmation Bias in Gaussian Mixture Models

On the Error Exponent of Approximate Sufficient Statistics for M-ary Hypothesis Testing

Gaussian Mixture Models with Rare Events.

Comparison of information criteria for detection of useful signal in noisy environment

Gaussian Mixture Model with Rare Events

Estimation and confidence sets for sparse normal mixtures

Tracking Dynamic Gaussian Density with a Theoretically Optimal Sliding Window Approach

A Fourier Approach to the Parameter Estimation Problem for One-dimensional Gaussian Mixture Models

A Modified Energy Detector for Random Signals in Gaussian Noise.

Adaptive classification of digital amplitude-phase modulated signals with additive non-Gaussian noise

A Fast Hybrid Noise Filtering Algorithm Based on Median-Mean

Sequential joint signal detection and signal-to-noise ratio estimation

A Blind Signal Samples Detection Algorithm for Accurate Primary User Traffic Estimation