Abstract:Many suggestions for dealing with the so-called replication crisis in psychology revolve around the idea that better and more complex statistical-mathematical tools or stricter procedures are required in order to obtain reliable findings and prevent cheating or publication biases. While these aspects may play an exacerbating role, we interpret the replication crisis primarily as an epistemological crisis in psychology caused by an inadequate fit between the ontic nature of the psyche and the quantitative approach. On the basis of the philosophers of science Karl Popper, Thomas Kuhn, and Imre Lakatos we suggest that the replication crisis is therefore a symptom of a fundamental problem in psychology, but at the same time it is also an opportunity to advance psychology as a science. In a first step, against the background of Popper's Critical Rationalism, the replication crisis is interpreted as an opportunity to eliminate inaccurate theories from the pool of theories and to correct problematic developments. Continuing this line of thought, in an interpretation along the lines of Thomas Kuhn, the replication crisis might signify a model drift or even model crisis, thus possibly heralding a new paradigm in psychology. The reasons for this are located in the structure of academic psychology on the basis of Lakatos's assumption about how sciences operate. Accordingly, one hard core that lies at the very basis of psychology may be found in the assumption that the human psyche can and is to be understood in quantitative terms. For this to be possible, the ontic structure of the psyche, i.e., its very nature, must also in some way be quantitatively constituted. Hence, the replication crisis suggests that the ontic structure of the psyche in some way (also) contains a non-quantitative dimension that can only be grasped incompletely or fragmentarily using quantitative research methods. Fluctuating and inconsistent results in psychology could therefore also be the expression of a mismatch between the ontic level of the object of investigation and the epistemic level of the investigation.

Statistical reform and the replication crisis

Statistical Assessment of Replicability via Bayesian Model Criticism

Replication, falsification, and the crisis of confidence in social psychology

Statistics in Service of Metascience: Measuring Replication Distance with Reproducibility Rate

The quantitative paradigm and the nature of the human mind. The replication crisis as an epistemological crisis of quantitative psychology in view of the ontic nature of the psyche

Comparing basic statistical concepts with diagnostic probabilities based on directly observed proportions to help understand the replication crisis

Possibility-theoretic statistical inference offers performance and probativeness assurances

Assessing replication success via skeptical mixture priors

Statistical witchhunts: Science, justice & the p-value crisis

When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment

The state of play of reproducibility in Statistics: an empirical analysis

Replication and Reproducibility in Cross-Cultural Psychology

On the uses and abuses of regression models: a call for reform of statistical practice and teaching

Addressing the “Replication Crisis”: Using Original Studies to Design Replication Studies with Appropriate Statistical Power

A new standard for the analysis and design of replication studies

Statistical Methods for Replicability Assessment

Double trouble? The communication dimension of the reproducibility crisis in experimental psychology and neuroscience

The Replication Crisis in Psychological Research:The Solution of It

Estimating the reproducibility of psychological science

Invited Commentary: The Need for Cognitive Science in Methodology

Statistics in the Service of Science: Don’t Let the Tail Wag the Dog