Abstract:A decade ago, replications were typically not conducted and appreciated in social psychology, although replications play a central role in ensuring trust in scientific fields. Without systematic replication efforts, it is not clear whether findings are trustworthy. As journals can function as gatekeepers for publications, they can influence whether researchers conduct (and publish) replications. Yet, the scholarly culture in social psychology might have changed over the last decade because numerous highly visible studies did not replicate past findings. In light of these insights and the resulting learning opportunities for the field, we predicted an increase in the expressed support for replications in the policies of social psychology journals from 2015 (i.e., the year the replication problem became widely known) to 2022. We coded whether and how replications were mentioned in the author guidelines on the websites of social psychology journals (N = 51). As expected, replications were welcomed more often in 2022 (25%) than they were in 2015 (12%), but they were not mentioned on the websites of most journals (71% in 2022 vs. 82% in 2015). An exploratory analysis suggested that journals that expressed support for replications on their websites were also more likely to publish articles about replication. Further, exploratory analyses of the journals’ TOP factors indicated similar rates of support for replications as for other rigor and transparency promoting policies. In sum, our findings suggest that appreciation for replication has increased, but is not yet part of mainstream culture in social psychology.

A glass half full interpretation of the replicability of psychological science

A discipline-wide investigation of the replicability of Psychology papers over the past two decades

Estimating the reproducibility of psychological science

Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

Comment on “Estimating the reproducibility of psychological science”

Replications are informative, particularly when they fail

The reproducibility of statistical results in psychological research: An investigation using unpublished raw data.

Large Scale Replication Projects in Contemporary Psychological Research

Statistical Methods for Replicability Assessment

A large-scale in silico replication of ecological and evolutionary studies

Replication in music psychology

Replication, falsification, and the crisis of confidence in social psychology

Predicting replicability -- analysis of survey and prediction market data from large-scale forecasting projects

Are replications mainstream now? A comparison of support for replications expressed in the policies of social psychology journals in 2015 and 2022

Replication is important for educational psychology: Recent developments and key issues

Interdisciplinary lessons and recommendations for the evaluation of replicability in behavioral sciences

Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus

Replication and Reproducibility in Cross-Cultural Psychology

Epistemic Functions of Replicability in Experimental Sciences: Defending the Orthodox View

You Can't Publish Replication Studies (and How to Anyways)

The Language of (Non)Replicable Social Science