Abstract:A decade ago, replications were typically not conducted and appreciated in social psychology, although replications play a central role in ensuring trust in scientific fields. Without systematic replication efforts, it is not clear whether findings are trustworthy. As journals can function as gatekeepers for publications, they can influence whether researchers conduct (and publish) replications. Yet, the scholarly culture in social psychology might have changed over the last decade because numerous highly visible studies did not replicate past findings. In light of these insights and the resulting learning opportunities for the field, we predicted an increase in the expressed support for replications in the policies of social psychology journals from 2015 (i.e., the year the replication problem became widely known) to 2022. We coded whether and how replications were mentioned in the author guidelines on the websites of social psychology journals (N = 51). As expected, replications were welcomed more often in 2022 (25%) than they were in 2015 (12%), but they were not mentioned on the websites of most journals (71% in 2022 vs. 82% in 2015). An exploratory analysis suggested that journals that expressed support for replications on their websites were also more likely to publish articles about replication. Further, exploratory analyses of the journals’ TOP factors indicated similar rates of support for replications as for other rigor and transparency promoting policies. In sum, our findings suggest that appreciation for replication has increased, but is not yet part of mainstream culture in social psychology.

Replications are informative, particularly when they fail

Replicating is difficult but necessary, and methodology can help

Replication, falsification, and the crisis of confidence in social psychology

Kinds of Replication: Examining the Meanings of “Conceptual Replication” and “Direct Replication”

Critical realism, psychology, and the crisis of replication: A reply to Haig; Derksen & Morawski; and Trafimow

A discipline-wide investigation of the replicability of Psychology papers over the past two decades

Replication is important for educational psychology: Recent developments and key issues

A Validity-Based Framework for Understanding Replication in Psychology

A glass half full interpretation of the replicability of psychological science

Replication in music psychology

Are Psychology Journals Anti-replication? A Snapshot of Editorial Practices

Are replications mainstream now? A comparison of support for replications expressed in the policies of social psychology journals in 2015 and 2022

Why Most Research Findings About Psi Are False: The Replicability Crisis, the Psi Paradox and the Myth of Sisyphus

Replication and Reproducibility in Cross-Cultural Psychology

Large Scale Replication Projects in Contemporary Psychological Research

Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015

Estimating the reproducibility of psychological science

Epistemic Functions of Replicability in Experimental Sciences: Defending the Orthodox View

Replication Markets: Results, Lessons, Challenges and Opportunities in AI Replication

Play It Again, Sam! An Analysis of Constructive Replication in the Organizational Sciences

Psychology’s reproducibility problem is exaggerated – say psychologists