The replication crisis and its relevance to Earth Science studies: Case studies and recommendations
Stephen J. Puetz,Kent C. Condie,Kurt Sundell,Nick M.W. Roberts,Christopher J. Spencer,Slah Boulila,Qiuming Cheng
DOI: https://doi.org/10.1016/j.gsf.2024.101821
IF: 8.9
2024-03-10
Geoscience Frontiers
Abstract:Highlights • Testing for replicability requires independent data. • A replicable global time-series requires a high globality index. • Proxy data is an alternative when direct data is unavailable. • Geological samples are seldom selected randomly, which requires adjustments. • Filtering a database for the highest quality records could enhance replicability. Numerous scientific fields are facing a replication crisis, where the results of a study often cannot be replicated when a new study uses independent data. This issue has been particularly emphasized in psychology, health, and medicine, as incorrect results in these fields could have serious consequences, where lives might be at stake. While other fields have also highlighted significant replication problems, the Earth Sciences seem to be an exception. The paucity of Earth Science research aimed at understanding the replication crisis prompted this study. Specifically, this work aims to fill that gap by seeking to replicate geological results involving various types of time-series. We identify and discuss 11 key variables for replicating U-Pb age distributions: independent data, global sampling, proxy data, data quality, disproportionate non-random sampling, stratigraphic bias, potential filtering bias, accuracy and precision, correlating time-series segments, testing assumptions and divergent analytical methods, and analytical transparency. Even while this work primarily focuses on U-Pb age distributions, most of these factors (or variations of them) also apply to other geoscience disciplines. Thus, some of the discussions involve time-series consisting of ε Hf, δ 18 O-zircon, 14 C, 10 Be, marine δ 13 C, and marine δ 18 O. We then provide specific recommendations for minimizing adverse effects related to these factors, and in the process enhancing prospects for replicating geological results. Graphical abstract Download : Download high-res image (378KB) Download : Download full-size image
geosciences, multidisciplinary