Closing the reproducibility gap: 2D materials research

Peter Bøggild,Timothy John Booth,Nolan Lassaline,Bjarke Sørensen Jessen,Abhay Shivayogimath,Stephan Hofmann,Kim Daasbjerg,Anders Smith,Kasper Nørgaard,Amaia Zurutuza,Inge Asselberghs,Terrance Barkan,Rafael Taboryski,Andrew J. Pollard

2024-09-18

Abstract:2D materials research has reached significant scientific milestones, accompanied by a rapidly growing industrial sector in the two decades since the field's inception. Such rapid progress requires pushing past the boundary of what is technically and scientifically feasible and carries the risk of disseminating irreproducible research results. This Expert Recommendation addresses the need for enhanced reproducibility in 2D materials science and physics. Through a comprehensive examination of the factors that affect reproducibility the authors present a set of concrete guidelines designed to improve the reliability of research results. The introduction of a Standardised Template for Experimental Procedures (STEP) offers a novel approach to documenting experimental details that are crucial for replication and troubleshooting. We emphasise the importance of involving stakeholders from research, industry, publishing, funding agencies, and policymaking to foster a culture of transparency, reliability, and trust without blind angles and critical oversights. By addressing systemic issues that hinder reproducibility and presenting actionable steps for improvement, we aim to pave the way for more robust research practices in 2D materials science, contributing to the field's scientific maturation and the subsequent development of beneficial technologies.

Physics and Society,Materials Science,Applied Physics,Data Analysis, Statistics and Probability

What problem does this paper attempt to address?

The paper attempts to address the reproducibility gap in the research of two-dimensional (2D) materials. Specifically, the authors believe that over the past 20 years, despite significant scientific achievements and industrial applications in the rapidly developing field of 2D materials, there is a serious issue: many research findings are difficult for other researchers to replicate or verify. This lack of reproducibility not only affects the quality and reliability of scientific research but also hinders the realization of technological transformation and societal impact.

The paper points out that the reproducibility issue is multifaceted, including the lack of transparency in experimental methods, insufficient data recording and sharing, and improper control of environmental factors. These problems lead to the unreliability of research results and instability in technological development. To address these challenges, the authors propose a series of specific recommendations and measures aimed at improving the reproducibility and reliability of 2D materials research, thereby promoting the healthy development and technological innovation in this field.

These measures include:
1. **Standardized Experimental Procedure Template (STEP)**: Providing a detailed framework for recording experimental parameters, equipment, and other important details to ensure the transparency and reproducibility of the experimental process.
2. **Enhanced Peer Review**: Encouraging reviewers to evaluate the reproducibility of the research and requiring authors to provide complete experimental data and detailed method descriptions.
3. **Improved Reporting Standards**: Requiring researchers to report all results, including negative results, and provide detailed experimental conditions when publishing papers.
4. **Strengthened Follow-up Research and Support**: Encouraging researchers to engage in replication studies, share data and methods to verify published research findings.

Through these measures, the paper hopes to establish a more transparent, reliable, and trustworthy culture in the field of 2D materials research, thereby driving further development in scientific research and technological applications.