Abstract:Research transparency is crucial for ensuring the relevance, integrity, and reliability of scientific findings. However, previous work indicates room for improvement across transparency practices. The primary objective of this study was to develop an extensible tool to provide individualized feedback and guidance for improved transparency across phases of a study. Our secondary objective was to assess the feasibility of implementing this tool to improve transparency in clinical trials. We developed study-level “report cards” that combine tailored feedback and guidance to investigators across several transparency practices, including prospective registration, availability of summary results, and open access publication. The report cards were generated through an automated pipeline for scalability. We also developed an infosheet to summarize relevant laws, guidelines, and resources relating to transparency. To assess the feasibility of using these tools to improve transparency, we conducted a single-arm intervention study at Berlin’s university medical center, the Charité – Universitätsmedizin Berlin. Investigators (n = 92) of 155 clinical trials were sent individualized report cards and the infosheet, and surveyed to assess their perceived usefulness. We also evaluated included trials for improvements in transparency following the intervention. Survey responses indicated general appreciation for the report cards and infosheet, with a majority of participants finding them helpful to build awareness of the transparency of their trial and transparency requirements. However, improvement on transparency practices was minimal and largely limited to linking publications in registries. Investigators also commented on various challenges associated with implementing transparency, including a lack of clarity around best practices and institutional hurdles. This study demonstrates the potential of developing and using tools, such as report cards, to provide individualized feedback at scale to investigators on the transparency of their study. While these tools were positively received by investigators, the limited improvement in transparency practices suggests that awareness alone is likely not sufficient to drive improvement. Future research and implementation efforts may adapt the tools to further practices or research areas, and explore integrated approaches that combine the report cards with incentives and institutional support to effectively strengthen transparency in research.

Improving Transparency in Observational Social Science Research: A Pre-Analysis Plan Approach

Flexible yet fair: blinding analyses in experimental psychology

Transparency in epidemiological analyses of cohort data - A case study of the Norwegian Mother, Father, and Child cohort study (MoBa)

Estimating the Prevalence of Transparency and Reproducibility-Related Research Practices in Psychology (2014–2017)

The preregistration revolution

Preferred Reporting Items for Complex Sample Survey Analysis (PRICSSA)

Are We Becoming More Transparent? Survey Reporting Trends in Top Journals of Social Sciences

A tale of two perspectives: regulation versus self-regulation. A financial reporting approach (from Sarbanes-Oxley) for research ethics

Improving quality of preclinical academic research through auditing: A feasibility study

Prespecification of Structure for Optimizing Data Collection and Research Transparency by Leveraging Conditional Independencies

Transparency in the secondary use of health data: Assessing the status quo of guidance and best practices

Promoting an open research culture

Improving research transparency with individualized report cards: A feasibility study in clinical trials at a large university medical center

Exploring open science practices in behavioural public policy research

Open data through Registered Reports can accelerate cumulative knowledge

Rethinking Transparency and Rigor from a Qualitative Open Science Perspective

Using public clinical trial reports to evaluate observational study methods

Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project

Implications of the open science era for educational psychology research syntheses

Protocols for Observational Studies: Methods and Open Problems

Transparency and reproducibility in the journal of contextual behavioral science: An audit study