Abstract:Background: Procedural and reporting guidelines are crucial in framing scientific practices and communications among researchers and the broader community. These guidelines aim to ensure transparency, reproducibility, and reliability in scientific research. Despite several methodological frameworks proposed by various initiatives to foster reproducibility, challenges such as data leakage and reproducibility remain prevalent. Recent studies have highlighted the transformative potential of incorporating the FAIR (Findable, Accessible, Interoperable, and Reusable) principles into workflows, particularly in contexts like software and machine learning model development, to promote open science. Objective: This study aims to introduce a comprehensive framework, designed to calibrate existing reporting guidelines against the FAIR principles. The goal is to enhance reproducibility and promote open science by integrating these principles into the scientific reporting process. Methods: We employed the "Best fit" framework synthesis approach which involves systematically reviewing and synthesizing existing frameworks and guidelines to identify best practices and gaps. We then proposed a series of defined workflows to align reporting guidelines with FAIR principles. A use case was developed to demonstrate the practical application of the framework. Results: The integration of FAIR principles with established reporting guidelines through the framework effectively bridges the gap between FAIR metrics and traditional reporting standards. The framework provides a structured approach to enhance the findability, accessibility, interoperability, and reusability of scientific data and outputs. The use case demonstrated the practical benefits of the framework, showing improved data management and reporting practices. Discussion: The framework addresses critical challenges in scientific research, such as data leakage and reproducibility issues. By embedding FAIR principles into reporting guidelines, the framework ensures that scientific outputs are more transparent, reliable, and reusable. This integration not only benefits researchers by improving data management practices but also enhances the overall scientific process by promoting open science and collaboration. Conclusion: The proposed framework successfully combines FAIR principles with reporting guidelines, offering a robust solution to enhance reproducibility and open science. This framework can be applied across various contexts, including software and machine learning model development stages, to foster a more transparent and collaborative scientific environment.

Universal Workflow Language and Software Enables Geometric Learning and FAIR Scientific Protocol Reporting

Universal Workflow Language and Software Enables Geometric Learning and FAIR Scientific Protocol Reporting

Methods Included: Standardizing Computational Reuse and Portability with the Common Workflow Language

MaRDIFlow: A CSE workflow framework for abstracting meta-data from FAIR computational experiments

Perspectives on automated composition of workflows in the life sciences

Implementation of FAIR Practices in Computational Metabolomics Workflows - A Case Study

Applying the FAIR Principles to Computational Workflows

Validation of the Scientific Literature via Chemputation Augmented by Large Language Models

Implementation of FAIR Practices in Computational Metabolomics Workflows—A Case Study

A workflow management system for reproducible and interoperable high-throughput self-driving experiments

Seamless Science: Lifting Experimental Mechanical Testing Lab Data to an Interoperable Semantic Representation

Visual Life Sciences Workflow Design Using Distributed and Heterogeneous Resources

Introducing SWIRL: An Intermediate Representation Language for Scientific Workflows

CALIFRAME: a proposed method of calibrating reporting guidelines with FAIR principles to foster reproducibility of AI research in medicine

Fluent Integration of Laboratory Data into Biocatalytic Process Simulation Using EnzymeML, DWSIM, and Ontologies

The future of scientific workflows

A new AI-assisted data standard accelerates interoperability in biomedical research

LLM4Workflow: An LLM-based Automated Workflow Model Generation Tool

ProtocoLLM: Automatic Evaluation Framework of LLMs on Domain-Specific Scientific Protocol Formulation Tasks

ULSA: Unified Language of Synthesis Actions for Representation of Synthesis Protocols

Designing workflows for materials characterization