Abstract:Modern high-throughput structural biology laboratories produce vast amounts of raw experimental data. The traditional method of data reduction is very simple-results are summarized in peer-reviewed publications, which are hopefully published in high-impact journals. By their nature, publications include only the most important results derived from experiments that may have been performed over the course of many years. The main content of the published paper is a concise compilation of these data, an interpretation of the experimental results, and a comparison of these results with those obtained by other scientists.Due to an avalanche of structural biology manuscripts submitted to scientific journals, in many recent cases descriptions of experimental methodology (and sometimes even experimental results) are pushed to supplementary materials that are only published online and sometimes may not be reviewed as thoroughly as the main body of a manuscript. Trouble may arise when experimental results are contradicting the results obtained by other scientists, which requires (in the best case) the reexamination of the original raw data or independent repetition of the experiment according to the published description of the experiment. There are reports that a significant fraction of experiments obtained in academic laboratories cannot be repeated in an industrial environment (Begley CG & Ellis LM, Nature 483(7391):531-3, 2012). This is not an indication of scientific fraud but rather reflects the inadequate description of experiments performed on different equipment and on biological samples that were produced with disparate methods. For that reason the goal of a modern data management system is not only the simple replacement of the laboratory notebook by an electronic one but also the creation of a sophisticated, internally consistent, scalable data management system that will combine data obtained by a variety of experiments performed by various individuals on diverse equipment. All data should be stored in a core database that can be used by custom applications to prepare internal reports, statistics, and perform other functions that are specific to the research that is pursued in a particular laboratory.This chapter presents a general overview of the methods of data management and analysis used by structural genomics (SG) programs. In addition to a review of the existing literature on the subject, also presented is experience in the development of two SG data management systems, UniTrack and LabDB. The description is targeted to a general audience, as some technical details have been (or will be) published elsewhere. The focus is on "data management," meaning the process of gathering, organizing, and storing data, but also briefly discussed is "data mining," the process of analysis ideally leading to an understanding of the data. In other words, data mining is the conversion of data into information. Clearly, effective data management is a precondition for any useful data mining. If done properly, gathering details on millions of experiments on thousands of proteins and making them publicly available for analysis-even after the projects themselves have ended-may turn out to be one of the most important benefits of SG programs.

ReUseData: an R/Bioconductor tool for reusable and reproducible genomic data management

A Practical Guide for DNase-seq Data Analysis: from Data Management to Common Applications

Reseqtools: an Integrated Toolkit for Large-Scale Next-Generation Sequencing Based Resequencing Analysis

Facilitating Bioinformatics Reproducibility

Genomics and Biological Big Data: Facing Current and Future Challenges around Data and Software Sharing and Reproducibility

OneStopRNAseq: A Web Application for Comprehensive and Efficient Analyses of RNA-Seq Data

BRGenomics for analyzing high-resolution genomics data in R

iSeq: An integrated tool to fetch public sequencing data

Data management to support reproducible research

Data management in the modern structural biology and biomedical research environment

Scalable Genomics with R and Bioconductor

RNA-SeQC: RNA-seq metrics for quality control and process optimization

Bio-medical Big Data Operating System (Bio-OS): An Integrated Data Mining Environment for Data Intensive Scientific Research

Reusing Data Technical and Ethical Challenges

Gencube: Efficient retrieval, download, and unification of genomic data from leading biodiversity databases

Harmonizing and integrating the NCI Genomic Data Commons through accessible, interactive, and cloud-enabled workflows

snpQT: flexible, reproducible, and comprehensive quality control and imputation of genomic data

A Suite of Tools for Biologists That Improve Accessibility and Visualization of Large Systems Genetics Datasets: Applications to the Hybrid Mouse Diversity Panel

Reproducible bioinformatics project: a community for reproducible bioinformatics analysis pipelines

Efficient storage and regression computation for population-scale genome sequencing studies

Poster: Diagnosing and Treating Code-Duplication Problems in Bioinformatics Libraries.