Abstract:Background The recent emergence of high-throughput automated image acquisition technologies has forever changed how cell biologists collect and analyze data. Historically, the interpretation of cellular phenotypes in different experimental conditions has been dependent upon the expert opinions of well-trained biologists. Such qualitative analysis is particularly effective in detecting subtle, but important, deviations in phenotypes. However, while the rapid and continuing development of automated microscope-based technologies now facilitates the acquisition of trillions of cells in thousands of diverse experimental conditions, such as in the context of RNA interference (RNAi) or small-molecule screens, the massive size of these datasets precludes human analysis. Thus, the development of automated methods which aim to identify novel and biological relevant phenotypes online is one of the major challenges in high-throughput image-based screening. Ideally, phenotype discovery methods should be designed to utilize prior/existing information and tackle three challenging tasks, i.e. restoring pre-defined biological meaningful phenotypes, differentiating novel phenotypes from known ones and clarifying novel phenotypes from each other. Arbitrarily extracted information causes biased analysis, while combining the complete existing datasets with each new image is intractable in high-throughput screens. Results Here we present the design and implementation of a novel and robust online phenotype discovery method with broad applicability that can be used in diverse experimental contexts, especially high-throughput RNAi screens. This method features phenotype modelling and iterative cluster merging using improved gap statistics. A Gaussian Mixture Model (GMM) is employed to estimate the distribution of each existing phenotype, and then used as reference distribution in gap statistics. This method is broadly applicable to a number of different types of image-based datasets derived from a wide spectrum of experimental conditions and is suitable to adaptively process new images which are continuously added to existing datasets. Validations were carried out on different dataset, including published RNAi screening using Drosophila embryos [Additional files 1 , 2 ], dataset for cell cycle phase identification using HeLa cells [Additional files 1 , 3 , 4 ] and synthetic dataset using polygons, our methods tackled three aforementioned tasks effectively with an accuracy range of 85%–90%. When our method is implemented in the context of a Drosophila genome-scale RNAi image-based screening of cultured cells aimed to identifying the contribution of individual genes towards the regulation of cell-shape, it efficiently discovers meaningful new phenotypes and provides novel biological insight. We also propose a two-step procedure to modify the novelty detection method based on one-class SVM, so that it can be used to online phenotype discovery. In different conditions, we compared the SVM based method with our method using various datasets and our methods consistently outperformed SVM based method in at least two of three tasks by 2% to 5%. These results demonstrate that our methods can be used to better identify novel phenotypes in image-based datasets from a wide range of conditions and organisms. Conclusion We demonstrate that our method can detect various novel phenotypes effectively in complex datasets. Experiment results also validate that our method performs consistently under different order of image input, variation of starting conditions including the number and composition of existing phenotypes, and dataset from different screens. In our findings, the proposed method is suitable for online phenotype discovery in diverse high-throughput image-based genetic and chemical screens.

Issues of Z-factor and an approach to avoid them for quality control in high-throughput screening studies

A Simple Statistical Parameter for Use in Evaluation and Validation of High Throughput Screening Assays

Using Iterative Cluster Merging with Improved Gap Statistics to Perform Online Phenotype Discovery in the Context of High-Throughput RNAi Screens

A benchmark of computational methods for correcting biases of established and unknown origin in CRISPR-Cas9 screening data

miQC: An adaptive probabilistic framework for quality control of single-cell RNA-sequencing data

snpQT: flexible, reproducible, and comprehensive quality control and imputation of genomic data

Assessment of batch-correction methods for scRNA-seq data with a new test metric

Optimal design for high-throughput screening via false discovery rate control

iCRISEE: an integrative analysis of CRISPR screen by reducing false positive hits

Biostatistical Aspects of Whole Genome Sequencing Studies: Preprocessing and Quality Control

A statistical simulation model to guide the choices of analytical methods in arrayed CRISPR screen experiments

CaMutQC: An R Package for Integrative Quality Control of Cancer Somatic Mutations

Improved HTGTS for CRISPR/Cas9 Off-target Detection

RabbitQC: high-speed scalable quality control for sequencing data

A model for accurate quantification of CRISPR effects in pooled FACS screens

Impact of Interval Censoring on Data Accuracy and Machine Learning Performance in Biological High-Throughput Screening

A framework for quality control in quantitative proteomics

Quantify and control reproducibility in high-throughput experiments

Benchmark data and software for assessing genome-wide CRISPR-Cas9 screening pipelines

Benchmark Software and Data for Evaluating CRISPR-Cas9 Experimental Pipelines Through the Assessment of a Calibration Screen

Data Exploration, Quality Control and Testing in Single-Cell qPCR-Based Gene Expression Experiments