Abstract:Background The recent emergence of high-throughput automated image acquisition technologies has forever changed how cell biologists collect and analyze data. Historically, the interpretation of cellular phenotypes in different experimental conditions has been dependent upon the expert opinions of well-trained biologists. Such qualitative analysis is particularly effective in detecting subtle, but important, deviations in phenotypes. However, while the rapid and continuing development of automated microscope-based technologies now facilitates the acquisition of trillions of cells in thousands of diverse experimental conditions, such as in the context of RNA interference (RNAi) or small-molecule screens, the massive size of these datasets precludes human analysis. Thus, the development of automated methods which aim to identify novel and biological relevant phenotypes online is one of the major challenges in high-throughput image-based screening. Ideally, phenotype discovery methods should be designed to utilize prior/existing information and tackle three challenging tasks, i.e. restoring pre-defined biological meaningful phenotypes, differentiating novel phenotypes from known ones and clarifying novel phenotypes from each other. Arbitrarily extracted information causes biased analysis, while combining the complete existing datasets with each new image is intractable in high-throughput screens. Results Here we present the design and implementation of a novel and robust online phenotype discovery method with broad applicability that can be used in diverse experimental contexts, especially high-throughput RNAi screens. This method features phenotype modelling and iterative cluster merging using improved gap statistics. A Gaussian Mixture Model (GMM) is employed to estimate the distribution of each existing phenotype, and then used as reference distribution in gap statistics. This method is broadly applicable to a number of different types of image-based datasets derived from a wide spectrum of experimental conditions and is suitable to adaptively process new images which are continuously added to existing datasets. Validations were carried out on different dataset, including published RNAi screening using Drosophila embryos [Additional files 1 , 2 ], dataset for cell cycle phase identification using HeLa cells [Additional files 1 , 3 , 4 ] and synthetic dataset using polygons, our methods tackled three aforementioned tasks effectively with an accuracy range of 85%–90%. When our method is implemented in the context of a Drosophila genome-scale RNAi image-based screening of cultured cells aimed to identifying the contribution of individual genes towards the regulation of cell-shape, it efficiently discovers meaningful new phenotypes and provides novel biological insight. We also propose a two-step procedure to modify the novelty detection method based on one-class SVM, so that it can be used to online phenotype discovery. In different conditions, we compared the SVM based method with our method using various datasets and our methods consistently outperformed SVM based method in at least two of three tasks by 2% to 5%. These results demonstrate that our methods can be used to better identify novel phenotypes in image-based datasets from a wide range of conditions and organisms. Conclusion We demonstrate that our method can detect various novel phenotypes effectively in complex datasets. Experiment results also validate that our method performs consistently under different order of image input, variation of starting conditions including the number and composition of existing phenotypes, and dataset from different screens. In our findings, the proposed method is suitable for online phenotype discovery in diverse high-throughput image-based genetic and chemical screens.

A Bag-of-words Approach for Drosophila Gene Expression Pattern Annotation

Drosophila Gene Expression Pattern Annotation Using Sparse Features and Term-Term Interactions

Automated Annotation of Developmental Stages of Drosophila Embryos in Images Containing Spatial Patterns of Expression

Extraction and Comparison of Gene Expression Patterns from 2d Rna in Situ Hybridization Images

Drosophila Gene Expression Pattern Annotations Via Multi-Instance Biological Relevance Learning

Drosophila Gene Expression Pattern Annotation through Multi-Instance Multi-Label Learning

FlyIT: <italic>Drosophila</italic> Embryogenesis Image Annotation based on Image Tiling and Convolutional Neural Networks

AnnoFly: Annotating Drosophila Embryonic Images Based on an Attention-Enhanced RNN Model

Stochastic Coordinate Coding and Its Application for Drosophila Gene Expression Pattern Annotation

DrosophilaGene Expression Pattern Annotation through Multi-Instance Multi-Label Learning

Developmental Stage Annotation of Drosophila Gene Expression Pattern Images via an Entire Solution Path for LDA

Learning Sparse Representations for Fruit-Fly Gene Expression Pattern Image Annotation and Retrieval

Using Iterative Cluster Merging with Improved Gap Statistics to Perform Online Phenotype Discovery in the Context of High-Throughput RNAi Screens

Deep convolutional neural networks for annotating gene expression patterns in the mouse brain

Automatic analysis of segmentwise locomotion details of Drosophila larva

HMIML: Hierarchical Multi-Instance Multi-Label Learning of Drosophila Embryogenesis Images Using Convolutional Neural Networks.

svdPPCS: an effective singular value decomposition-based method for conserved and divergent co-expression gene module identification

Contour Extraction of Drosophila Embryos Based on Conditional Generative Adversarial Nets

High-resolution spatiotemporal transcriptomic maps of developing Drosophila embryos and larvae

Virtual in situs: Sequencing mRNA from cryo-sliced Drosophila embryos to determine genome-wide spatial patterns of gene expression

Spatio-temporal Reconstruction of Gene Expression Patterns in Developing Mice