Abstract:Background The recent emergence of high-throughput automated image acquisition technologies has forever changed how cell biologists collect and analyze data. Historically, the interpretation of cellular phenotypes in different experimental conditions has been dependent upon the expert opinions of well-trained biologists. Such qualitative analysis is particularly effective in detecting subtle, but important, deviations in phenotypes. However, while the rapid and continuing development of automated microscope-based technologies now facilitates the acquisition of trillions of cells in thousands of diverse experimental conditions, such as in the context of RNA interference (RNAi) or small-molecule screens, the massive size of these datasets precludes human analysis. Thus, the development of automated methods which aim to identify novel and biological relevant phenotypes online is one of the major challenges in high-throughput image-based screening. Ideally, phenotype discovery methods should be designed to utilize prior/existing information and tackle three challenging tasks, i.e. restoring pre-defined biological meaningful phenotypes, differentiating novel phenotypes from known ones and clarifying novel phenotypes from each other. Arbitrarily extracted information causes biased analysis, while combining the complete existing datasets with each new image is intractable in high-throughput screens. Results Here we present the design and implementation of a novel and robust online phenotype discovery method with broad applicability that can be used in diverse experimental contexts, especially high-throughput RNAi screens. This method features phenotype modelling and iterative cluster merging using improved gap statistics. A Gaussian Mixture Model (GMM) is employed to estimate the distribution of each existing phenotype, and then used as reference distribution in gap statistics. This method is broadly applicable to a number of different types of image-based datasets derived from a wide spectrum of experimental conditions and is suitable to adaptively process new images which are continuously added to existing datasets. Validations were carried out on different dataset, including published RNAi screening using Drosophila embryos [Additional files 1 , 2 ], dataset for cell cycle phase identification using HeLa cells [Additional files 1 , 3 , 4 ] and synthetic dataset using polygons, our methods tackled three aforementioned tasks effectively with an accuracy range of 85%–90%. When our method is implemented in the context of a Drosophila genome-scale RNAi image-based screening of cultured cells aimed to identifying the contribution of individual genes towards the regulation of cell-shape, it efficiently discovers meaningful new phenotypes and provides novel biological insight. We also propose a two-step procedure to modify the novelty detection method based on one-class SVM, so that it can be used to online phenotype discovery. In different conditions, we compared the SVM based method with our method using various datasets and our methods consistently outperformed SVM based method in at least two of three tasks by 2% to 5%. These results demonstrate that our methods can be used to better identify novel phenotypes in image-based datasets from a wide range of conditions and organisms. Conclusion We demonstrate that our method can detect various novel phenotypes effectively in complex datasets. Experiment results also validate that our method performs consistently under different order of image input, variation of starting conditions including the number and composition of existing phenotypes, and dataset from different screens. In our findings, the proposed method is suitable for online phenotype discovery in diverse high-throughput image-based genetic and chemical screens.

Drosophila Gene Expression Pattern Annotations Via Multi-Instance Biological Relevance Learning

DrosophilaGene Expression Pattern Annotation through Multi-Instance Multi-Label Learning

Drosophila Gene Expression Pattern Annotation through Multi-Instance Multi-Label Learning

A Bag-of-words Approach for Drosophila Gene Expression Pattern Annotation

Extraction and Comparison of Gene Expression Patterns from 2d Rna in Situ Hybridization Images

Drosophila Gene Expression Pattern Annotation Using Sparse Features and Term-Term Interactions

Developmental Stage Annotation of Drosophila Gene Expression Pattern Images via an Entire Solution Path for LDA

HMIML: Hierarchical Multi-Instance Multi-Label Learning of Drosophila Embryogenesis Images Using Convolutional Neural Networks.

FlyIT: <italic>Drosophila</italic> Embryogenesis Image Annotation based on Image Tiling and Convolutional Neural Networks

Automated Annotation of Developmental Stages of Drosophila Embryos in Images Containing Spatial Patterns of Expression

AnnoFly: Annotating Drosophila Embryonic Images Based on an Attention-Enhanced RNN Model

Stochastic Coordinate Coding and Its Application for Drosophila Gene Expression Pattern Annotation

HE2Gene: Image-to-RNA Translation Via Multi-Task Learning for Spatial Transcriptomics Data

Using Iterative Cluster Merging with Improved Gap Statistics to Perform Online Phenotype Discovery in the Context of High-Throughput RNAi Screens

Machine Learning Approaches Identify Genes Containing Spatial Information From Single-Cell Transcriptomics Data

A multi-modality and multi-granularity collaborative learning framework for identifying spatial domains and spatially variable genes

Gene Function Prediction Based on Combining Gene Ontology Hierarchy with Multi-Instance Multi-Label Learning

Learning Sparse Representations for Fruit-Fly Gene Expression Pattern Image Annotation and Retrieval

Predicting gene regulatory interactions based on spatial gene expression data and deep learning

Using Machine Learning to Measure Relatedness Between Genes: A Multi-Features Model.

svdPPCS: an effective singular value decomposition-based method for conserved and divergent co-expression gene module identification