Abstract:Background The recent emergence of high-throughput automated image acquisition technologies has forever changed how cell biologists collect and analyze data. Historically, the interpretation of cellular phenotypes in different experimental conditions has been dependent upon the expert opinions of well-trained biologists. Such qualitative analysis is particularly effective in detecting subtle, but important, deviations in phenotypes. However, while the rapid and continuing development of automated microscope-based technologies now facilitates the acquisition of trillions of cells in thousands of diverse experimental conditions, such as in the context of RNA interference (RNAi) or small-molecule screens, the massive size of these datasets precludes human analysis. Thus, the development of automated methods which aim to identify novel and biological relevant phenotypes online is one of the major challenges in high-throughput image-based screening. Ideally, phenotype discovery methods should be designed to utilize prior/existing information and tackle three challenging tasks, i.e. restoring pre-defined biological meaningful phenotypes, differentiating novel phenotypes from known ones and clarifying novel phenotypes from each other. Arbitrarily extracted information causes biased analysis, while combining the complete existing datasets with each new image is intractable in high-throughput screens. Results Here we present the design and implementation of a novel and robust online phenotype discovery method with broad applicability that can be used in diverse experimental contexts, especially high-throughput RNAi screens. This method features phenotype modelling and iterative cluster merging using improved gap statistics. A Gaussian Mixture Model (GMM) is employed to estimate the distribution of each existing phenotype, and then used as reference distribution in gap statistics. This method is broadly applicable to a number of different types of image-based datasets derived from a wide spectrum of experimental conditions and is suitable to adaptively process new images which are continuously added to existing datasets. Validations were carried out on different dataset, including published RNAi screening using Drosophila embryos [Additional files 1 , 2 ], dataset for cell cycle phase identification using HeLa cells [Additional files 1 , 3 , 4 ] and synthetic dataset using polygons, our methods tackled three aforementioned tasks effectively with an accuracy range of 85%–90%. When our method is implemented in the context of a Drosophila genome-scale RNAi image-based screening of cultured cells aimed to identifying the contribution of individual genes towards the regulation of cell-shape, it efficiently discovers meaningful new phenotypes and provides novel biological insight. We also propose a two-step procedure to modify the novelty detection method based on one-class SVM, so that it can be used to online phenotype discovery. In different conditions, we compared the SVM based method with our method using various datasets and our methods consistently outperformed SVM based method in at least two of three tasks by 2% to 5%. These results demonstrate that our methods can be used to better identify novel phenotypes in image-based datasets from a wide range of conditions and organisms. Conclusion We demonstrate that our method can detect various novel phenotypes effectively in complex datasets. Experiment results also validate that our method performs consistently under different order of image input, variation of starting conditions including the number and composition of existing phenotypes, and dataset from different screens. In our findings, the proposed method is suitable for online phenotype discovery in diverse high-throughput image-based genetic and chemical screens.

A Highly-Efficient, Scalable Pipeline for Fixed Feature Extraction from Large-Scale High-Content Imaging Screens

Using Iterative Cluster Merging with Improved Gap Statistics to Perform Online Phenotype Discovery in the Context of High-Throughput RNAi Screens

An Automatic Method for Robust and Fast Cell Detection in Bright Field Images from High-Throughput Microscopy.

An Explainable Classification Method Based on Complex Scaling in Histopathology Images for Lung and Colon Cancer

fastER: a user-friendly tool for ultrafast and robust cell segmentation in large-scale microscopy.

Abstract 5361: Deep learning models capture high dimensional features for cell morphology analysis

A statistical framework for high-content phenotypic profiling using cellular feature distributions

Deep learning pipeline for automated cell profiling from cyclic imaging

A Novel Quantum Swarm Evolutionary Algorithm for Solving 0-1 Knapsack Problem

Domain-invariant features for mechanism of action prediction in a multi-cell-line drug screen

Automated spheroid generation, drug application and efficacy screening using a deep learning classification: a feasibility study

Abstract 3523: Self-supervised foundation model captures high-dimensional morphology data from single cell brightfield images

Achieving high-resolution single-cell segmentation in convoluted cancer spheroids via Bayesian optimization and deep-learning

Abstract 5381: A broad-use deep learning model based on multi-dimensional morphology to identify and characterize tumor cell heterogeneity

Generalising from Conventional Pipelines: A Case Study in Deep Learning-Based for High-Throughput Screening

Surrogate-assisted Feature Extraction for High-Throughput Phenotyping.

SCIP: A scalable, reproducible and open-source pipeline for morphological profiling of image cytometry and microscopy data

Online Single-Cell Data Integration Through Projecting Heterogeneous Datasets into a Common Cell-Embedding Space

Feature extraction for proteomics imaging mass spectrometry data

RRScell method for automated single-cell profiling of multiplexed immunofluorescence cancer tissue

Fast and Scalable Image Search For Histology