Abstract:Introduction Flow cytometry is widely used in clinical and research laboratories for diagnostics, biomarker discovery, and immune system monitoring. Flow cytometry data processing still uses gating- and clustering-based approaches that are highly time-consuming and subjective. Data processing time increases with panel size and number of detected populations, posing challenges to the search for new biomarkers. Low reproducibility and method limitations have thus far hindered efforts to automate and standardize flow cytometry data processing; hence, these efforts have not yielded any significant advancements in data processing methods. Here we present a new ML-based algorithm for automated cell-type labeling. Our supervised ML approach allows us to classify every event in a flow cytometry data file solely based on the presence and absence of markers, without the need for prior knowledge or assumption about cell population content in the sample. This approach enables the detection of rare and/or new cell populations with a high average quality metric (f1-score). The rapid and high-quality analysis our algorithm can perform renders it applicable in clinical settings, particularly for detecting hematological abnormalities and cancers. Methods We processed 500 blood samples from a cohort of healthy donors and patients with various cancer diagnoses using 10 different 18-channel multicolor flow cytometry panels. We then used data from either the entire or a portion of these 500 samples in a 3:1 split for training:test datasets to train and test our algorithm on each cytometry panel. To do this, we manually matched cells with certain cellular phenotypes to create 10 high-quality training sets for supervised learning and 10 test datasets, one pair for each of the 10 panels. To train the cell type classifier, we set up a two-level boosting-based model. The first-level model filters out outliers, including dead cells, cellular debris, beads, and other undefined particles, in order to hone in on the target population. The second-level model for predicting cell types within a target population is defined by two approaches. The population-based approach detects major subpopulation types in a target population and predicts the precise population labels. This approach is useful for labeling a small number of previously known or predicted subpopulations. The marker-based approach is useful for target populations with large numbers of subpopulations, such as T cells harboring different combinations of cell-surface receptors. It predicts the presence or absence of specific markers on each cell to assign its phenotype. It also allows us to construct complex hierarchies in order to detect new populations that are challenging to identify manually. Figure 1 outlines our workflow. Results We validated our final set of 10 trained models on our test dataset. The summarized number of detected cell populations in the test dataset was 221, which corresponds to the number of unique cell types predicted by our models. Table 1 shows the evaluation metrics for our algorithm for populations with > 0.1% whole blood cells (WBCs).The average quality metric (f1-score) for all antibody panels used is 0.86. This value is the mean of all f1-scores calculated for all cell populations identified by our algorithm. Mean f1-score is the highest (0.96) for large populations, lower (0.87) for mid-sized populations, and lowest but acceptable (0.77) for small populations. Mean quality score for the marker-based models is also high (0.96). Compared to manual evaluation that took approximately 1 hour to analyze one data file, the algorithm completed analysis within 10 seconds. Conclusion Our new algorithm automates cell labeling and produces high-quality outputs that are comparable to manual processing, but with a much shorter turnaround time (TAT) and without the need for prior knowledge or expert competence from the user. Importantly, it allows us to effectively and accurately filter out outliers, identify the target population, and divide this target population into multiple cell subtypes including new and rare cell subpopulations, all without a priori assumptions about cell population content in the sample. Given its ability to perform high-quality cell population analysis and its short TAT, our algorithm provides rapid, unbiased, and precise cell typing that will have utility for the diagnosis of heme malignancies and immunoprofiling.

A beginner's guide to supervised analysis for mass cytometry data in cancer biology

Machine learning facilitates the application of mass spectrometry-based metabolomics to clinical analysis: A review of early diagnosis of high mortality rate cancers

A comparison framework and guideline of clustering methods for mass cytometry data

Automated cell type annotation and exploration of single cell signalling dynamics using mass cytometry

Deep learning for computational cytology: A survey

Getting Started with Machine Learning for Experimental Biochemists and Other Molecular Scientists

Machine Learning (ML)-Enabled Automation for High-Throughput Data Processing in Flow Cytometry

Information-Distilled Generative Label-Free Morphological Profiling Encodes Cellular Heterogeneity

Discriminating Leukemia Cellular Heterogeneity and Screening Metabolite Biomarker Candidates using Label-Free Mass Cytometry

Survey and comparative analysis of machine learning algorithms for breast cancer diagnosis: A comprehensive review

Machine Learning in CLL

Machine Learning Against Cancer: Accurate Diagnosis of Cancer by Machine Learning Classification of the Whole Genome Sequencing Data

Machine learning applications in cancer prognosis and prediction

Application of machine learning for high-throughput tumor marker screening

Machine learning for single cell genomics data analysis

Expanding the use of clustering and dimensionality reduction in high parameter flow cytometry data through machine learning for novel samples.

From patterns to patients: Advances in clinical machine learning for cancer diagnosis, prognosis, and treatment

Machine Learning for Flow Cytometry Data Analysis

Applications of Machine Learning (ML) and Mathematical Modeling (MM) in Healthcare with Special Focus on Cancer Prognosis and Anticancer Therapy: Current Status and Challenges

Clinical Validation of a Real-Time Machine Learning-based System for the Detection of Acute Myeloid Leukemia by Flow Cytometry

Machine learning strategies to tackle data challenges in mass spectrometry-based proteomics