Abstract:Introduction: Flow cytometry is an integral part of routine diagnostics for hematological malignancies. Unfortunately, a decreasing number of skilled operators have to cope with increasing case volumes. The current methods are also known to produce inter- and intra-observer variability. Aim: To reduce labor time, dependency on expert knowledge and interpretation variability, we aimed to build and validate clinical-grade decision support software in the routine using machine learning (ML) for clinical cytometry. Methods: We obtained ≈100k flow cytometry cases from multiple centers, taken from clinical routine and annotated by expert users using multiple diagnostic methods. These cases span the full spectrum of hematological malignancy, including 47% non-malignant reference samples. As the data were not measured using harmonized protocols, we developed data pooling techniques to merge the data, including synthetic imputation of missing markers. After data processing, we applied multi-layer artificial neural networks to predict sub-type or non-malignancy (B-NHL and acute leukemias, ten classes at time of writing), directly from the data without any human preprocessing. Transfer learning was then used to fine-tune the model to a particular protocol for which the model could be used in routine. Besides sub-typing recommendations, users need to report cell population frequencies, traditionally measured using manual ‘gating’. We trained separate supervised ML models to classify single cells based on a combination of curated and refined routine gating data, expanded with in-house annotations produced by a highly trained cytometrist. To enable clinicians to receive the diagnostic recommendations and produce reports for the treating doctor, we built a CE-IVD web-application (“hema.to”) in which selected users could upload cytometry data, inspect the raw data including abnormalities in the immunophenotype, and audit the ML recommendations against the WHO criteria. The user feedback from each case was recorded, from which the consistency of the ML recommendations with expert opinion could be compared. Before the product was integrated in the clinical routine, a ‘dry run’ retrospective two-arm, four-center blinded clinical study using 96 randomly selected non-overlapping B-NHL cases revealed that analysis time was reduced by >2x and accuracy saw a slight (non-significant) increase against a gold standard as compared to the control arm with a traditional workflow. Results: A worst-case sub-typing performance was computed by testing the model against historic data without expert supervision, and found an f1 score of >90% and sensitivity of 96%. The ML models for acute leukemias specifically show an f1 score of ≈90%, a false positive rate of ≈1.5% and false negative rate of 2-6%. These quality metrics demonstrate that the system can be used for both screening and sub-typing. We therefore integrated hema.to into the routine for B-NHL diagnosis at Result Laboratorium (Dordrecht) and the HpH (Hamburg) since January, for the latter including a deep integration into the laboratory database with automated reporting of expressed CD markers. To date, over a thousand routine cases have been analyzed using the system. We then measured the relationship between predicted sub-typing confidence of the model and agreement with the final expert judgment. The data showed that, on average, confidence≈accuracy ( R2=0.94), indicating that the model is neither over- nor underconfident. As such, the model is a “trustworthy” classifier. Expert agreement over time revealed that the quality of the diagnostic recommendations has been stable over time despite a change of device type and was consistently in excess of 90% across various metrics, including a 100% specificity during the four most recent recorded months. Conclusions: We've shown that machine learning can offer decision support and automated reporting for screening and classifying blood cancers from flow cytometry in a real-world routine setting. Our next focus is to expand the number of indications and increase the model sensitivity to small pathological populations, including measurable residual disease. These results represent major strides towards decision support software for any lab and all hematological neoplasms. Such a software will not only speed up and simplify diagnostic workflows, but also improve the quality of the analysis.

Computational diagnosis and risk evaluation for canine lymphoma

Whole Genome 3D Blood Biopsy Profiling of Canine Cancers: Development and Validation of EpiSwitch Multi-Choice Array-Based Diagnostic Test.

Advancements in genetic analysis: Insights from a case study and review of next-generation sequencing techniques for veterinary oncology applications

Multimodal machine learning models identify chemotherapy drugs with prospective clinical efficacy in dogs with relapsed B-cell lymphoma

Automated diagnosis of 7 canine skin tumors using machine learning on H&E-stained whole slide images

Comparison of the accuracy of minimally invasive techniques (cytology, cell block, immunocytochemistry and clonality assay) in the diagnosis of canine multicentric lymphoma

Artificial intelligence can be trained to predict c-KIT-11 mutational status of canine mast cell tumors from hematoxylin and eosin-stained histological slides

The K9 lymphoma assay allows a genetic subgrouping of canine lymphomas with improved risk classification

Real-World Demonstration of AI to Clinical Cytometry for Rapid and Reliable Decision Support and Automated Reporting of Blood Cancers Including B-NHL and Acute Leukemias

Haemoglobin Epsilon as a Biomarker for the Molecular Detection of Canine ‎Lymphoma

Application of Immunophenotyping and Heteroduplex Polymerase Chain Reaction (hPARR) for Diagnosis of Canine Lymphomas

Automated Nuclear Morphometry: A Deep Learning Approach for Prognostication in Canine Pulmonary Carcinoma to Enhance Reproducibility

Canine Cancer Diagnostics by X-ray Diffraction of Claws

Diagnosis of Canine Tumours and the Value of Combined Detection of VEGF, P53, SF and NLRP3 for the Early Diagnosis of Canine Mammary Carcinoma

Canine Mammary Tumor Histopathological Image Classification via Computer-Aided Pathology: An Available Dataset for Imaging Analysis

Deep Learning model predicts the c-Kit-11 mutational status of canine cutaneous mast cell tumors by HE stained histological slides

Detection of PIK3CA hotspot mutations in canine mammary tumors using droplet digital PCR: tissue validation and liquid biopsy feasibility

Keeping Pathologists in the Loop and an Adaptive F1-Score Threshold Method for Mitosis Detection in Canine Perivascular Wall Tumours

Using Machine Learning Algorithms to Predict Immunotherapy Response in Patients with Advanced Melanoma

Abstract 1612: Comparative oncology analysis of canine cancer by tumor and liquid biopsy testing for biomarker and therapeutic discovery in humans and dogs

A machine learning tool to improve prediction of mediastinal lymph node metastases in non-small cell lung cancer using routinely obtainable [18F]FDG-PET/CT parameters