Abstract:Abstract Understanding the tumor microenvironment and detecting rare circulating tumor cells from blood are two major challenges faced by cancer biologists and oncologists. Both require high sensitivity and accuracy in classifying and isolating single cells in a complex and heterogeneous environment. Classical cell classification and sorting techniques are limited by their reliance on pre-selected cell biomarkers or physical characteristics. Recent breakthroughs in machine learning have achieved unprecedented accuracy across a wide range of image classification problems. We have developed a platform that combines high-resolution imaging of unlabeled cells in microfluidic flow with real-time deep neural network (DNN) based classification and sorting. The DNN classifier was trained on more than 25 million high-resolution cell images of multiple types imaged on the platform. Our model was trained to discriminate among multiple cell classes, including immune cell subtypes, non-small-cell lung cancer cells (NSCLC), hepatocellular carcinomas (HCC), and stromal cells (including endothelial, epithelial, fibroblasts, smooth muscle cells). We then assessed model performance on a separate validation set of cell images, including cell lines not used in the training data. Our classifier accurately identifies NSCLC and HCC against a background of blood cells with an area under the ROC curve (AUC) of > 0.999. In addition we demonstrate the enrichment of NSCLC cells from spike-in mixtures with WBCs or whole blood at concentrations as low as 1:100,000, achieving an enrichment of > 25,000x on multiple cell lines. Using dissociated lung cancer tissue, we demonstrate that our label-free classification of tumor cells closely matches results from both standard flow cytometer analysis and single cell RNA sequencing. Additionally we were able to enrich the tumor cell fraction from dissociated tumor tissue thereby improving the sensitivity of mutation detection and enabling refined downstream single-cell genomic analysis. This work demonstrates that deep learning using high-resolution cell images collected at scale can achieve a high classification accuracy and can enable the label-free isolation of rare cells of interest for a wide range of applications. This system can be used to analyze tumor biopsies and liquid biopsies and has the potential to enable the study of tumor cells and tumor microenvironment with novel dimension and insight. Citation Format: Mahyar Salek, Hou-pu Chou, Prashast Khandelwal, Krishna P. Pant, Thomas J. Musci, Nianzhen Li, Christina Chang, Andreja Jovic, Esther Lee, Stephanie Huang, Jeff Walker, Phuc Nguyen, Kiran Saini, Jeanette Mei, Quillan F. Smith, Maddison Masaeli. Deep learning enables label-free profiling of the tumor microenvironment and enrichment of rare cancer cells [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2021; 2021 Apr 10-15 and May 17-21. Philadelphia (PA): AACR; Cancer Res 2021;81(13_Suppl):Abstract nr 188.

Learning deep features for dead and living breast cancer cell classification without staining

Using deep convolutional neural networks to identify and classify tumor-associated stroma in diagnostic breast biopsies

Stain-free approach to determine and monitor cell heath using supervised and unsupervised image-based deep learning

Evaluation of a Deep Learning Based Approach to Computational Label Free Cell Viability Quantification

Deep learning identifies heterogeneous subpopulations in breast cancer cell lines

Abstract 188: Deep learning enables label-free profiling of the tumor microenvironment and enrichment of rare cancer cells

TLCellClassifier: Machine Learning Based Cell Classification for Bright-Field Time-Lapse Images

Automated classification of elliptical cancer cells with stain-free holographic imaging and self-supervised learning

Abstract 5361: Deep learning models capture high dimensional features for cell morphology analysis

Molecular Classification of Breast Cancer Using Weakly Supervised Learning

Classification of Human White Blood Cells Using Machine Learning for Stain-Free Imaging Flow Cytometry

Evaluation of deep learning training strategies for the classification of bone marrow cell images

Convolutional neural network for cell classification using microscope images of intracellular actin networks

Histopathological Image Classification with Cell Morphology Aware Deep Neural Networks

End-to-End Learning via a Convolutional Neural Network for Cancer Cell Line Classification

Breast Cancer Histopathology Image Classification Using an Ensemble of Deep Learning Models

Classification and counting of cells in brightfield microscopy images: an application of convolutional neural networks

Classification of unlabeled cells using lensless digital holographic images and deep neural networks

Deep Learning-Based, Multiclass Approach to Cancer Classification on Liquid Biopsy Data

Accurate and reproducible invasive breast cancer detection in whole-slide images: A Deep Learning approach for quantifying tumor extent

Breast Cancer Classification: A Deep Learning Approach for Digital Pathology