Abstract:The human immune system consists of a highly intelligent network of billions of independent, self-organized cells that interact with each other. Machine learning (ML) is an artificial intelligence (AI) tool that automatically processes huge amounts of image data. Immunotherapies have revolutionized the treatment of blood cancer. Specifically, one such therapy involves engineering immune cells to express chimeric antigen receptors (CAR), which combine tumor antigen specificity with immune cell activation in a single receptor. To improve their efficacy and expand their applicability to solid tumors, scientists optimize different CARs with different modifications. However, predicting and ranking the efficacy of different "off-the-shelf" immune products (e.g., CAR or Bispecific T-cell Engager [BiTE]) and selection of clinical responders are challenging in clinical practice. Meanwhile, identifying the optimal CAR construct for a researcher to further develop a potential clinical application is limited by the current, time-consuming, costly, and labor-intensive conventional tools used to evaluate efficacy. Particularly, more than 30 years of immunological synapse (IS) research data demonstrate that T cell efficacy is not only controlled by the specificity and avidity of the tumor antigen and T cell interaction, but also it depends on a collective process, involving multiple adhesion and regulatory molecules, as well as tumor microenvironment, spatially and temporally organized at the IS formed by cytotoxic T lymphocytes (CTL) and natural killer (NK) cells. The optimal function of cytotoxic lymphocytes (including CTL and NK) depends on IS quality. Recognizing the inadequacy of conventional tools and the importance of IS in immune cell functions, we investigate a new strategy for assessing CAR-T efficacy by quantifying CAR IS quality using the glass-support planar lipid bilayer system combined with ML-based data analysis. Previous studies in our group show that CAR-T IS quality correlates with antitumor activities in vitro and in vivo . However, current manually quantified IS quality data analysis is time-consuming and labor-intensive with low accuracy, reproducibility, and repeatability. In this study, we develop a novel ML-based method to quantify thousands of CAR cell IS images with enhanced accuracy and speed. Specifically, we used artificial neural networks (ANN) to incorporate object detection into segmentation. The proposed ANN model extracts the most useful information to differentiate different IS datasets. The network output is flexible and produces bounding boxes, instance segmentation, contour outlines (borders), intensities of the borders, and segmentations without borders. Based on requirements, one or a combination of this information is used in statistical analysis. The ML-based automated algorithm quantified CAR-T IS data correlates with the clinical responder and non-responder treated with Kappa-CAR-T cells directly from patients. The results suggest that CAR cell IS quality can be used as a potential composite biomarker and correlates with antitumor activities in patients, which is sufficiently discriminative to further test the CAR IS quality as a clinical biomarker to predict response to CAR immunotherapy in cancer. For translational research, the method developed here can also provide guidelines for designing and optimizing numerous CAR constructs for potential clinical development. Trial Registration: ClinicalTrials.gov NCT00881920 .

RCMNet: A deep learning model assists CAR-T therapy for leukemia

CoTCoNet: An Optimized Coupled Transformer-Convolutional Network with an Adaptive Graph Reconstruction for Leukemia Detection

Potent Anti-Leukemia Activities of Humanized CD19-targeted Chimeric Antigen Receptor T (CAR-T) Cells in Patients with Relapsed/refractory Acute Lymphoblastic Leukemia.

High-throughput Image-based Clustering of CAR-T/Tumor Cocultures for Rapid and Facile Hit Identification

Predicting CAR-T Response in Mantle Cell Lymphoma Using Deep Neural Network Models on Single-Cell RNA Sequencing Data

Cd19 Targeted Chimeric Antigen Receptor T (Car-T) Cell Immunotherapy Has Demonstrated Significant Anti-Leukemia Activity In Pediatric Patients With Relapsed/Refractory Acute Lymphocytic Leukemia: A Multicentre Study In China.

DeepLeuk: a convolutional neural network pre-trained model for microscopic cell images-Based leukemia Cancer analysis

[Progress in Clinical Studies of Chimeric Antigen Receptor Engineered T Cells for Treatment of Childhood Cancer].

An attention-based deep learning for acute lymphoblastic leukemia classification

Videl: A Vision-based AI Diagnoser for Early Leukemia

Identification of methylation signatures associated with CAR T cell in B-cell acute lymphoblastic leukemia and non-hodgkin's lymphoma

A deep transfer learning based approaches for the detection and classification of acute lymphocytic leukemia using microscopic images

In vitro machine learning-based CAR T immunological synapse quality measurements correlate with patient clinical outcomes

Radionuclide-based molecular imaging allows CAR-T cellular visualization and therapeutic monitoring

Diagnosis and typing of leukemia using a single peripheral blood cell through deep learning

Predictive model for CAR‐T cell therapy success in patients with relapsed/refractory B‐cell acute lymphoblastic leukaemia

A deep learning method and device for bone marrow imaging cell detection

High‐Accuracy and Lightweight Image Classification Network for Optimizing Lymphoblastic Leukemia Diagnosisy

[An Improved Vision Transformer Model for the Recognition of Blood Cells].

Development and Evaluation of a Leukemia Diagnosis System Using Deep Learning in Real Clinical Scenarios

Diagnosing acute promyelocytic leukemia by using convolutional neural network