Abstract:Immunotherapies have shown promising results in treating patients with hematological malignancies like multiple myeloma, which is an incurable but treatable bone marrow-resident plasma cell cancer. Choosing the most efficacious treatment for a patient remains a challenge in such cancers. However, pre-clinical assays involving patient-derived tumor cells co-cultured in an ex vivo reconstruction of immune-tumor micro-environment have gained considerable notoriety over the past decade. Such assays can characterize a patient's response to several therapeutic agents including immunotherapies in a high-throughput manner, where bright-field images of tumor (target) cells interacting with effector cells (T cells, Natural Killer (NK) cells, and macrophages) are captured once every 30 minutes for upto six days. Cell detection, tracking, and classification of thousands of cells of two or more types in each frame is bound to test the limits of some of the most advanced computer vision tools developed to date and requires a specialized approach. We propose TLCellClassifier (time-lapse cell classifier) for live cell detection, cell tracking, and cell type classification, with enhanced accuracy and efficiency obtained by integrating convolutional neural networks (CNN), metric learning, and long short-term memory (LSTM) networks, respectively. State-of-the-art computer vision software like KTH-SE and YOLOv8 are compared with TLCellClassifier, which shows improved accuracy in detection (CNN) and tracking (metric learning). A two-stage LSTM-based cell type classification method is implemented to distinguish between multiple myeloma (tumor/target) cells and macrophages/monocytes (immune/effector cells). Validation of cell type classification was done both using synthetic datasets and ex vivo experiments involving patient-derived tumor/immune cells.

Identification of Mitosis Stages Using Artificial Neural Networks for 3D Time Lapse Cell Sequences

Accurate and Fast Mitotic Detection Using an Anchor-Free Method Based on Full-Scale Connection with Recurrent Deep Layer Aggregation in 4D Microscopy Images

Automatic detection of cell-cycle stages using recurrent neural networks

A 2.5D Cascaded Convolutional Neural Network with Temporal Information for Automatic Mitotic Cell Detection in 4D Microscopic Images

CELL CYCLE STATE PREDICTION USING GRAPH NEURAL NETWORKS

Predicting cell cycle stage from 3D single-cell nuclear-stained images

Multi CNN based automatic detection of mitotic nuclei in breast histopathological images

Deep Learning Enabled Time-Lapse 3D Cell Analysis

Cell mitosis event analysis in phase contrast microscopy images using deep learning.

Multi-Scale Deep Neural Network for Mitosis Detection in Breast Cancer Histological Images

Automatic classification of normal and abnormal cell division using deep learning

An Efficient and Robust 3D Medical Image Classification Approach Based on 3D CNN, Time‐Distributed 2D CNN‐BLSTM Models, and mRMR Feature Selection

A multi-phase deep CNN based mitosis detection framework for breast cancer histopathological images

Mitosis Detection, Fast and Slow: Robust and Efficient Detection of Mitotic Figures

Deep learning-based reconstruction of embryonic cell-division cycle from label-free microscopy time-series of evolutionarily diverse nematodes

Search for temporal cell segmentation robustness in phase-contrast microscopy videos

Utilizing convolutional neural networks for discriminating cancer and stromal cells in three-dimensional cell culture images with nuclei counterstain

A Novel Two-Stage Deep Method for Mitosis Detection in Breast Cancer Histology Images

TLCellClassifier: Machine Learning Based Cell Classification for Bright-Field Time-Lapse Images

Towards Automatic Embryo Staging in 3D+T Microscopy Images using Convolutional Neural Networks and PointNets

A novel deep learning-based 3D cell segmentation framework for future image-based disease detection