Abstract:Automated cell classification in cancer biology is a challenging topic in computer vision and machine learning research. Breast cancer is the most common malignancy in women that usually involves phenotypically diverse populations of breast cancer cells and an heterogeneous stroma. In recent years, automated microscopy technologies are allowing the study of live cells over extended periods of time, simplifying the task of compiling large image databases. For instance, there have been several studies oriented towards building machine learning systems capable of automatically classifying images of different cell types (i.e. motor neurons, stem cells). In this work we were interested in classifying breast cancer cells as live or dead, based on a set of automatically retrieved morphological characteristics using image processing techniques. Our hypothesis is that live-dead classification can be performed without any staining and using only bright-field images as input. We tackled this problem using the JIMT-1 breast cancer cell line that grows as an adherent monolayer. First, a vast image set composed by JIMT-1 human breast cancer cells that had been exposed to a chemotherapeutic drug treatment (doxorubicin and paclitaxel) or vehicle control was compiled. Next, several classifiers were trained based on well-known convolutional neural networks (CNN) backbones to perform supervised classification using labels obtained from fluorescence microscopy images associated with each bright-field image. Model performances were evaluated and compared on a large number of bright-field images. The best model reached an AUC = 0.941 for classifying breast cancer cells without treatment. Furthermore, it reached AUC = 0.978 when classifying breast cancer cells under drug treatment. Our results highlight the potential of machine learning and computational image analysis to build new diagnosis tools that benefit the biomedical field by reducing cost, time, and stimulating work reproducibility. More importantly, we analyzed the way our classifiers clusterize bright-field images in the learned high-dimensional embedding and linked these groups to salient visual characteristics in live-dead cell biology observed by trained experts.

Automated chondrocyte viability analysis of articular cartilage based on deep learning segmentation and classification of two-photon microscopic images

Deep learning provides high accuracy in automated chondrocyte viability assessment in articular cartilage using nonlinear optical microscopy

Nondestructive, quantitative viability analysis of 3D tissue cultures using machine learning image segmentation

Cell quantification at the osteochondral interface from synchrotron radiation phase contrast micro-computed tomography images using a deep learning approach

Stain-free approach to determine and monitor cell heath using supervised and unsupervised image-based deep learning

Automating three-dimensional osteoarthritis histopathological grading of human osteochondral tissue using machine learning on contrast-enhanced micro-computed tomography

Deep-learning-based multi-class segmentation for automated, non-invasive routine assessment of human pluripotent stem cell culture status

Evaluation of a Deep Learning Based Approach to Computational Label Free Cell Viability Quantification

Deep-Learning for Tidemark Segmentation in Human Osteochondral Tissues Imaged with Micro-computed Tomography

High‐Throughput, Label‐Free and Slide‐Free Histological Imaging by Computational Microscopy and Unsupervised Learning

Automated mesenchymal stem cell segmentation and machine learning-based phenotype classification using morphometric and textural analysis

Evaluation of Cartilage Engineering Using PKH26 and Molecular Light Imaging System

Automated measurement and grading of knee cartilage thickness: a deep learning-based approach

Segmentation and Evaluation of Corneal Nerves and Dendritic Cells From In Vivo Confocal Microscopy Images Using Deep Learning

Automatic femoral articular cartilage segmentation using deep learning in three-dimensional ultrasound images of the knee

Automatic Segmentation of Osteonal Microstructure in Human Cortical Bone Using Deep Learning: A Proof of Concept

Automatic Segmentation for Analysis of Murine Cardiac Ultrasound and Photoacoustic Image Data Using Deep Learning

A deep learning approach to estimate chemically-treated collagenous tissue nonlinear anisotropic stress-strain responses from microscopy images

Deep learning-based segmentation of knee MRI for fully automatic subregional morphological assessment of cartilage tissues: Data from the Osteoarthritis Initiative

Learning deep features for dead and living breast cancer cell classification without staining

Utilizing deep learning for dermal matrix quality assessment on in vivo line-field confocal optical coherence tomography images