Abstract:Deep learning has achieved spectacular performance in image and speech recognition and synthesis. It outperforms other machine learning algorithms in problems where large amounts of data are available. In the area of measurement technology, instruments based on the photonic time stretch have established record real-time measurement throughput in spectroscopy, optical coherence tomography, and imaging flow cytometry. These extreme-throughput instruments generate approximately 1 Tbit/s of continuous measurement data and have led to the discovery of rare phenomena in nonlinear and complex systems as well as new types of biomedical instruments. Owing to the abundance of data they generate, time-stretch instruments are a natural fit to deep learning classification. Previously we had shown that high-throughput label-free cell classification with high accuracy can be achieved through a combination of time-stretch microscopy, image processing and feature extraction, followed by deep learning for finding cancer cells in the blood. Such a technology holds promise for early detection of primary cancer or metastasis. Here we describe a new deep learning pipeline, which entirely avoids the slow and computationally costly signal processing and feature extraction steps by a convolutional neural network that directly operates on the measured signals. The improvement in computational efficiency enables low-latency inference and makes this pipeline suitable for cell sorting via deep learning. Our neural network takes less than a few milliseconds to classify the cells, fast enough to provide a decision to a cell sorter for real-time separation of individual target cells. We demonstrate the applicability of our new method in the classification of OT-II white blood cells and SW-480 epithelial cancer cells with more than 95% accuracy in a label-free fashion.

High Precision Phase Recovery for Single Frame Fringe Pattern of Label-free Cells Detection Based on Deep Learning

Automatic Phase Recognition Method Based on Convolutional Neural Network

Biological Cell Phase Imaging System Integrated with Optical Scattering Information

Automatic whole blood cell analysis from blood smear using label-free multi-modal imaging with deep neural networks

Deep Learning in Label-free Cell Classification

Label-free hematology analysis method based on defocusing phase-contrast imaging under illumination of 415 nm light

Automatic Classification of Red Blood Cell Morphology Based on Quantitative Phase Imaging

Deep-learning assisted label-free hematology analysis through defocusing a regular microscope

Quantitative phase imaging of living red blood cells combining digital holographic microscopy and deep learning

Long-term, Real-Time and Label-Free Live Cell Image Processing and Analysis Based on a Combined Algorithm of CellPose and Watershed Segmentation

Progress on Methods of Quantitative Phase Measurement and Retrieval for Biological Cells

Label-free blood analysis utilizing contrast-enhanced defocusing imaging with machine vision

Interferometric Phase Microscopy Of Red Blood Cells

Phase Image Detection of Typical Leukocytes for Their Feature Analysis

A Rapid Detection Method for Morphological Characteristics of Biological Cells Based on Phase Imaging

Accurate label-free 3-part leukocyte recognition with single cell lens-free imaging flow cytometry

3D side-scattering imaging flow cytometer and convolutional neural network for label-free cell analysis

Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry

Computational Imaging Of Label-Free Cells Using Lens-Less Digital Holography

Real-time measurement of three-dimensional morphology of blood cells in batches by non-orthogonal phase imaging

Multiparameter Representation and Classification of Blood Cells Based on Phase Map Analysis