Abstract:Deep learning has achieved spectacular performance in image and speech recognition and synthesis. It outperforms other machine learning algorithms in problems where large amounts of data are available. In the area of measurement technology, instruments based on the photonic time stretch have established record real-time measurement throughput in spectroscopy, optical coherence tomography, and imaging flow cytometry. These extreme-throughput instruments generate approximately 1 Tbit/s of continuous measurement data and have led to the discovery of rare phenomena in nonlinear and complex systems as well as new types of biomedical instruments. Owing to the abundance of data they generate, time-stretch instruments are a natural fit to deep learning classification. Previously we had shown that high-throughput label-free cell classification with high accuracy can be achieved through a combination of time-stretch microscopy, image processing and feature extraction, followed by deep learning for finding cancer cells in the blood. Such a technology holds promise for early detection of primary cancer or metastasis. Here we describe a new deep learning pipeline, which entirely avoids the slow and computationally costly signal processing and feature extraction steps by a convolutional neural network that directly operates on the measured signals. The improvement in computational efficiency enables low-latency inference and makes this pipeline suitable for cell sorting via deep learning. Our neural network takes less than a few milliseconds to classify the cells, fast enough to provide a decision to a cell sorter for real-time separation of individual target cells. We demonstrate the applicability of our new method in the classification of OT-II white blood cells and SW-480 epithelial cancer cells with more than 95% accuracy in a label-free fashion.

Deep learning guided image-based droplet sorting for on-demand selection and analysis of single cells and 3D cell cultures

Deep learning enabled label-free microfluidic droplet classification for single cell functional assays

An on-chip imaging droplet-sorting system: a real-time shape recognition method to screen target cells in droplets with single cell resolution

Deep Learning‐Assisted Label‐Free Parallel Cell Sorting with Digital Microfluidics

Mixing characterization of binary-coalesced droplets in microchannels using deep neural network

Deep Cytometry: Deep learning with Real-time Inference in Cell Sorting and Flow Cytometry

Machine Learning Based Real-Time Image-Guided Cell Sorting and Classification

Deep learning-based image analysis for in situ microscopic imaging of cell culture process

Enhancing Microdroplet Image Analysis with Deep Learning

COSMOS: a platform for real-time morphology-based, label-free cell sorting using deep learning

Design and construction of a microfluidics workstation for high-throughput multi-wavelength fluorescence and transmittance activated droplet analysis and sorting

Pheno-morphological screening and acoustic sorting of 3D multicellular aggregates using drop millifluidics

Automated spheroid generation, drug application and efficacy screening using a deep learning classification: a feasibility study

Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments

Precise and Fast Microdroplet Size Distribution Measurement Using Deep Learning

Dynamic video recognition for cell-encapsulating microfluidic droplets

Accelerating intelligent microfluidic image processing with transfer deep learning: A microchannel droplet/bubble breakup case study

Achieving high-resolution single-cell segmentation in convoluted cancer spheroids via Bayesian optimization and deep-learning

spinDrop: a droplet microfluidic platform to maximise single-cell sequencing information content

Research on cell detection method for microfluidic single cell dispensing

Droplet microfluidic technology for single-cell high-throughput screening