Abstract:Microrobotic contact manipulation enables automated and precise cell capture, positioning and screening and has potential in biomedical engineering and disease detection. However, when using an optical microscope for visual positioning of targets, the poor clarity, limited cell-background contrast and lack of global 3D information of the cells in the field of view hinder global strategy making and automation, thereby affecting the accuracy and efficiency of manipulation. Here, we propose the 3D locating of multiple biological targets based on digital holography. Global–local combined visual feedback is developed for overall spatial locating and partial locating in a liquid-phase bright-field environment. By applying a filtering-based planar locating algorithm and maximum-area-based depth detection algorithm, the 3D global distribution of micro-targets in the field of view is periodically updated with a high detection rate. By applying a planar locating algorithm based on a convolutional neural network and a depth detection algorithm based on a gradient descent, the 3D fast locating of targets is performed precisely. Experiments show that the detection rate of the global positioning is 95.1%, the mean average precision of the local planar positioning is 90.53%, and the deviation of the local depth positioning is 1.22 $\mu$ m. When capturing cells, this method reaches an average speed of 7.4 cells/min and a collection rate of 90.5%. We anticipate that our method will support the research in cell-based bioengineering including cell screening and early disease diagnosis. Note to Practitioners—Automated cell manipulation is one of the most significant techniques in cell-based biomedical applications. This paper introduces a three-dimensional multi-target visual positioning method for automated cell manipulation. Combining with holographic imaging technique, the global information for the cells in the limited field of view is provided with improved imaging clarity and extended depth of field. The visual recognition algorithm can screen and extract the rare cells in the cell population, which will support the research in the field of early disease diagnosis and biomedicine. The research outcome provides an effective and precise solution to achieve biological targets positioning, capture, and screening within 3D liquid-phase bright-field environment.

Automated Robotic Measurement of 3-D Cell Morphologies

3D Microgroove Electrical Impedance Sensing to Examine 3D Cell Cultures for Antineoplastic Drug Assessment

3D Cell-Based Biosensor for Cell Viability and Drug Assessment by 3D Electric Cell/matrigel-Substrate Impedance Sensing.

Single Cell Mass Spectrometry with a Robotic Micromanipulation System for Cell Metabolite Analysis

Automated microrobotic characterization of cell-cell communication

Precise Automated Intracellular Delivery Using a Robotic Cell Microscope System with Three-Dimensional Image Reconstruction Information

Robotic Adherent Cell Injection for Characterizing Cell-Cell Communication.

Robotic Intracellular Manipulation: 3d Navigation And Measurement Inside A Single Cell

Computer-Vision-Based Dielectrophoresis Mobility Tracking for Characterization of Single-Cell Biophysical Properties.

Automated measurement of cell mechanical properties using an integrated dielectrophoretic microfluidic device

3-D Visual Feedback For Automated Sorting Of Cells With Ultra-Low Proportion Under Dark Field

High‐Throughput Electromechanical Coupling Chip Systems for Real‐Time 3D Invasion/Migration Assay of Cells

Three-Dimensional Autofocusing Visual Feedback For Automated Rare Cells Sorting In Fluorescence Microscopy

3-D Image Reconstruction of Biological Organelles with a Robot-Aided Microscopy System for Intracellular Surgery

A high-precision multi-dimensional microspectroscopic technique for morphological and properties analysis of cancer cell

Automated Shear Adhesion Force Measurement of Batch-adherent Cell based on Balance Pressure in Micropipette

Direct Measurement of Cell Protrusion Force Utilizing a Robot-Aided Cell Manipulation System with Optical Tweezers for Cell Migration Control

Automated Cell Mechanical Characterization by On-Chip Sequential Squeezing: From Static to Dynamic

Robot-Assisted Precise Manufacturing of Tissue Spheroid in Single-Cell Scale

Digital Holography Based Three-Dimensional Multi-Target Locating for Automated Cell Micromanipulation

Automated Non-Invasive Measurement of Single Sperm’s Motility and Morphology