Abstract:Automated manipulation of deformable objects is challenging due to the object’s deformation behavior. Different from still deformable objects such as wires and cloth, biological organisms such as sperm and worms are both deformable and motile, requiring the control of both deformation and motion. This paper reports automated orientation control of live sperm, as an example of motile deformable cells. Robotic manipulation of human sperm was performed by using a glass micropipette, which is a standard clinical tool, to rotate individual motile sperm. Sperm rotation must be performed before immobilization, as required in clinical cell surgery for infertility treatment. To control tail deformation during sperm rotation, a path planner was designed based on kinematic analysis and manipulation point update. To deal with the intrinsic motion of a motile sperm, a motorized stage was controlled to compensate for sperm swimming motion, and an observer was designed to decouple sperm orientation from its wiggling motion. A sliding mode controller was designed to cope with stiffness variances along the sperm tail and among different sperm. Deep neural networks were developed for robust sperm tail detection, and Kalman filter was used to predict tail motion. Experimental results demonstrated that automated sperm manipulation achieved an orientation error of 0.8 $^{circ}$ and operation time of 6.8 s, both significantly less than those of manual operation. The designed observer was effective to reduce sperm orientation error by reducing the disturbance from sperm wiggling motion. The developed sliding mode controller outperformed the PID controller in operation time, reducing the time of oocyte exposure to the ambient environment. Note to Practitioners—This work tackled the challenge of rotating a fast-swimming and deformable sperm in clinical cell surgeries. Automated manipulation of deformable objects has wide applications in industrial and service settings such as manipulating wires and folding cloth. However, the intrinsic motion of a motile sperm and the lack of a rotational degree of freedom in standard micromanipulators pose difficulties to automated sperm manipulation. In this paper, we propose automation techniques for sperm orientation control. For sperm tail detection, deep learning was used to handle the variances of shape and length among different sperm. A path planning strategy and a controller were designed to achieve automated rotation of motile sperm, with its deformation and motion both controlled. The developed methods can be generalized to the manipulation of other deformable objects such as wires, cables and cloth. These objects exhibit significant variance of mechanical properties, and calibration is often time-consuming. The designed controller can be used to manipulate deformable objects with robustness to varied mechanical parameters. Path planning was designed by updating the manipulation point based on the object’s deformation behavior, and is suitable in manipulation where constraints are imposed such as the object’s strain.

Deep Learning-Based Method for Analyzing the Optically Trapped Sperm Rotation.

A Real-Time Oocyte Polar Body Detection Method

Chirality and frequency measurement of longitudinal rolling of human sperm using optical trap

Arbitrary Manipulation of Micro-Particles in Three Dimensions by Steering of Multiple Orbital Angular Momentum Modes

Controlled rotation of cells using a single-beam anisotropic optical trap

Automatic Cell Rotation Based on Real-Time Detection and Tracking

Visual Servoed Robotic Mouse Oocyte Rotation

Multidimensional Morphological Analysis of Live Sperm Based on Multiple-target Tracking

Fast Noninvasive Morphometric Characterization of Free Human Sperms Using Deep Learning

Deep learning for optical tweezers

Accurate and Automatic Extraction of Cell Self-Rotation Speed in an ODEP Field Using an Area Change Algorithm

Thermophoretic Tweezers for Low-Power and Versatile Manipulation of Biological Cells

Automated Orientation Control of Motile Deformable Cells

Optofluidic-based cell multi-axis controllable rotation and 3D surface imaging

High-Order Fiber Mode Beam Parameter Optimization for Transport and Rotation of Single Cells

3D Dynamic Observation of Human Sperm by Parallel Phase-Shifting Digital Holographic Microscopy Based on Pixelated Polarization

Modelling and control of optical manipulation for cell rotation

3D cell electrorotation and imaging for measuring multiple cellular biophysical properties.

Droplet-based optical trapping for cell separation in mock forensic samples

Orientation of biological cells using plane-polarized Gaussian beam optical tweezers