Abstract:Microfluidic flows feature typically fully three-dimensional velocity fields. However, often the optical access for measurements is limited. Astigmatism or defocus particle tracking velocimetry is a technique that enables the 3D position determination of individual particles by the analysis of astigmatic/defocused particle images. The classification and position determination of particles is a task well suited to deep neural networks (DNNs). In this work, two DNNs are used to extract the class and in-plane position (object detection) as well as the depth position (regression network). The performance of both DNNs is assessed by the position uncertainties as well as the precision of the size classes and the amount of recalled particles. The DNNs are evaluated on a synthetic dataset and establish a new benchmark of DNNs in defocus tracking applications. The recall is higher than compared to classic methods and the in-plane errors are always subpixel accurate. The relative uncertainty in the depth position is below \SI{1}{\percent} for all examined particle seeding concentrations. Additionally, the performance on experimental images, using four different particle sizes, ranging from 1.14 to \SI{5.03}{\micro\meter} is analyzed. The particle images are systematically rearranged to produce comprehensive datasets of varying particle seeding concentrations. The distinction between particles of similar size is more challenging but the DNNs still show very good results. A precision above \SI{96}{\percent} is reached with a high recall above \SI{95}{\percent}. The error in the depth position remains below \SI{1}{\percent} and the in-plane errors are subpixel accurate with respect to the labels. The work shows that first, DNNs can be trained with artificially rearranged data sets based on individual experimental images and are therefore easily adaptable to various experimental setups and applicable by non experts. Second, the DNNs can be successfully adapted to determine additional variables as in this case the size of the suspended particles.

On the determination of 3D position and orientation of spheroidal particles using defocusing and deep learning

On The Preparation Of Training Data For 3D Tracking Of Position And Orientation Of Microswimmers Using Defocusing And Deep Learning

A deep neural network architecture for reliable 3D position and size determination for Lagrangian particle tracking using a single camera

3D Positioning and Autofocus of the Particle Field Based on the Depth-from-defocus Method and the Deep Networks

Particle Field Positioning with a Commercial Microscope Based on a Developed CNN and the Depth-from-defocus Method

Double refractive particle tracking and sizing

Measurement of particle trajectory by defocusing technique with one camera

Generalizable Deep Learning Approach for 3D Particle Imaging using Holographic Microscopy

Adaptive In-Focus Particle Detection and Segmentation in Holographic 3d Image with Mechanism-Guided Machine Learning

3D particle tracking using a dual-objective fluorescent reflection system with spherical aberration

Depth from defocus technique with convolutional neural networks for high particle concentrations

Depth from Defocus Technique for High Number Densities and Non-spherical Particles

Precise Three-Dimensional Scan-Free Multiple-Particle Tracking over Large Axial Ranges with Tetrapod Point Spread Functions

FiND: Few-shot three-dimensional image-free confocal focusing on point-like emitters

A 3-D deconvolution based particle detection method for wide-field microscopy image

Label-free 3D tracking of biological micro-objects using RGB pinholes

Depth from defocus technique: a simple calibration-free approach for dispersion size measurement

Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning

Learning an optimal PSF-pair for ultra-dense 3D localization microscopy

Developing Noise-Resistant Three-Dimensional Single Particle Tracking Using Deep Neural Networks.

Fast and High-Accuracy Localization for Three-Dimensional Single-Particle Tracking