Abstract:Microfluidic flows feature typically fully three-dimensional velocity fields. However, often the optical access for measurements is limited. Astigmatism or defocus particle tracking velocimetry is a technique that enables the 3D position determination of individual particles by the analysis of astigmatic/defocused particle images. The classification and position determination of particles is a task well suited to deep neural networks (DNNs). In this work, two DNNs are used to extract the class and in-plane position (object detection) as well as the depth position (regression network). The performance of both DNNs is assessed by the position uncertainties as well as the precision of the size classes and the amount of recalled particles. The DNNs are evaluated on a synthetic dataset and establish a new benchmark of DNNs in defocus tracking applications. The recall is higher than compared to classic methods and the in-plane errors are always subpixel accurate. The relative uncertainty in the depth position is below \SI{1}{\percent} for all examined particle seeding concentrations. Additionally, the performance on experimental images, using four different particle sizes, ranging from 1.14 to \SI{5.03}{\micro\meter} is analyzed. The particle images are systematically rearranged to produce comprehensive datasets of varying particle seeding concentrations. The distinction between particles of similar size is more challenging but the DNNs still show very good results. A precision above \SI{96}{\percent} is reached with a high recall above \SI{95}{\percent}. The error in the depth position remains below \SI{1}{\percent} and the in-plane errors are subpixel accurate with respect to the labels. The work shows that first, DNNs can be trained with artificially rearranged data sets based on individual experimental images and are therefore easily adaptable to various experimental setups and applicable by non experts. Second, the DNNs can be successfully adapted to determine additional variables as in this case the size of the suspended particles.

Single-shot self-supervised particle tracking

Object tracking with 3D LIDAR via multi-task sparse learning

Particle filter with affine transformation for multiple key points tracking

Particle Identification in Particle Tracking Velocimetry Using Two-Stage Neural Networks

Multiple Dense Particle Tracking In Fluorescence Microscopy Images Based On Multidimensional Assignment

Automated Single Particle Detection and Tracking for Large Microscopy Datasets.

Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D

Deep Learning for Tracking of Intracellular Vesicles in Time-lapse Microscopy Images

Low-Rank Sparse Learning For Robust Visual Tracking

Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning

U-Net-based Deep Learning for Tracking and Quantitative Analysis of Intracellular Vesicles in Time-Lapse Microscopy Images

UmUTracker: A versatile MATLAB program for automated particle tracking of 2D light microscopy or 3D digital holography data

Subcellular particles tracking in time-lapse confocal microscopy images

Minimal Path Based Particle Tracking in Low SNR Fluorescence Microscopy Images.

A deep neural network architecture for reliable 3D position and size determination for Lagrangian particle tracking using a single camera

Micro-object motion tracking based on the probability hypothesis density particle tracker

Extract latent features of single-particle trajectories with historical experience learning

Deep learning-based multiple particle tracking in complex system

Detecting directed motion and confinement in single-particle trajectories using hidden variables

Self-STORM: Deep Unrolled Self-Supervised Learning for Super-Resolution Microscopy

Long-term tracking algorithm using deep features and a single shot multibox detector.