Abstract:Microfluidic flows feature typically fully three-dimensional velocity fields. However, often the optical access for measurements is limited. Astigmatism or defocus particle tracking velocimetry is a technique that enables the 3D position determination of individual particles by the analysis of astigmatic/defocused particle images. The classification and position determination of particles is a task well suited to deep neural networks (DNNs). In this work, two DNNs are used to extract the class and in-plane position (object detection) as well as the depth position (regression network). The performance of both DNNs is assessed by the position uncertainties as well as the precision of the size classes and the amount of recalled particles. The DNNs are evaluated on a synthetic dataset and establish a new benchmark of DNNs in defocus tracking applications. The recall is higher than compared to classic methods and the in-plane errors are always subpixel accurate. The relative uncertainty in the depth position is below \SI{1}{\percent} for all examined particle seeding concentrations. Additionally, the performance on experimental images, using four different particle sizes, ranging from 1.14 to \SI{5.03}{\micro\meter} is analyzed. The particle images are systematically rearranged to produce comprehensive datasets of varying particle seeding concentrations. The distinction between particles of similar size is more challenging but the DNNs still show very good results. A precision above \SI{96}{\percent} is reached with a high recall above \SI{95}{\percent}. The error in the depth position remains below \SI{1}{\percent} and the in-plane errors are subpixel accurate with respect to the labels. The work shows that first, DNNs can be trained with artificially rearranged data sets based on individual experimental images and are therefore easily adaptable to various experimental setups and applicable by non experts. Second, the DNNs can be successfully adapted to determine additional variables as in this case the size of the suspended particles.

Developing Noise-Resistant Three-Dimensional Single Particle Tracking Using Deep Neural Networks.

3D dual-virtual-pinhole assisted single particle tracking microscopy

Particle Identification in Particle Tracking Velocimetry Using Two-Stage Neural Networks

Real-Time 3D Tracking of Multi-Particle in the Wide-Field Illumination Based on Deep Learning

Neural Network Based 3D Tracking with a Graphene Transparent Focal Stack Imaging System

Pet Image Resolution Uniformity Improvements Using Deep Learning

A deep neural network architecture for reliable 3D position and size determination for Lagrangian particle tracking using a single camera

Neural-network-enhanced line-of-sight method for 3D particle cloud reconstruction in particle tracking velocimetry

Deep Joint Denoising and Detection for Enhanced Intracellular Particle Analysis

Convolutional neural networks automate detection for tracking of submicron scale particles in 2D and 3D

Particle Field Positioning with a Commercial Microscope Based on a Developed CNN and the Depth-from-defocus Method

Fast and High-Accuracy Localization for Three-Dimensional Single-Particle Tracking

Minimal Path Based Particle Tracking in Low SNR Fluorescence Microscopy Images.

High-axial-resolution Single-Molecule Localization under Dense Excitation with a Multi-Channel Deep U-Net.

Precise Three-Dimensional Scan-Free Multiple-Particle Tracking over Large Axial Ranges with Tetrapod Point Spread Functions

3D Positioning and Autofocus of the Particle Field Based on the Depth-from-defocus Method and the Deep Networks

Nano‐level position resolution for particle tracking in digital in‐line holographic microscopy

A deep neural network for positioning and inter-crystal scatter identification in multiplexed PET detectors

3D Position Estimation Using an Artificial Neural Network for a Continuous Scintillator PET Detector

Deep learning-based multiple particle tracking in complex system

FreeTrack: Device-Free Human Tracking with Deep Neural Networks and Particle Filtering