Abstract:Ultrasound Localization Microscopy (ULM), an emerging medical imaging technique, effectively resolves the classical trade-off between resolution and penetration inherent in traditional ultrasound imaging, opening up new avenues for noninvasive observation of the microvascular system. However, traditional microbubble tracking methods encounter various practical challenges. These methods typically entail multiple processing stages, including intricate steps like pairwise correlation and trajectory optimization, rendering real-time applications unfeasible. Furthermore, existing deep learning-based tracking techniques neglect the temporal aspects of microbubble motion, leading to ineffective modeling of their dynamic behavior. To address these limitations, this study introduces a novel approach called the Gated Recurrent Unit (GRU)-based Multitasking Temporal Neural Network (GRU-MT). GRU-MT is designed to simultaneously handle microbubble trajectory tracking and trajectory optimization tasks. Additionally, we enhance the nonlinear motion model initially proposed by Piepenbrock et al. to better encapsulate the nonlinear motion characteristics of microbubbles, thereby improving trajectory tracking accuracy. In this study, we perform a series of experiments involving network layer substitutions to systematically evaluate the performance of various temporal neural networks, including Recurrent Neural Networks (RNN), Long Short-Term Memory (LSTM), GRU, Transformer, and its bidirectional counterparts, on the microbubble trajectory tracking task. Concurrently, the proposed method undergoes qualitative and quantitative comparisons with traditional microbubble tracking techniques. The experimental results demonstrate that GRU-MT exhibits superior nonlinear modeling capabilities and robustness, both in simulation and in vivo dataset. Additionally, it achieves reduced trajectory tracking errors in shorter time intervals, underscoring its potential for efficient microbubble trajectory tracking. Model code is open-sourced at https://github.com/zyt-Lib/GRU-MT.

Motion-Based Multiple Object Tracking of Ultrasonic-Induced Nucleation: A Case Study of L-Glutamic Acid

Homogeneous and Heterogeneous Nucleation of Potash Alum in Drop-Based Microfluidic Device

Relative Position Control and Coalescence of Independent Microparticles Using Ultrasonic Waves

Nucleation rate measurement of colloidal crystallization using microfluidic emulsion droplets.

Image Analysis For In-Line Measurement Of Multidimensional Size, Shape, And Polymorphic Transformation Of L-Glutamic Acid Using Deep Learning-Based Image Segmentation And Classification

Ultrasound-assisted Intensified Crystallization of L-glutamic Acid: Crystal Nucleation and Polymorph Transformation.

The Polymorph and Crystal Habit Control of Dl-Methionine Assisted by Ultrasound

Automatic Control of Nucleation and Crystal Growth Using Online Raman Analyzer

On-line measurement of the real size and shape of crystals in stirred tank crystalliser using non-invasive stereo vision imaging

Solution Thermodynamics of L-Glutamic Acid Polymorphs from Finite-Sized Molecular Dynamics Simulations

Efficient Microbubble Trajectory Tracking in Ultrasound Localization Microscopy Using a Gated Recurrent Unit-Based Multitasking Temporal Neural Network

Effect of Supersaturation on L-Glutamic Acid Polymorphs under Droplet-Based Microchannels

Growing a single suspended perfect protein crystal in a fully noncontact manner

Protein Nucleation and Crystallization Process with Process Analytical Technologies in a Batch Crystallizer

Automated Crystallization Monitoring in Material Development using Computer Vision and Neuronal Networks

Deep-learning based in-situ micrograph analysis of high-density crystallization slurry using image and data enhancement strategy

Tracing Nucleation and Growth on Atomic Level in Amorphous Sodium by Molecular Dynamics Simulation

Deep Learning-Based In Situ Micrograph Synthesis and Augmentation for Crystallization Process Image Analysis

Preparation and growth mechanism of micro spherical ammonium dinitramide crystal based on ultrasound-assisted solvent-antisolvent method

Image Analytical Approach for Needle-Shaped Crystal Counting and Length Estimation

Image Analysis of Crystal Size Distribution and Agglomeration for Β Form L-Glutamic Acid Crystallization Based on YOLOv4 Deep Learning