Abstract:Flow visualization technologies such as particle tracking velocimetry are broadly used for studying three-dimensional turbulent flow in natural and industrial processes. Despite the advances in three-dimensional acquisition techniques, it is challenging to develop motion estimation algorithms in particle tracking due to large particle displacements, dense particle distributions and high computational cost. We present an end-to-end solution called graph optimal transport (GotFlow3D) to learn the three-dimensional fluid flow motion from consecutive particle images. The proposed model uses a graph neural network to extract geometric features and to further enrich the particle representations. The extracted deep features are subsequently used to correspond particles between consecutive frames, and the flow motion is then iteratively updated with a recurrent neural network approach. Experimental evaluations-including assessments on numerical experiments and validations on real-world experiments-demonstrate that GotFlow3D achieves state-of-the-art performance compared with recently developed scene flow learners and particle tracking algorithms. We believe that the high accuracy, robustness and generalization ability of our method can provide deeper insight into the complex dynamics of many physical and biological systems. Particle tracking velocimetry to estimate particle displacements in fluid flows in complex experimental scenarios is a challenging task and often comes with high computational cost. Liang and colleagues propose a graph neural network and optimal transport-based algorithm that can greatly improve the accuracy of existing tracking algorithms in real-world applications.

3D Target Detection and Tracking Based on Scene Flow

FlowMOT: 3D Multi-Object Tracking by Scene Flow Association

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Recurrent Graph Optimal Transport for Learning 3D Flow Motion in Particle Tracking

Detecting and Tracking Dynamic Objects in Complex Environments

A Simple 3d Face Tracking Method Based On Depth Information

Optical Flow Based Obstacle Detection in Static Environment

Moving target tracking using sparse optical flow method

Motion Detection Based on RGB-D Data and Scene Flow Clustering

Kalman-Based Scene Flow Estimation for Point Cloud Densification and 3D Object Detection in Dynamic Scenes

Stereoscopic video conversion based on depth tracking

FlowTrack: Point-level Flow Network for 3D Single Object Tracking

Motion Targets Tracking Algorithm Based on Video Surveillance

Optical Flow Based Real-time Moving Object Detection in Unconstrained Scenes.

An effective motion object detection method using optical flow estimation under a moving camera

Motion Detection for Rapidly Moving Cameras in Fully 3D Scenes

A Moving Target Detection and Localization Strategy Based on Optical Flow and Pin-hole Imaging Methods Using Monocular Vision

A Systematic Solution for Moving-Target Detection and Tracking While Only Using a Monocular Camera

Temporal Point Cloud Fusion With Scene Flow for Robust 3D Object Tracking

Object Tracking in Satellite Videos Based on a Multi-Frame Optical Flow Tracker

Fast Multi-frame Stereo Scene Flow with Motion Segmentation