Abstract:Motion fields estimated from image data have been widely used in physics and engineering. Time-resolved particle image velocimetry (TR-PIV) is considered as an advanced flow visualization technique that measures multi-frame velocity fields from successive images. Contrary to conventional PIV, TR-PIV essentially estimates a velocity field video that provides both temporal and spatial information. However, performing TR-PIV with high computational efficiency and high computational accuracy is still a challenge for current algorithms. To solve these problems, we put forward a novel deep learning network named Deep-TRPIV in this study, to effectively estimate fluid motions from multi-frame particle images in an end-to-end manner. First, based on particle image data, we modify the optical flow model known as recurrent all-pairs field transforms that iteratively updates flow fields through a convolutional gated recurrent unit. Second, we specifically design a temporal recurrent network architecture based on this optical flow model by conveying features and flow information from previous frame. When N successive images are fed, the network can efficiently estimate N - 1 motion fields. Moreover, we generate a dataset containing multi-frame particle images and true fluid motions to train the network supervised. Eventually, we conduct extensive experiments on synthetic and experimental data to evaluate the performance of the proposed model. Experimental evaluation results demonstrate that our proposed approach achieves high accuracy and computational efficiency, compared with classical approaches and related deep learning models.

Recurrent Spatial Pyramid CNN for Optical Flow Estimation

Deeper Spatial Pyramid Network with Refined Up-Sampling for Optical Flow Estimation.

Dense Motion Estimation of Particle Images Via a Convolutional Neural Network

Unsupervised Learning for Optical Flow Estimation Using Pyramid Convolution LSTM

Learnable spatiotemporal feature pyramid for prediction of future optical flow in videos

Optical Flow Estimation Using Spatial-Channel Combinational Attention-Based Pyramid Networks

Recurrent Partial Kernel Network for Efficient Optical Flow Estimation

Unsupervised Optical Flow Estimation Based on Improved Feature Pyramid

Spatio-Temporal Recurrent Networks for Event-Based Optical Flow Estimation

FPCR-Net: Feature pyramidal correlation and residual reconstruction for optical flow estimation

RAPIDFlow: Recurrent Adaptable Pyramids with Iterative Decoding for Efficient Optical Flow Estimation

Optical Flow Estimation Using Dual Self-Attention Pyramid Networks

LCIF-Net: Local criss-cross attention based optical flow method using multi-scale image features and feature pyramid

Learning Optical Flow via Deformable Convolution and Feature Pyramid Networks

Structural Pyramid Network For Cascaded Optical Flow Estimation

SKFlow: Optical Flow Estimation Using Selective Kernel Networks

Pyramid Structured Optical Flow Learning with Motion Cues

Deep Dual Recurrence Optical Flow Learning for Time-Resolved Particle Image Velocimetry

Optical Flow Estimation with Convolutional Neural Nets

A CNNs-based method for optical flow estimation with prior constraints and stacked U-Nets

MRDFlow: Unsupervised Optical Flow Estimation Network With Multi-Scale Recurrent Decoder