Abstract:Optical flow represents vector motion of targets, and its estimation is a hot research in computer vision. The traditional prior-based methods build mathematical models using different regularizers on object characteristics. These methods are straightforward and easily understood, but they suffer from a high computational burden. Deep learning based approaches greatly improve their efficiency, but their filter sizes are fixed and receptive fields are large. To solve these problems, this paper proposes a novel recurrent feature refinement network based on short-term dense connection modules for optical flow estimation (RFRFlow), including the following key parts: firstly, we utilize short-term dense concatenate modules (STDC) as a backbone part for constructing a feature extracting network which can preserve rich details and use global averaging pooling to extract global context information with a large receptive field. Secondly, a 4D correlation volume is constructed using context features of image pairs to extract multi-scale 4D correlation information. Thirdly, a motion feature encoder is reported to transfer the multi-scale 4D correlation information into 2D motion features. Finally, 2D context features and 2D motion features are input into a global motion aggregation (GMA) decoder for pursuing the final optical flow. In the experiments, we firstly present and analyze the results of ablation studies on the selection of batch size and image size. Then, both quantitative and qualitative results on Sintel and KITTI datasets are compared, showing that the proposed RFRFlow is effective and even performs better than the state-of-the-art optical flow estimation methods on performance improvement and objects’ shape preservation.

Salient-motion-heuristic Scheme for Fast 3D Optical Flow Estimation Using RGB-D Data

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

Motion Detection Based on RGB-D Data and Scene Flow Clustering

ScaleFlow++: Robust and Accurate Estimation of 3D Motion from Video

FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flow

Direct Method for Motion Estimation and Structure Reconstruction Based on Optical Flow

Stereoscopic video conversion based on depth tracking

Motion Recovery Using the Image Interpolation Algorithm and an RGB-D Camera

Fast Multi-frame Stereo Scene Flow with Motion Segmentation

HMAFlow: Learning More Accurate Optical Flow via Hierarchical Motion Field Alignment

Optical Flow as Spatial-Temporal Attention Learners

RFRFlow: Recurrent feature refinement network for optical flow estimation

Three-dimensional motion estimation by straight-line and endpoint optical flow

RPEFlow: Multimodal Fusion of RGB-PointCloud-Event for Joint Optical Flow and Scene Flow Estimation

A Robust Optical Flow Computation

Multi-Motion Segmentation: Combining Geometric Model-Fitting and Optical Flow for RGB Sensors

Optical Flow Estimation Via Motion Feature Recovery

Camera Motion Estimation from RGB-D-Inertial Scene Flow

Optical Flow in Mostly Rigid Scenes