Abstract:Optical flow estimation is crucial for various applications in vision and robotics. As the difficulty of collecting ground truth optical flow in real-world scenarios, most of the existing methods of learning optical flow still adopt synthetic dataset for supervised training or utilize photometric consistency across temporally adjacent video frames to drive the unsupervised learning, where the former typically has issues of generalizability while the latter usually performs worse than the supervised ones. To tackle such challenges, we propose to leverage the geometric connection between optical flow estimation and stereo matching (based on the similarity upon finding pixel correspondences across images) to unify various real-world depth estimation datasets for generating supervised training data upon optical flow. Specifically, we turn the monocular depth datasets into stereo ones via synthesizing virtual disparity, thus leading to the flows along the horizontal direction; moreover, we introduce virtual camera motion into stereo data to produce additional flows along the vertical direction. Furthermore, we propose applying geometric augmentations on one image of an optical flow pair, encouraging the optical flow estimator to learn from more challenging cases. Lastly, as the optical flow maps under different geometric augmentations actually exhibit distinct characteristics, an auxiliary classifier which trains to identify the type of augmentation from the appearance of the flow map is utilized to further enhance the learning of the optical flow estimator. Our proposed method is general and is not tied to any particular flow estimator, where extensive experiments based on various datasets and optical flow estimation models verify its efficacy and superiority.

Feature Homogenization Strategy Using Optical Flow for Vision-Related Simultaneous Localization and Mapping in a Complex Environment.

Leveraging Local Planar Motion Property for Robust Visual Matching and Localization.

Unsupervised Learning of Scene Flow Estimation Fusing with Local Rigidity.

Optical Flow Based Obstacle Detection in Static Environment

A Dense Optical Flow-Based Feature Matching Approach in Visual Odometry

Self-Attention-Based Multiscale Feature Learning Optical Flow with Occlusion Feature Map Prediction

A Robust and Integrated Visual Odometry Framework Exploiting the Optical Flow and Feature Point Method

Fast and Accurate Optical Flow based Depth Map Estimation from Light Fields

Skin the sheep not only once: Reusing Various Depth Datasets to Drive the Learning of Optical Flow

Improving monocular visual SLAM in dynamic environments: an optical-flow-based approach

SeisLFMFlow: Seismic Common Image Gathers Enhancement Using Self-Supervised Optical Flow Estimation Based on Local Feature Matching

EMatch: A Unified Framework for Event-based Optical Flow and Stereo Matching

Optical flow and feature constrains algorithm for remote sensing image registration

A Moving Target Detection and Localization Strategy Based on Optical Flow and Pin-hole Imaging Methods Using Monocular Vision

MOP-SLAM: A real time SLAM system based on multi-head optical flow estimation network

Breaking of brightness consistency in optical flow with a lightweight CNN network

An Unsupervised Optical Flow Estimation For LiDAR Image Sequences

Revised Depth Map Estimation for Multi-View Stereo.

FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flow

Optical Flow boosts Unsupervised Localization and Segmentation

LLA-FLOW: A Lightweight Local Aggregation on Cost Volume for Optical Flow Estimation