Abstract:The accuracy of optical flow estimation algorithms has been improving steadily as evidenced by results on the Middlebury optical flow benchmark. The typical formulation, however, has changed little since the work of Horn and Schunck. We attempt to uncover what has made recent advances possible through a thorough analysis of how the objective function, the optimization method, and modern implementation practices influence accuracy. We discover that “classical” flow formulations perform surprisingly well when combined with modern optimization and implementation techniques. One key implementation detail is the median filtering of intermediate flow fields during optimization. While this improves the robustness of classical methods it actually leads to higher energy solutions, meaning that these methods are not optimizing the original objective function. To understand the principles behind this phenomenon, we derive a new objective function that formalizes the median filtering heuristic. This objective function includes a non-local smoothness term that robustly integrates flow estimates over large spatial neighborhoods. By modifying this new term to include information about flow and image boundaries we develop a method that can better preserve motion details. To take advantage of the trend towards video in wide-screen format, we further introduce an asymmetric pyramid downsampling scheme that enables the estimation of longer range horizontal motions. The methods are evaluated on the Middlebury, MPI Sintel, and KITTI datasets using the same parameter settings.

An Improved Algorithm for Optical Flow Estimation from Color Images

Optical Flow Estimation Algorithm Using Color Gradient Invariance

An Improved HS Algorithm Based on Optimized Gradients Calculation

An Estimating Arithmetic for Improving Optical Flow Estimation of Color Imagery Based on HSV

A Method of Color Optical Flow Computation with Local and Global Model Combined

A Robust Optical Flow Computation

Color Optical Flow Estimation Based on Complex Value Wavelet

An Estimation of Complex Wavelet Optical Flow with Invariant Morphological Gradient

Optical Flow Estimation Combining Spatial-Temporal Derivatives Based Nonlinear Filtering.

A PDE-Based Method for Optical Flow Estimation

A Robust Optical Flow Estimation under Varying Illumination.

Optical Flow Estimation Between Images of Different Resolutions Via Variational Method

A new algorithm for estimating optic flow for low-level vision systems

An Iterative Method for Optical Flow Estimation with Motion Blur.

A NONLINEAR FILTERING BASED OPTICAL FLOW COMPUTATION

Models of Color Image Sequence Optical Flow with Local and Global Methods Combined

A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them

Optical Flow Computation Based On Bayesian Selecting Scheme

Adaptive Fractional-Order Multi-Scale Optimization TV-L1 Optical Flow Algorithm

Robust Optical Flow Computation: A Higher-Order Differential Approach

Optical Flow Estimation Based on Texture Constraints and Parametric Motion Model