Abstract:When processing image sequences some representation of image motion must be derived as a first stage. The most often used representation is the optical flow field, which is a set of velocity measurements of image patterns. It is well known that it is very difficult to estimate accurate optical flow at locations in an image which correspond to scene discontinuities. What is less well known, however, is that even at the locations corresponding to smooth scene surfaces, the optical flow field often cannot be estimated accurately.Noise in the data causes many optical flow estimation techniques to give biased flow estimates. Very often there is consistent bias: the estimate tends to be an underestimate in length and to be in a direction closer to the majority of the gradients in the patch. This paper studies all three major categories of flow estimation methods—gradient-based, energy-based, and correlation methods, and it analyzes different ways of compounding one-dimensional motion estimates (image gradients, spatiotemporal frequency triplets, local correlation estimates) into two-dimensional velocity estimates, including linear and nonlinear methods.Correcting for the bias would require knowledge of the noise parameters. In many situations, however, these are difficult to estimate accurately, as they change with the dynamic imagery in unpredictable and complex ways. Thus, the bias really is a problem inherent to optical flow estimation. We argue that the bias is also integral to the human visual system. It is the cause of the illusory perception of motion in the Ouchi pattern and also explains various psychophysical studies of the perception of moving plaids.

Determining Optical Flow under Space-Varying or Time-Varying Illumination

Location Uncertainty Principle: Toward the Definition of Parameter-Free Motion Estimators

Dynamic Illumination Optical Flow Computing for Sensing Multiple Mobile Robots from a Drone.

Optical Flow Estimation Between Images of Different Resolutions Via Variational Method

A Comprehensive Evaluation on Non-deterministic Motion Estimation

Anti-Occlusion Light-Field Optical Flow Estimation Using Light-Field Super-Pixels

Calculation of 3D Motion and Structure from Optical Flow in Image Sequence

Analysis on the Optimization of Optical Flow Estimation Algorithms

Fluid flow and optical flow

Optical Flow Method for Motion Details Estimation

Physics-based Optical Flow Estimation under Varying Illumination Conditions

Visual Optical Flow Computing: Algorithms and Applications

An Improved Optical Flow Algorithm Based On Image And Flow-Driven Regularization

Optical Flow in Mostly Rigid Scenes

A Robust Optical Flow Computation

Robust computation of optical flow field with large motion

An analysis of physics-based optical flow

The Analysis and Development of Computed 2D Optical Flow Velocity Based on Phantom Data

Optical Flow Field Estimation Based on Illumination Radiation Model

Optical Flow Estimation Algorithm Using Color Gradient Invariance

The Statistics of Optical Flow