Abstract:Optic flow, the retinal pattern of motion that is experience during self-motion contains information about one's direction of heading. If the visual scene contains other moving objects optic flow becomes a combination of self-motion and independent object motion. The global pattern due to self-motion is locally confounded, and the locally restricted object flow is the sum of components due to these different causal sources of motion. Nonetheless, humans are able to retrieve information from such flow accurately, including the direction of heading and the scene-relative motion of an object. One way to handle such complex flow is flow parsing, a process speculated to allow the brain's sensitivity to optic flow to separate the causal sources of retinal motion in information due to self-motion and information due to object motion. In a computational model that retrieves object and self-motion information from optic flow, we implemented such a process of causal separation based on heading likelihood maps, whose distributions indicate the consistency of parts of the flow with self-motion alone. The flow parsing allows for concurrent estimation of heading, the detection and localization of and independently moving object, and the estimation of scene-relative motion of that object. We developed a paradigm that allows the model to perform all the different estimations while systematically varying how the object contributes to the flow field. Simulations of that paradigm showed that the model replicates many aspects of human performance, including the dependence of heading estimation on object speed and how different object movements bias that estimation. Regarding object detection and motion estimation, the model's results fit human behavioral data, the latter even for flow of reduced quality.

A single coordinate framework for optic flow and binocular disparity

Optic Flow-Multiple Instantaneous Rigid Motions

The Statistics of Optical Flow

Optic flow based spatial vision in insects

A simple optical flow model explains why certain object viewpoints are special

Pitting optic flow, object motion, and biological motion against each other

Flow parsing as causal source separation: A computational model for concurrent retrieval of object and self-motion information from optic flow

Optical flow modeling and computation: A survey

Fluid flow and optical flow

Optical Flow in Mostly Rigid Scenes

A Database and Evaluation Methodology for Optical Flow

Simultaneous Higher-Order Optical Flow Estimation and Decomposition

Flow Fields: Dense Correspondence Fields for Highly Accurate Large Displacement Optical Flow Estimation

A Quantitative Analysis of Current Practices in Optical Flow Estimation and the Principles Behind Them

Determining Optical Flow under Space-Varying or Time-Varying Illumination

Visual Optical Flow Computing: Algorithms and Applications

Full Flow: Optical Flow Estimation By Global Optimization over Regular Grids

A multi-scale optical flow algorithm based on oriented smoothness constraint optimization

Principle and Prospect of Optical Flow in Three-Dimensional Micro/nano-Scale Deformation Measurement

Robust Optical Flow Computation: A Higher-Order Differential Approach

High-Resolution Optical Flow from 1D Attention and Correlation