Abstract:When moving around in the world, the human visual system uses both motion and form information to estimate the direction of self-motion (i.e., heading). However, little is known about cortical areas in charge of this task. This brain-imaging study addressed this question by using visual stimuli consisting of randomly distributed dot pairs oriented toward a locus on a screen (the form-defined focus of expansion [FoE]) but moved away from a different locus (the motion-defined FoE) to simulate observer translation. We first fixed the motion-defined FoE location and shifted the form-defined FoE location. We then made the locations of the motion- and the form-defined FoEs either congruent (at the same location in the display) or incongruent (on the opposite sides of the display). The motion- or the form-defined FoE shift was the same in the two types of stimuli, but the perceived heading direction shifted for the congruent, but not for the incongruent stimuli. Participants (both sexes) made a task-irrelevant (contrast discrimination) judgment during scanning. Searchlight and ROI-based multivoxel pattern analysis revealed that early visual areas V1, V2, and V3 responded to either the motion- or the form-defined FoE shift. After V3, only the dorsal areas V3a and V3B/KO responded to such shifts. Furthermore, area V3B/KO shows a significantly higher decoding accuracy for the congruent than the incongruent stimuli. Our results provide direct evidence showing that area V3B/KO does not simply respond to motion and form cues but integrates these two cues for the perception of heading.SIGNIFICANCE STATEMENT Human survival relies on accurate perception of self-motion. The visual system uses both motion (optic flow) and form cues for the perception of the direction of self-motion (heading). Although human brain areas for processing optic flow and form structure are well identified, the areas responsible for integrating these two cues for the perception of self-motion remain unknown. We conducted fMRI experiments and used multivoxel pattern analysis technique to find human brain areas that can decode the shift in heading specified by each cue alone and the two cues combined. We found that motion and form cues are first processed in the early visual areas and then are likely integrated in the higher dorsal area V3B/KO for the final estimation of heading.

Integration of Semi-Circular Canal and Otolith Cues for Direction Discrimination during Eccentric Rotations

Long-term Deficits in Motion Detection Thresholds and Spike Count Variability after Unilateral Vestibular Lesion

Neuronal Thresholds and Choice-Related Activity of Otolith Afferent Fibers During Heading Perception

Detection Thresholds of Macaque Otolith Afferents

Transformation of Spatiotemporal Dynamics in the Macaque Vestibular System from Otolith Afferents to Cortex

Direction Discrimination Thresholds of Vestibular and Cerebellar Nuclei Neurons.

How much I moved: Robust biases in self-rotation perception

Accumulation of Inertial Sensory Information in the Perception of Whole Body Yaw Rotation

Neuronal thresholds and correlations in the peripheral vestibular system during rotation discrimination

Vestibular mapping of the naturalistic head-centered motion spectrum

The Mechanism of Sensing Postural Changes in Human Ears by Numerical Simulation

Dynamic Reweighting of Visual and Vestibular Cues during Self-Motion Perception

First evidence of the link between internal and external structure of the human inner ear otolith system using 3D morphometric modeling

Visuo-Vestibular Integration for Self-Motion: Human Cortical Area V6 Prefers Forward and Congruent Stimuli

Humans gradually integrate sudden gain or loss of visual information into spatial orientation perception

Unraveling the Twist: Spatial Navigational Challenges in Cervical Dystonia

Shared neural mechanisms between imagined and perceived egocentric motion - A combined GVS and fMRI study

Investigation on biomechanical responses in bilateral semicircular canals and nystagmus in vestibulo-ocular reflex experiments under different forward-leaning angles

Intelligent analysis and measurement of semicircular canal spatial attitude

Self-Motion Versus Environmental-Motion Perception Following Rotational Vestibular Stimulation and Factors Modifying Them

Integration of Motion and Form Cues for the Perception of Self-Motion in the Human Brain