Visuoinertial and visual feedback in online steering control

Jo-Yu Liu,James R. H. Cooke,Luc P. J. Selen,W. Pieter Medendorp
DOI: https://doi.org/10.1101/2024.11.20.624619
2024-11-21
Abstract:Multisensory integration has primarily been studied in static environments, where optimal integration relies on the precision of the respective sensory modalities. However, in numerous situations, sensory information is dynamic and changes over time, due to changes in our bodily state and the surrounding environment. Given that different sensory modalities have different delays, this suggests that optimal integration may not solely depend on sensory precision but may also be affected by the delays associated with each sensory system. To investigate this hypothesis, participants (n = 22, 16 female) engaged in a continuous steering task. Participants sat on a motion platform facing a screen that displayed a cartoonish traffic scene, featuring a car traveling along a road. In the visuoinertial condition, where vestibular and somatosensory feedback were available, they were tasked with counteracting an external multi-frequency perturbation signal, which laterally perturbed the platform and the car, such that the car was kept within the center of the road. In the visual condition, the visual car was perturbed, while the motion platform remained stationary. We show that participants compensate better for the perturbation in the visuoinertial than the visual condition, particularly in the high frequency range of the perturbation. Using computational modelling, we demonstrate that this enhanced performance is partially due to the shorter delay of the vestibular modality. In this condition, participants rely more on the vestibular information, which is less delayed than the more precise but longer delayed, visual information.
Biology
What problem does this paper attempt to address?