Abstract:Intra-modal apparent motion has been shown to be affected or 'captured' by information from another, task-irrelevant modality, as shown in cross-modal dynamic capture effect. Here we created inter-modal apparent motion between visual and tactile stimuli and investigated whether there are mutual influences between auditory apparent motion and inter-modal visual/tactile apparent motion. Moreover, we examined whether and how the spatial remapping between somatotopic and external reference frames of tactile events affect the cross-modal capture between auditory apparent motion and inter-modal visual/tactile apparent motion, by introducing two arm postures: arms-uncrossed and arms-crossed. In Experiment 1, we used auditory stimuli (auditory apparent motion) as distractors and inter-modal visual/tactile stimuli (inter-modal apparent motion) as targets while in Experiment 2 we reversed the distractors and targets. In Experiment 1, we found a general detrimental influence of arms-crossed posture in the task of discrimination of direction in visual/tactile stream, but in Experiment 2, the influence of arms-uncrossed posture played a significant role in modulating the inter-modal visual/tactile stimuli capturing over auditory apparent motion. In both Experiments, the synchronously presented motion streams led to noticeable directional congruency effect in judging the target motion. Among the different modality combinations, tactile to tactile apparent motion (TT) and visual to visual apparent motion (VV) are two signatures revealing the asymmetric congruency effects. When the auditory stimuli were targets, the congruency effect was largest with VV distractors, lowest with TT distractors; the pattern was reversed when the auditory stimuli were distractors. In addition, across both experiments the congruency effect in visual to tactile (VT) and tactile to visual (TV) apparent motion was intermediate between the effect-sizes in VV and TT. We replicated the above findings with a block-wise design (Experiment 3). In Experiment 4, we introduced static distractor events (visual or tactile stimulus), and found the modulation of spatial remapping of distractors upon AA motion is reduced. These findings suggest that there are mutual but a robust asymmetric influence between intra-modal auditory apparent motion and intermodal visual/tactile apparent motion. We proposed that relative reliabilities in directional information between distractor and target streams, summed over a remapping process between two spatial reference frames, determined this asymmetric influence.

Shape Representation Modulating the Effect of Motion on Visual Search Performance.

Visual Search During Dynamic Displays: Effects of Velocity and Motion Direction

Effect of Stimuli Shape on Visual Search Performance: A Selective Literature Review.

Stimulus Motion: A Basic Influence Factor in Visual Search.

The Effect of Emotion Regulation on Visual Search for Faces with Emotional Expressions

Visual Search May Not Require Target Representation in Working Memory or Long-Term Memory.

Display Movement Velocity and Dynamic Visual Search Performance

Effects of speed, motion type, and stimulus size on dynamic visual search: A study of radar human-machine interface.

Searchers adjust their eye movement dynamics to the target characteristics in natural scenes

Eye Movements During Dynamic Visual Search

Cultural Differences in Visual Search for Geometric Figures

Searching for Life Motion Signals

Visual search as an embodied process: The effects of perspective change and external reference on search performance

Visual Search Tasks: Measurement of Dynamic Visual Lobe and Relationship with Display Movement Velocity

Visual apparent motion can be modulated by task-irrelevant lexical information

Influence of social presence on eye movements in visual search tasks

Visual Search Training Benefits from the Integrative Effect of Enhanced Covert Attention and Optimized Overt Eye Movements

The Effect of Display Movement Speed on Visual Fatigue in Dynamic Visual Search Tasks

Mutual influences of intermodal visual/tactile apparent motion and auditory motion with uncrossed and crossed arms.

Dense and uniform displays facilitate the detection of salient targets

Both Cognitive Factors and Local Inhibition Mediate the Effect of a Surrounding Frame in Visual Search for Oriented Bars