Abstract:Cross-modal conflict arises when information from different sensory modalities are incompatible with each other. Such conflict may influence the processing of stimuli in the task-relevant modality (and call for cognitive control to resolve this conflict). Here we investigate how reward modulates cross-modal conflict control during object categorization by manipulating reward (reward vs. no-reward) and stimuli type (visual-only vs. audio-visual congruent vs. audio-visual incongruent). In visual-only condition, only images of objects were presented. In audio-visual conditions, images of objects and sounds commonly associated with specific objects were presented simultaneously, with the image and the sound either congruent (associated with the same object) or incongruent (associated with different objects). Participants were instructed to categorize the images (animate/inanimate) and ignore the sounds while their brain activities were recorded by EEG. At the beginning of each block, a cue was presented indicating reward availability of that block. In a reward block, correct responses with RT faster than the baseline RT (mean RT of the practice trials) were rewarded, whereas in no-reward block no reward was delivered irrespective of performance. Behaviorally, reward facilitated performance in a stimuli type-dependent manner: in no-reward conditions, RTs were shorter for congruent trials than for incongruent trials; this difference was absent in reward conditions. Neurally, we found that the fronto-central N2 (240-320 ms) was larger in the incongruent condition than in the congruent condition, but only when there was no reward for performance. Time-frequency analysis revealed a conflict-related modulation of the non-phase-locked theta power over the fronto-central sites, but again, only for no-reward conditions. Taken together, our results demonstrate that reward modulates cross-modal conflict resolution and the conflict-related N2 and theta-band neural oscillations. Meeting abstract presented at VSS 2017

Distinct mechanisms underlying cross-modal semantic conflict and response conflict processing

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

The Neural Mechanisms of Semantic and Response Conflicts: an Fmri Study of Practice-Related Effects in the Stroop Task

Electrophysiological Dynamics Reveal Distinct Processing of Stimulus-Stimulus and Stimulus-Response Conflicts

Sequential and domain-specific processing mechanisms for dual cognitive-emotional conflict

Dissociable Early Attentional Control Mechanisms Underlying Cognitive and Affective Conflicts

Dissociated stimulus and response conflict effect in the Stroop task: evidence from evoked brain potentials and brain oscillations.

Brain Mechanismof Resp onse Conflict and Stimulus Conflict:Evidence from an Event-Related Potential Study

Conflict Processing Networks: A Directional Analysis of Stimulus-Response Compatibilities Using MEG.

The Dissociable Neural Dynamics of Cognitive Conflict and Emotional Conflict Control: an ERP Study

Frontal And Occipital-Parietal Alpha Oscillations Distinguish Between Stimulus Conflict And Response Conflict

Hemodynamic and electrophysiological signals of conflict processing in the Chinese-character Stroop task: a simultaneous near-infrared spectroscopy and event-related potential study.

EEG Neural Oscillatory Dynamics Reveal Semantic and Response Conflict at Difference Levels of Conflict Awareness

Conflict Processing in Schizophrenia: Dissociable neural mechanisms revealed by the N2 and frontal midline theta

Opposite Effect of Conflict Context Modulation on Neural Mechanisms of Cognitive and Affective Control.

Emotional Modulation of Conflict Processing in the Affective Domain: Evidence from Event-related Potentials and Event-related Spectral Perturbation Analysis

Auditory Dominance in Processing Chinese Semantic Abnormalities in Response to Competing Audio-visual Stimuli.

Cognitive Conflict in Audiovisual Integration: an Event-Related Potential Study.

An fMRI Study of Response and Semantic Conflict in the Stroop Task

Reward modulates cross-modal conflict

Different Stages, Different Signals: the Modulating Effect of Cognitive Conflict on Subsequent Processing.