Abstract:Our study proposes a test of a key assumption of the most prominent model of consciousness - the global workspace (GWS) model (e.g., Baars, 2002, 2005, 2007; Dehaene & Naccache, 2001; Mudrik, Faivre, & Koch, 2014). This assumption is that multimodal integration requires consciousness; however, few studies have explicitly tested if integration can occur between nonconscious information from different modalities. The proposed study examined whether a classic indicator of multimodal integration - the McGurk effect - can be elicited with subliminal auditory-visual speech stimuli. We used a masked speech priming paradigm developed by Kouider and Dupoux (2005) in conjunction with continuous flash suppression (CFS; Tsuchiya & Koch, 2005), a binocular rivalry technique for presenting video stimuli subliminally. Applying these techniques together, we carried out two experiments in which participants categorised auditory syllable targets which were preceded by subliminal auditory-visual (AV) speech primes. Subliminal AV primes were either illusion-inducing (McGurk) or illusion-neutral (Incongruent) combinations of speech stimuli. In Experiment 1, the categorisation of the syllable target ("pa") was facilitated by the same syllable prime when it was part of a McGurk combination (auditory "pa" and visual "ka") but not when part of an Incongruent combination (auditory "pa" and visual "wa"). This dependency on specific AV combinations indicated a nonconscious AV interaction. Experiment 2 presented a different syllable target ("ta") which matched the predicted illusory outcome of the McGurk combination - here, both the McGurk combination (auditory "pa" and visual "ka") and the Incongruent combination (auditory "ta" and visual "ka") failed to facilitate target categorisation. The combined results of both Experiments demonstrate a type of nonconscious multimodal interaction that is distinct from integration - it allows unimodal information that is compatible for integration (i.e., McGurk combinations) to persist and influence later processes, but does not actually combine and alter that information. As the GWS model does not account for non-integrative multimodal interactions, this places some pressure on such models of consciousness.

Cognitive integration of asynchronous natural or non-natural auditory and visual information in videos of real-world events: an event-related potential study

Asymmetrical Cross-Modal Influence on Neural Encoding of Auditory and Visual Features in Natural Scenes.

Semantic Congruent Audiovisual Integration During the Encoding Stage of Working Memory: an ERP and Sloreta Study

Multisensory processing of naturalistic objects in motion: a high-density electrical mapping and source estimation study

Neural Processing of Naturalistic Audiovisual Events in Space and Time

Audiovisual Integration of Natural Auditory and Visual Stimuli in the Real-World Situation

The Oscillatory Activities And Its Synchronization In Auditory-Visual Integration As Revealed By Event-Related Potentials To Bimodal Stimuli

Cognitive Conflict in Audiovisual Integration: an Event-Related Potential Study.

Auditory-visual integration during nonconscious perception

Auditory-Visual Integration during Multimodal Object Recognition in Humans: A Behavioral and Electrophysiological Study

Inverted encoding of neural responses to audiovisual stimuli reveals super-additive multisensory enhancement

Spatial and Semantic Processing Between Audition and Vision: an Event-Related Potential Study

Event-related Potentials Reveal Early Visual-tactile Integration in the Deaf

Distinct Mechanism of Audiovisual Integration with Informative and Uninformative Sound in a Visual Detection Task: A DCM Study

Modulation of audiovisual integration in the left and right sides: effects of side and spatial coherency

Time-varying networks of ERPs in P300-speller paradigms based on spatially and semantically congruent audiovisual bimodality

Electrophysiological Evidence of Non-Spatial Inhibition of Return Affecting Audiovisual Integration

The Influence of the Cross-Modal Emotional Pre-Preparation Effect on Audiovisual Integration

The Effect of Visual Reliability on Auditory-Visual Integration: an Event-Related Potential Study

The Time Course Of Spatial And Semantic Processing Between Audition And Vision: Evidence From Event-Related Potentials

Neural Mechanisms for the Effect of Prior Knowledge on Audiovisual Integration.