Abstract:Previous research indicates that, under explicit instructions to listen to spoken stimuli or in speech-oriented behavioural tasks, the brain's responses to senseless pseudowords are larger than those to meaningful words; the reverse is true in non-attended conditions. These differential responses could be used as a tool to trace linguistic processes in the brain and their interaction with attention. However, as previous studies relied on explicit instructions to attend or ignore the stimuli, a technique for automatic attention modulation (i.e., not dependent on explicit instruction) would be more advantageous, especially when cooperation with instructions may not be guaranteed (e.g., neurological patients, children etc). Here we present a novel paradigm in which the stimulus context automatically draws attention to speech. In a non-attend passive auditory oddball sequence, rare words and pseudowords were presented among frequent non-speech tones of variable frequency and length. The low percentage of spoken stimuli guarantees an involuntary attention switch to them. The speech stimuli, in turn, could be disambiguated as words or pseudowords only in their end, at the last phoneme, after the attention switch would have already occurred. Our results confirmed that this paradigm can indeed be used to induce automatic shifts of attention to spoken input. At ~250ms after the stimulus onset, a P3a-like neuromagnetic deflection was registered to spoken (but not tone) stimuli indicating an involuntary attention shift. Later, after the word-pseudoword divergence point, we found a larger oddball response to pseudowords than words, best explained by neural processes of lexical search facilitated through increased attention. Furthermore, we demonstrate a breakdown of this orderly pattern of neurocognitive processes as a result of sleep deprivation. The new paradigm may thus be an efficient way to assess language comprehension processes and their dynamic interaction with those of attention allocation. It does it in an automatic and task-free fashion, indicating its potential benefit for assessing uncooperative clinical populations.

An Attention Based Model for Off-Topic Spontaneous Spoken Response Detection: an Initial Study.

Off-topic Response Detection for Spontaneous Spoken English Assessment.

Detecting Off-topic Responses to Visual Prompts

Towards automatic assessment of spontaneous spoken English

Hear Me Out: A Study on the Use of the Voice Modality for Crowdsourced Relevance Assessments

A Cross-Attention and Siamese Network Based Model for Off-Topic Detection

Temporal Attention and Consistency Measuring for Video Question Answering

Evaluating Nuanced Bias in Large Language Model Free Response Answers

Non-native Speaker Verification for Spoken Language Assessment

Robust assessment of the cortical encoding of word-level expectations using the temporal response function

Impact of ASR Performance on Free Speaking Language Assessment

An Initial Investigation of Non-Native Spoken Question-Answering

BERT-Based Automatic Scoring Model for Speech-Oriented Text Modality

A Comparative Study of Item Response Theory Models for Mixed Discrete-Continuous Responses

Attention to language: novel MEG paradigm for registering involuntary language processing in the brain

Automatic Question Tagging with Deep Neural Networks

Memory-Based Model With Multiple Attentions For Multi-Turn Response Selection

A Survey on Response Selection for Retrieval-based Dialogues.

Adapting an ASR Foundation Model for Spoken Language Assessment

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems

Automatic Fluency Assessment Method for Spontaneous Speech Without Reference Text