The effect of visual speech cues on neural tracking of speech in 10‐month‐old infants
Melis Çetinçelik,Antonia Jordan‐Barros,Caroline F. Rowland,Tineke M. Snijders
DOI: https://doi.org/10.1111/ejn.16492
IF: 3.698
2024-08-30
European Journal of Neuroscience
Abstract:This study examined whether visual speech cues, such as the lip, jaw, and larynx movements of a speaker, facilitate 10‐month‐old infants' neural tracking of speech. We recorded continuous electroencephalography while infants watched videos of a speaker either showing the full face or with the mouth and jaw area occluded by a block. The results showed that infants tracked speech at stress and syllabic frequency rates, but there were no significant differences in neural speech tracking between the conditions with and without visible visual speech cues, suggesting that infants' neural tracking of speech may not be significantly affected by the presence of visual speech cues. While infants' sensitivity to visual speech cues and the benefit of these cues have been well‐established by behavioural studies, there is little evidence on the effect of visual speech cues on infants' neural processing of continuous auditory speech. In this study, we investigated whether visual speech cues, such as the movements of the lips, jaw, and larynx, facilitate infants' neural speech tracking. Ten‐month‐old Dutch‐learning infants watched videos of a speaker reciting passages in infant‐directed speech while electroencephalography (EEG) was recorded. In the videos, either the full face of the speaker was displayed or the speaker's mouth and jaw were masked with a block, obstructing the visual speech cues. To assess neural tracking, speech‐brain coherence (SBC) was calculated, focusing particularly on the stress and syllabic rates (1–1.75 and 2.5–3.5 Hz respectively in our stimuli). First, overall, SBC was compared to surrogate data, and then, differences in SBC in the two conditions were tested at the frequencies of interest. Our results indicated that infants show significant tracking at both stress and syllabic rates. However, no differences were identified between the two conditions, meaning that infants' neural tracking was not modulated further by the presence of visual speech cues. Furthermore, we demonstrated that infants' neural tracking of low‐frequency information is related to their subsequent vocabulary development at 18 months. Overall, this study provides evidence that infants' neural tracking of speech is not necessarily impaired when visual speech cues are not fully visible and that neural tracking may be a potential mechanism in successful language acquisition.
neurosciences