Abstract:As elucidated by prior research, children with hearing loss have impaired vocal emotion recognition compared with their normal-hearing peers. Cochlear implants (CIs) have achieved significant success in facilitating hearing and speech abilities for people with severe-to-profound sensorineural hearing loss. However, due to the current limitations in neuroimaging tools, existing research has been unable to detail the neural processing for perception and the recognition of vocal emotions during early stage CI use in infant and toddler CI users (ITCI). In the present study, functional near-infrared spectroscopy (fNIRS) imaging was employed during preoperative and postoperative tests to describe the early neural processing of perception in prelingual deaf ITCIs and their recognition of four vocal emotions (fear, anger, happiness, and neutral). The results revealed that the cortical response elicited by vocal emotional stimulation on the left pre-motor and supplementary motor area (pre-SMA), right middle temporal gyrus (MTG), and right superior temporal gyrus (STG) were significantly different between preoperative and postoperative tests. These findings indicate differences between the preoperative and postoperative neural processing associated with vocal emotional stimulation. Further results revealed that the recognition of vocal emotional stimuli appeared in the right supramarginal gyrus (SMG) after CI implantation, and the response elicited by fear was significantly greater than the response elicited by anger, indicating a negative bias. These findings indicate that the development of emotional bias and the development of emotional perception and recognition capabilities in ITCIs occur on a different timeline and involve different neural processing from those in normal-hearing peers. To assess the speech perception and production abilities, the Infant-Toddler Meaningful Auditory Integration Scale (IT-MAIS) and Speech Intelligibility Rating (SIR) were used. The results revealed no significant differences between preoperative and postoperative tests. Finally, the correlates of the neurobehavioral results were investigated, and the results demonstrated that the preoperative response of the right SMG to anger stimuli was significantly and positively correlated with the evaluation of postoperative behavioral outcomes. And the postoperative response of the right SMG to anger stimuli was significantly and negatively correlated with the evaluation of postoperative behavioral outcomes.

Prosody-Based Vocal Emotional Alignment in Infant-Caregiver Interaction

Inherent Emotional Feature Extraction of Neonatal Cry

Discrimination of Emotional Prosodies in Human Neonates: A Pilot Fnirs Study.

Exploring Spatio-Temporal Representations by Integrating Attention-based Bidirectional-LSTM-RNNs and FCNs for Speech Emotion Recognition

Self-attention Transfer Networks for Speech Emotion Recognition

Sounds elicit relative left frontal alpha activity in 2-month-old infants.

Measuring Mother-Infant Emotions By Audio Sensing

Development of the neural processing of vocal emotion during the first year of life

Recognition of Infant's Emotions and Needs from Speech Signals.

Caregiver reactions to babbling organize turn‐taking interactions: Facilitative effects of vocal versus non‐vocal responses

Implicit Learning and Emotional Responses in Nine-Month-old Infants

Neonatal sensitivity to vocal emotions: A developmental change at 37 weeks of gestational age

Auditory observation of infant-directed speech by mothers: experience-dependent interaction between language and emotion in the basal ganglia

Functional connectivity during facial and vocal emotion recognition: Preliminary evidence for dissociations in developmental change by nonverbal modality

Voice emotion recognition by cochlear-implanted children and their normally-hearing peers

Proactive or reactive? Neural oscillatory insight into the leader-follower dynamics of early infant-caregiver interaction

The Neural Processing of Vocal Emotion After Hearing Reconstruction in Prelingual Deaf Children: A Functional Near-Infrared Spectroscopy Brain Imaging Study

Do infants discriminate non-linguistic vocal expressions of positive emotions?

Evidence for a Caregiving Instinct: Rapid Differentiation of Infant from Adult Vocalizations Using Magnetoencephalography

Prosody Analysis And Modeling For Emotional Speech Synthesis

Research on Chinese Speech Emotion Recognition Based on Deep Neural Network and Acoustic Features