Abstract:At around 7 months of age, human infants begin to reliably produce well-formed syllables containing both consonants and vowels, a behavior called canonical babbling. Over subsequent months, the frequency of canonical babbling continues to increase. How the infant's nervous system supports the acquisition of this ability is unknown. Here we present a computational model that combines a spiking neural network, reinforcement-modulated spike-timing-dependent plasticity, and a human-like vocal tract to simulate the acquisition of canonical babbling. Like human infants, the model's frequency of canonical babbling gradually increases. The model is rewarded when it produces a sound that is more auditorily salient than sounds it has previously produced. This is consistent with data from human infants indicating that contingent adult responses shape infant behavior and with data from deaf and tracheostomized infants indicating that hearing, including hearing one's own vocalizations, is critical for canonical babbling development. Reward receipt increases the level of dopamine in the neural network. The neural network contains a reservoir with recurrent connections and two motor neuron groups, one agonist and one antagonist, which control the masseter and orbicularis oris muscles, promoting or inhibiting mouth closure. The model learns to increase the number of salient, syllabic sounds it produces by adjusting the base level of muscle activation and increasing their range of activity. Our results support the possibility that through dopamine-modulated spike-timing-dependent plasticity, the motor cortex learns to harness its natural oscillations in activity in order to produce syllabic sounds. It thus suggests that learning to produce rhythmic mouth movements for speech production may be supported by general cortical learning mechanisms. The model makes several testable predictions and has implications for our understanding not only of how syllabic vocalizations develop in infancy but also for our understanding of how they may have evolved.

Learning Model-Based F0 Production Through Goal-Directed Babbling

Experiment on pitch target approximation model for generating Mandarin F0 contour

A Model-Based Learning Process for Modeling Coarticulation of Human Speech

Decoding the dancing of the tongue: A model-based learning approach to phonetic targets in coarticulationa)

Decoding the Dancing of the Tongue: A Model-Based Learning Approach to Phonetic Targets in Coarticulation

Modeling Tone and Intonation in Mandarin and English As a Process of Target Approximation.

Artificial Vocal Learning Guided by Speech Recognition: What It May Tell Us about How Children Learn to Speak

Functional-oriented Articulatory Modeling of Tones and Intonations

Auditive Learning Based Chinese F0 Prediction

Simulating Articulatory Trajectories with Phonological Feature Interpolation

Learning to Produce Syllabic Speech Sounds via Reward-Modulated Neural Plasticity

Simulating Post-L F0 Bouncing By Modeling Articulatory Dynamics

Modeling F0 Trajectories in Hierarchically Structured Deep Neural Networks.

Learning Prosodic Focus from Continuous Speech Input: A Neural Network Exploration

Improving F0 prediction using bidirectional associative memories and syllable-level F0 features for HMM-based Mandarin speech synthesis

Toward Invariant Functional Representations of Variable Surface Fundamental Frequency Contours: Synthesizing Speech Melody Via Model-Based Stochastic Learning

A Hierarchical F0 Modeling Method for HMM-based Speech Synthesis

Unsupervised Inference of Physiologically Meaningful Articulatory Trajectories with VocalTractLab

Emergent Jaw Predominance in Vocal Development through Stochastic Optimization

The Challenges of Developing Articulatory Synthesis Models of Early Vocal Production in Humans

Investigation of Prosodie FO Layers in Hierarchical FO Modeling for HMM-based Speech Synthesis