Abstract:We present a new computational model of speech motor control: the Feedback-Aware Control of Tasks in Speech or <em>FACTS</em> model. FACTS employs a hierarchical state feedback control architecture to control simulated vocal tract and produce intelligible speech. The model includes higher-level control of speech tasks and lower-level control of speech articulators. The task controller is modeled as a dynamical system governing the creation of desired constrictions in the vocal tract, after Task Dynamics. Both the task and articulatory controllers rely on an internal estimate of the current state of the vocal tract to generate motor commands. This estimate is derived, based on efference copy of applied controls, from a forward model that predicts both the next vocal tract state as well as expected auditory and somatosensory feedback. A comparison between predicted feedback and actual feedback is then used to update the internal state prediction. FACTS is able to qualitatively replicate many characteristics of the human speech system: the model is robust to noise in both the sensory and motor pathways, is relatively unaffected by a loss of auditory feedback but is more significantly impacted by the loss of somatosensory feedback, and responds appropriately to externally-imposed alterations of auditory and somatosensory feedback. The model also replicates previously hypothesized trade-offs between reliance on auditory and somatosensory feedback and shows for the first time how this relationship may be mediated by acuity in each sensory domain. These results have important implications for our understanding of the speech motor control system in humans.Speaking is one of the most complex motor tasks humans perform, but it's neural and computational bases are not well understood. We present a new computational model that generates speech movements by comparing high-level language production goals with an internal estimate of the current state of the vocal tract. This model reproduces many key human behaviors, including making appropriate responses to multiple types of external perturbations to sensory feedback, and makes a number of novel predictions about the speech motor system. These results have implications for our understanding of healthy speech as well as speech impairments caused by neurological disorders. They also suggest that the mechanisms of control are shared between speech and other motor domains.

Sensory Error Drives Fine Motor Adjustment

A Neural Basis For Auditory Feedback Control Of Vocal Pitch

Neurophysiologic Study on Sensorimotor Control Mechanism of Echolocating Bat, Eptesicuc Fuscus

Doppler-shift Compensation Behavior in Horseshoe Bats Revisited: Auditory Feedback Controls Both a Decrease and an Increase in Call Frequency.

Active Listening for Spatial Orientation in a Complex Auditory Scene

Top-down Vocal Feedback Control in Active Hearing.

Neurophysiological Study on Sensorimotor Control Mechanism in Superior Colliculus of Echolocating Bat

Vocal error monitoring in the primate auditory cortex

Linking Cortical Morphology to Interindividual Variability in Auditory Feedback Control of Vocal Production

Decoding Target Range from Sensori-motor Neuron Activities in Echolocating Bat Superior Colliculus

Neural representation of vocalization self-monitoring in the bat auditory midbrain

Rapid sensorimotor adaptation to auditory midbrain silencing in free-flying bats

Vocal Responses to Frequency Modulated Composite Sinewaves Via Auditory and Vibrotactile Pathways

Audiomotor prediction errors drive speech adaptation even in the absence of overt movement

Action Enhances Acoustic Cues for 3-D Target Localization by Echolocating Bats

Motor compensations, not sensory errors, regulate serial dependence in naturalistic speech production

The FACTS model of speech motor control: Fusing state estimation and task-based control

Specialization of the auditory system for the processing of bio-sonar information in the frequency domain: Mustached bats

Role of auditory feedback for vocal production learning in the Egyptian fruit bat

A Neural Mechanism for Detecting the Distance of a Selected Target by Modulating the FM Sweep Rate of Biosonar in Echolocation of Bat

Attention Modulates Cortical Processing of Pitch Feedback Errors in Voice Control