Abstract:Quantitative measurement of functional and anatomical traits of 4D tongue motion in the course of speech or other lingual behaviors remains a major challenge in scientific research and clinical applications. Here, we introduce a statistical multimodal atlas of 4D tongue motion using healthy subjects, which enables a combined quantitative characterization of tongue motion in a reference anatomical configuration. This atlas framework, termed Speech Map, combines cine- and tagged-MRI in order to provide both the anatomic reference and motion information during speech. Our approach involves a series of steps including (1) construction of a common reference anatomical configuration from cine-MRI, (2) motion estimation from tagged-MRI, (3) transformation of the motion estimations to the reference anatomical configuration, and (4) computation of motion quantities such as Lagrangian strain. Using this framework, the anatomic configuration of the tongue appears motionless, while the motion fields and associated strain measurements change over the time course of speech. In addition, to form a succinct representation of the high-dimensional and complex motion fields, principal component analysis is carried out to characterize the central tendencies and variations of motion fields of our speech tasks. Our proposed method provides a platform to quantitatively and objectively explain the differences and variability of tongue motion by illuminating internal motion and strain that have so far been intractable. The findings are used to understand how tongue function for speech is limited by abnormal internal motion and strain in glossectomy patients.

Development of a 3D tongue motion visualization platform based on ultrasound image sequences

Contour-based 3d tongue motion visualization using ultrasound image sequences

Acquiring and visualizing 3D/4D ultrasound recordings of tongue motion

Real-time Ultrasound-enhanced Multimodal Imaging of Tongue using 3D Printable Stabilizer System: A Deep Learning Approach

Acoustic VR in the Mouth: A Real-Time Speech-Driven Visual Tongue System.

Visualization of mandarin articulation driven by ultrasound data

Continuous Ultrasound Based Tongue Movement Video Synthesis from Speech.

A Novel Self-adjusting Ultrasound Transducer Stabilized Elastic System Realized by 3D Printing

Speech Map: A Statistical Multimodal Atlas of 4D Tongue Motion During Speech from Tagged and Cine MR Images

3D dynamic tongue visualization based on DirectX

Ultrasound tongue imaging for diarization and alignment of child speech therapy sessions

Progress in animation of an EMA-controlled tongue model for acoustic-visual speech synthesis

A systematic review of the application of machine learning techniques to ultrasound tongue imaging analysis

Motion-Aware Robotic 3D Ultrasound

Ultra2Speech -- A Deep Learning Framework for Formant Frequency Estimation and Tracking from Ultrasound Tongue Images

Dynamic Measurement of Tongue Shape Using Ultrasonic System. Influence of Vertical Dimension of Occlusion on Tongue Shape.

A Speech-Driven 3-D Tongue Model with Realistic Movement in Mandarin Chinese.

Tongue contour extraction from ultrasound images based on deep neural network

Quantitative imaging of tongue kinematics during infant feeding and adult swallowing reveals highly conserved patterns

Stabilization Improved Ultrasound Imaging Helmet Based on Skull Feature in the Articulatory Data Observation

Reconstruction of Vocal Tract Based on Multi-Source Image Information.