SPREEKPAD: Audiovisual Technology for Pronunciation Training

Ilse Ravyse,Fan Ping,Hichem Sahli,Dongmei Jiang,Werner Verhelst
2008-01-01
Abstract:We propose a learning environment for children and adults with pronunciation difficulties in which they play a word game with a 3-dimensional virtual face. The facial model does not only serve as an interface for the exercises, but also gives feedback on the mouth shape and speech reproduction. The goal of the research within this project SPREEKPAD is to develop, evaluate and apply a speech learning environment in which an animated avatar facilitates the training for oral communication by creating visual speech. The scientific aim is the expl oration of analysis and synthesis techniques for the integration of audio and visual modalitie s of speech. Primarily, the project is oriented towards the stimulation of the confidence during communication of hearing impaired.
What problem does this paper attempt to address?