The Research of Human-Computer Interaction Model Based on the Morhpable Model Based 3D Face Synthesis in the Speech Rehabilitation for Deaf Children
Zhao Jian,Shi Lijuan,Wang Lirong,Lin Jun,Du Qinsheng,S. V. Shalobanov
DOI: https://doi.org/10.1109/bdcloud.2015.17
2015-01-01
Abstract:The 3D face morphable model is applied in the hearing and speech rehabilitation for hearing-impaired children, put forward to 3D face morphable model is the core of special human-computer interaction model. Including 3D face, sound, vibration, air, video, gestures, etc., through the computer generate realistic 3D face expressions and motions, with corresponding voice vibration flow feedback information can be more realistic and comprehensive process of speakers is simulated. The use of data driven 3D face morphable model technology, research on multimodal human-computer interactive technology, to solve the non-artificial intervention for deaf children independent speech rehabilitation training problems. Establishment of 3D face morphable model, the establishment of visual and nonvisual integration of information synchronization algorithm, to achieve true expression to the real face of, set up for deaf children 3D face morphable model Chinese pronunciation database driven, Establish the data driven 3D face morphable model is the core of the deaf children with a computer multimodal human-computer interaction model, based on multimodal human-computer interaction model of hearing speech rehabilitation method and system on.