Intent capturing through multimodal inputs

Weimin Guo,Cheng Cheng,Mingkai Cheng,Yonghan Jiang,Honglin Tang

DOI: https://doi.org/10.1007/978-3-642-39330-3_26

2013-01-01

Abstract:Virtual manufacturing environments need complex and accurate 3D human-computer interaction. One main problem of current virtual environments (VEs) is the heavy overloads of the users on both cognitive and motor operational aspects. This paper investigated multimodal intent delivery and intent inferring in virtual environments. Eye gazing modality is added into virtual assembly system. Typical intents expressed by dual hands and eye gazing modalities are designed. The reliability and accuracy of eye gazing modality is examined through experiments. The experiments showed that eye gazing and hand multimodal cooperation has a great potential to enhance the naturalness and efficiency of human-computer interaction (HCI).