Design and Implementation of Multi-modal Interaction System of Electronic Sand Table Application

Yun-xiang LING,Hou-yi YAN,Guo-hua ZHANG,Cong LU
DOI: https://doi.org/10.3969/j.issn.1673-629X.2015.02.003
2015-01-01
Abstract:Multi-modal interaction technique is an important aspect of the study of human-computer interaction. The electronic sand table using multi-modal interaction technique will provide the commander with a nature and efficient interaction,which will consumedly raise the efficiency of directing. In this paper,use the idea of modular to describe the multi-modal interaction system architecture with the elec-tronic sand table as the platform,expound mainly the method of task analysis and verification and multi-modal integration. The task man-agement unit mainly implements task analysis using extended-CTT and meta-operation verification. The multi-modal integration unit is realized based on desktop cooperation by task template matching optimization. It then introduces a prototype based on situation discus-sing.
What problem does this paper attempt to address?