Study on the Model of Control Center Large Screen's HCI Based on MMI

ZHU Quan-sheng,ZHU Zuo-xin,LI Wei-dong
DOI: https://doi.org/10.3969/j.issn.1674-3814.2011.06.003
2011-01-01
Abstract:Large screen display systems have been widely in power system control centers.As large screens are substantially different from small-sized control panels,and the human computer interaction system of the latter can not meet the requirement of the former,thus intensive special studies should be carried out for the interaction.This paper designs an HCI system for large screen displays based on MMI,which is composed of multimodal information acquisition,multimodal information recognition,information integration,and multimodal information output.At the input,the system adopts a multimodal integration model which mainly adopts phonetic information supplemented with gestures,and this pattern is more natural and practicable.Visualization and Text-To-Speech(TTS) are used in the output to display system information as graphics and voices which are easier for operators to understand.
What problem does this paper attempt to address?