Abstract:Human–computer interaction cognitive behavior (HCICB) modeling faces four deficiencies: 1) lack of a standard framework model; 2) large simulation error; 3) single simulation dimension; and 4) lack of a simulation software. To solve these deficiencies, we have carried out work in four aspects. First, we construct an HCICB model with the user, system device, and environment as the core elements, which provides a unified framework for the subsequent HCICB modeling in the Military Internet of Things (MIoT) command and control (C2) system. Second, we correct visual and motion parameters in the adaptive control of thought rational module of the Cogtool model by the commander in the loop (CIL) experiment. Third, we construct a mental workload (MW) prediction model of the MIoT C2 system based on improved visual auditory cognitive psychomotor, which realizes fast, high-precision, and quantitative MW prediction. It is added as a simulation dimension for the HCICB. Fourth, we develop MwCogtool, an HCICB prediction software that can rapidly simulate typical tasks at the design and usage stages of the MIoT C2 system, and also can output six parameters, including task completion time (TCT), MW, eye movement prepare time, eye movement execution time, motion time, and cognitive time in the whole process quickly and visually. In addition, we select 20 real users and 9 typical tasks of the MIoT C2 system to carry out the CIL verification experiment. Compared with Cogtool, MwCogtool reduces the maximum simulation error in TCT of the C2 system from 45.00% to 5.58%. The consistency of simulation results with real user data reaches 0.99. The results of the MW prediction model can significantly and negatively predict the change of real users’ eye movement, and can accurately predict the trend of MW change. Simultaneously, we build a fitting model between the mean MW prediction value and eye movement parameters.

Development of the Communication Interface for the Cognitive Model of Complicated Human-Computer Interaction Task

Communication Model for Internet-Oriented 2.5D Virtual Environments

Studies on Application of HACP Protocol in Distance Learning

An Effective Communication Architecture for Collaborative Virtual Systems

Efficient communication approach in HLA-based distributed simulation for VR application

Model and implementation of a high performance collaboration supporting environment

QianLi: A Modular System for Connecting Distant Family Members Through Tacit Interaction

Human-computer Interaction Cognitive Behavior Modeling of Command and Control Systems

An effective interaction control mechanism with minor step for multidisciplinary collaborative simulation system

Towards a collaborative modeling and simulation platform on the Internet

A modular method to implement multidisciplinary CAE systems into a distributed simulation environment

Realization of Collaborative Design and Simulation Platform for Multidiscipline Virtual Prototyping

CrossTalk: Intelligent Substrates for Language-Oriented Interaction in Video-Based Communication and Collaboration

The Integration Method of Multimodal Human-Computer Interaction Framework

A collaborative platform for complex product design with an extended HLA integration architecture

A Heterogeneous Model Integration and Interoperation Approach in Distributed Collaborative Simulation Environment

An Event-Driven And Object-Oriented Framework For Human Computer Interface Of Cad System

A Study On The Run-Time Interaction Between Distributed Computational Models In Multidisciplinary Collaborative Simulation

Immersive Virtual Simulation System for Principles of Communications Based on Unity 3D

Interaction of Thoughts: Towards Mediating Task Assignment in Human-AI Cooperation with a Capability-Aware Shared Mental Model.

A Multi-modal Virtual-Real Fusion System for Multi-task Human-Computer Interaction.