Abstract:This paper describes the framework of a real-time simulation system to model human behavior and reactions in dangerous environments. The system utilizes the latest 3D computer animation techniques, combined with artificial intelligence, robotics and psychology, to model human behavior, reactions and decision making under expected/unexpected dangers in real-time in virtual environments. The development of the system includes: classification on the conscious/subconscious behaviors and reactions of different people; capturing different motion postures by the Eagle Digital System; establishing 3D character animation models; establishing 3D models for the scene; planning the scenario and the contents; and programming within Virtools Dev. Programming within Virtools Dev is subdivided into modeling dangerous events, modeling character's perceptions, modeling character's decision making, modeling character's movements, modeling character's interaction with environment and setting up the virtual cameras. The real-time simulation of human reactions in hazardous environments is invaluable in military defense, fire escape, rescue operation planning, traffic safety studies, and safety planning in chemical factories, the design of buildings, airplanes, ships and trains. Currently, human motion modeling can be realized through established technology, whereas to integrate perception and intelligence into virtual human's motion is still a huge undertaking. The challenges here are the synchronization of motion and intelligence, the accurate modeling of human's vision, smell, touch and hearing, the diversity and effects of emotion and personality in decision making. There are three types of software platforms which could be employed to realize the motion and intelligence within one system, and their advantages and disadvantages are discussed.

Embedded semi-physical simulation system of bomb-disposal robot

Semi-physical Experiment System and Control Strategy for Bulldozer

HumRoboSim: an Autonomous Humanoid Robot Simulation System

A Comprehensive Simulation Testbench For Aerial Robot In Dynamic Scenario Using Gazebo-Ros

Modeling and Control of General Hydraulic Excavator for Human-in-the-loop Automation

Design and Implementation of Simulation System for the Competitive Robot System

The System Design and Robotic Manipulation Skills of Dualarm Autonomous Mobile Robot for Bomb Removing

Concept and realization of semi-physical simulation for space robotic visual servoing

Research on Trajectory Planning and Autodig of Hydraulic Excavator

A Real-Time Simulation System For Excavator Controller

A Ground Experiment System of Free-floating Robot for Capturing Space Target

The Developing of Software System of Release and Urgency Block Simulation for Hazardous Material

Modeling and Simulation of Air-to-Surface Missile System

Robot Manipulation Strategy for Explosives Disposal in Cluttered Scenes

Modeling human behaviors and reactions under dangerous environment

Study on Three Dimensional Predictive Simulation System of Teleoperation for Free Flying Space Robot

Subway disaster accident simulation testing platform

Interactive Physically-Based Simulation of Roadheader Robot

Three-Dimensional Geometric-Physical Modeling of an Environment with an In-House-Developed Multi-Sensor Robotic System

An experiment system of space robot for capturing target

FC-EODR: Immersive Humanoid Dual-Arm Dexterous Explosive Ordnance Disposal Robot