Abstract:Purpose of research . Development of a tool for debugging intelligent control system algorithms, including the development of a vision system and planning a software trajectory for an industrial robot. Methods . To achieve this goal, a review of existing simulation tools was carried out. A protocol of contactless humanrobot interaction is presented. An algorithm for the recognition of gesture commands based on the difference of three-dimensional binary microblocks and the construction of the skeleton of the human body has been developed. An example of using the ROBOGuid software tool for imitating the motion of an industrial robot in the development and debugging of its own control methods focused on real objects is presented. Results . The use of digital twins of technological equipment to simulate and display real technological processes in a virtual environment, in the context of the formation of a new concept of Industry 4.0 and the sixth technological order, allows improving the main and auxiliary production processes, as well as analyzing, researching and evaluating the economic efficiency of new technological and technical solutions. Simulation allows the development of ergonomic ways of human interaction with mechatronic objects. The solution proposed in the work was tested on the example of working out a complex spatial contour that simulates the milling of a part. Experimental studies of the gesture command recognition algorithm proposed in the work were carried out on the publicly available UCF101 dataset, the results are compared with known approaches to recognizing human actions. Conclusion . The developed interface module was used on the example of working out a complex spatial contour that simulates the milling of a part, and the method of a contactless robot control system has shown its effectiveness and the need to develop this direction.

Java software platform for the development of advanced robotic virtual laboratories

A Labview-Based, Interactive Virtual Laboratory for Electronic Engineering Education

Infrastructure of Web-based VR-form virtual laboratory

A Case Study of Virtual Circuit Laboratory for Undergraduate Student Courses

Virtual and Remote Robotic Laboratory Using EJS, MATLAB and LabVIEW

Web-Based Interactive Virtual Laboratory System For Digital Circuit Experiment

A Framework for Java 3d Based Collaborative Virtual Environment

Semi-Contained Neutrino Events in MACRO

EJS, JIL Server, and LabVIEW: An Architecture for Rapid Development of Remote Labs

Virtual Reality Platform to Develop and Test Applications on Human-Robot Social Interaction

Virtual UR5 Robot for Online Learning of Inverse Kinematics and Independent Joint Control Validated with FSM Position Control

Robotics via Experiential Active Learning With Immersive Technology: A Pedagogical Framework Designed for Engineering Curricula

A Process Control Platform for Education in the Virtual Factory Laboratory System

Browser-based simulation for novice-friendly classroom robotics

Research and Realization of Robot Experiment System Based on Virtuality and Actuality

Intuitive Robot Integration via Virtual Reality Workspaces

A Novel Real-Time MATLAB/Simulink/LEGO EV3 Platform for Academic Use in Robotics and Computer Science

A Bioinspired Virtual Reality Toolkit for Robot-Assisted Medical Application: BioVRbot

Robotic kinematics teaching system with virtual reality, remote control and an on–site laboratory

Virtual Interface Technology in the Process of Simulation of Complex Functional Modules of Control Systems for Industrial Robots and Multi-Axis Mechatronic Systems

The Virtual Experiences Lab - a platform for global collaborative engineering and beyond