Abstract:—This paper presents two different approaches for utilizing virtual environments to enable learning for both human and robotic students. In the first approach, we showcase a 3D interactive environment that allows a human user to learn how to interact with a virtual robot, before interaction with a physical robot. In the second approach, we present a method that utilizes a simulation environment to provide feedback to a human teacher during a training session in order to concurrently allow adaptation of the learning process for both the teacher and the robotic student. We provide details of the approaches in this paper and provide results of the learning outcomes for the two different scenarios. Index Terms —Robot learning, virtual instructors, human- robot interaction. I. INTRODUCTION As the inclusion of robotics in everyday life begins to become a reality, the capability of both humans and robots to learn from each other begins to gain in importance. Robots that are integrated into dynamic environments, such as the home, must have the ability to be taught new tasks and new objectives by their human users. And yet, we cannot assume that the human user is a skilled expert in robot interaction, or that they understand how to efficiently explain a new task without physically demonstrating the task to their robot assistant. In the early 80s, Trist [1] discussed the concept of the socio-technical system in order to formalize the reciprocal interrelationship between humans and machines. The theory states that humans can be made to adjust to technologies and technologies can correspondingly be made to adjust to humans. These adjustments must occur interdependently in order to maximum usage of technology within a social organization since processes that are optimal for humans may not be optimalfor machines. Following this sociotechnical systems approach, we seek to develop a process that allows both humans and robots to adapt together in familiar ways. This is accomplished by utilizing a virtual environment to enable learning for both human and robotic students. To create a mechanism for this learning process to occur, virtual environments function as the classroom setting. Assuming that the virtual environment implements the same physical laws as those in the real world, the learning attained thus becomes transferable. This type of training, in a high fidelity environment, not only provides the

Application of Virtual Reality in Developing the Digital Twin for an Integrated Robot Learning System

Digital Twin of Experience for Human-Robot Collaboration Through Virtual Reality

Data and model hybrid-driven virtual reality robot operating system

Digital Twin as Industrial Robots Manipulation Validation Tool

Virtual Reality based Digital Twin System for remote laboratories and online practical learning

Digital Twin for FANUC Robots: Industrial Robot Programming and Simulation Using Virtual Reality

Application of virtual reality technology and digital twin in digital media communication

Embedding Digital Twin Technology in Robotics

Robotics via Experiential Active Learning With Immersive Technology: A Pedagogical Framework Designed for Engineering Curricula

Digital Twins Utilizing XR-Technology as Robotic Training Tools

Digital twin for mobile robot modeling and simulation

R&D of a Parameterized Method for 3D Virtual Human Body Based on Anthropometry.

Research on Guidance Methods of Digital Twin Robotic Arms Based on User Interaction Experience Quantification

Application of Virtual Reality Technology in Teaching and Training System of Processing Industrial Robot

Implementation of a Virtual Reality Based Digital-Twin Robotic Minimally Invasive Surgery Simulator

Digital Twin System for Home Service Robot Based on Motion Simulation

Digital Twin: Concept of Hybrid Programming for Industrial Robots — Use Case

Development of a VR-based Manipulation System for Dual-arm Robots

How to Integrate Digital Twin and Virtual Reality in Robotics Systems? Design and Implementation for Providing Robotics Maintenance Services in Data Centers

Study of industrial interactive design system based on virtual reality teaching technology in industrial robot

Online teaching system of teleoperation robot based on digital twin model