Abstract:Due to the lack of transparent and friendly human–robot interaction (HRI) interface, as well as various uncertainties, it is usually a challenge to remotely manipulate a robot to accomplish a complicated task. To improve the teleoperation performance, we propose a new perception mechanism by integrating a novel learning method to operate the robots in the distance. In order to enhance the perception of the teleoperation system, we utilize a surface electromyogram signal to extract the human operator’s muscle activation. As a response to the changes in the external environment, as sensed through haptic and visual feedback, a human operator naturally reacts with various muscle activations. By imitating the human behaviors in task execution, not only motion trajectory but also arm stiffness adjusted by muscle activation, it is expected that the robot would be able to carry out the repetitive tasks autonomously or uncertain tasks with improved intelligence. To this end, we develop a robot learning algorithm based on probability statistics under an integrated framework of the hidden semi-Markov model (HSMM) and the Gaussian mixture method. This method is employed to obtain a generative task model based on the robot’s trajectory. Then, Gaussian mixture regression based on HSMM is applied to correct the robot trajectory with the reproduced results from the learned task model. The execution procedures consist of a learning phase and a reproduction phase. To guarantee the stability, immersion, and maneuverability of the teleoperation system, a variable gain control method that involves electromyography (EMG) is introduced. Experimental results have demonstrated the effectiveness of the proposed method. Note to Practitioners—This paper is inspired by the limitations of teleoperation to perform a task with unfriendly HRI and lack of intelligence. The human operators need to concentrate on the manipulation in the traditional setup of a teleoperation system; thus, it is quite a labor intensive for a human operator. This is a huge challenge for the requirement of increasingly complicated, diverse tasks in teleoperation. Therefore, efficient ways of the robot intelligence need to be urgently developed for the telerobots. In this paper, we develop a robot intelligence framework by merging robot learning technology and perception mechanism. The proposed framework is effective where the task performed with repeatability and rapidity in a teleoperated mode. The proposed method includes three following ideas: 1) remote operation information can be actively sensed by infusing muscle activation with a haptics EMG perception mechanism; 2) the robot intelligence can be enhanced by employing a robot learning method. The developed approach is verified by the experimental results; and 3) the proposed method can be potentially used for telemanufacturing, teletehabilitation, and telemedicine, and so on. In our future work, more interactive information between humans and telerobots should be taken into consideration in the telerobot perception system to enhance the robot intelligence.

An Event-Related Potential-Based Adaptive Model for Telepresence Control of Humanoid Robot Motion in an Environment Cluttered with Obstacles

Development of a Human-Robot Hybrid Intelligent System Based on Brain Teleoperation and Deep Learning SLAM

Telepresence control of humanoid robot via high-frequency phase-tagged SSVEP stimuli

Comparative Study of Ssvep- and P300-Based Models for the Telepresence Control of Humanoid Robots

Behavior-Based SSVEP Hierarchical Architecture for Telepresence Control of Humanoid Robot to Achieve Full-Body Movement.

An adaptive P300 model for controlling a humanoid robot with mind

Unified Contact Model and Hybrid Motion/force Control for Teleoperated Manipulation in Unknown Environments

Control of a humanoid robot via N200 potentials

Coordinating human-robot collaboration by EEG-based human intention prediction and vigilance control

Control System of Robotic Arm Based on Steady-State Visual Evoked Potentials in Augmented Reality Scenarios

Adaptive asynchronous control system of robotic arm based on augmented reality-assisted brain–computer interface

A Brain Robot Interaction System by Fusing Human and Machine Intelligence.

Haptics Electromyogrphy Perception and Learning Enhanced Intelligence for Teleoperated Robot

Using Variable Natural Environment Brain-Computer Interface Stimuli for Real-time Humanoid Robot Navigation

Amplifying robotics capacities with a human touch: An immersive low-latency panoramic remote system

Force-Reflecting Hierarchical Approach for Human-Aided Teleoperation of NRS With Event-Triggered Local Communication

Title : Single-trial classification of the P 300 event-related potential for shaping human-robot interaction

TeleAware Robot: Designing Awareness-augmented Telepresence Robot for Remote Collaborative Locomotion

Semi-Autonomous Robotic Arm Reaching With Hybrid Gaze-Brain Machine Interface

Robust Predictive Control for EEG-Based Brain–Robot Teleoperation

A Robot Learning Method with Physiological Interface for Teleoperation Systems