Abstract:In the realm of robotics and automation, robot teleoperation, which facilitates human–machine interaction in distant or hazardous settings, has surged in significance. A persistent issue in this domain is the delays between command issuance and action execution, causing negative repercussions on operator situational awareness, performance, and cognitive load. These delays, particularly in long-distance operations, are difficult to mitigate even with the most advanced computing advancements. Current solutions mainly revolve around machine-based adjustments to combat these delays. However, a notable lacuna remains in harnessing human perceptions for an enhanced subjective teleoperation experience. This paper introduces a novel approach of sensory manipulation for induced human adaptation in delayed teleoperation. Drawing from motor learning and rehabilitation principles, it is posited that strategic sensory manipulation, via altered sensory stimuli, can mitigate the subjective feeling of these delays. The focus is not on introducing new skills or adapting to novel conditions; rather, it leverages prior motor coordination experience in the context of delays. The objective is to reduce the need for extensive training or sophisticated automation designs. A human-centered experiment involving 41 participants was conducted to examine the effects of modified haptic cues in teleoperations with delays. These cues were generated from high-fidelity physics engines using parameters from robot-end sensors or physics engine simulations. The results underscored several benefits, notably the considerable reduction in task time and enhanced user perceptions about visual delays. Real-time haptic feedback, or the anchoring method, emerged as a significant contributor to these benefits, showcasing reduced cognitive load, bolstered self-confidence, and minimized frustration. Beyond the prevalent methods of automation design and training, this research underscores induced human adaptation as a pivotal avenue in robot teleoperation. It seeks to enhance teleoperation efficacy through rapid human adaptation, offering insights beyond just optimizing robotic systems for delay compensations.

Network Traffic Reduction in Six Degree-of-freedom Haptic, Telementoring Systems

Prediction-Based Haptic Data Reduction And Transmission In Telementoring Systems

Robust Perception-Based Data Reduction And Transmission In Telehaptic Systems

Data Analysis on Virtual Stiffness in 6dofs Haptic Rendering System

Six-degree-of-freedom Haptic Rendering Using Translational and Generalized Penetration Depth Computation.

Cross-Modal Transmission with Active Packet Loss and Restoration for Tactile Internet

Haptic rendering method based on generalized penetration depth computation.

A Lightweight Haptic Interface for Hand-to-Object Tasks with Spatiotemporal Displays

A Review on Haptic Bilateral Teleoperation Systems

Conveying Surroundings Information of a Robot End-Effector by Adjusting Controller Button Stiffness

Congestion Control for Network-Aware Telehaptic Communication

Compensating Device Inertia For 6-Dof Haptic Rendering

Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable Robot

Virtual Reality Based Tactile Sensing Enhancements for Bilateral Teleoperation System with In-Hand Manipulation

Haptic Interactions Subject to Variable Latency

Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance

A new impedance force control of a haptic teleoperation system for improved transparency

A Proxy Method for Real-Time 3-DOF Haptic Rendering of Streaming Point Cloud Data

Optimal Haptic Communications Over Nanonetworks for E-Health Systems

Bi-directional Momentum-based Haptic Feedback and Control System for Dexterous Telemanipulation

Sensory manipulation as a countermeasure to robot teleoperation delays: system and evidence