Sensory Manipulation as a Countermeasure to Robot Teleoperation Delays: System and Evidence

Jing Du,William Vann,Tianyu Zhou,Yang Ye,Qi Zhu

2023-10-13

Abstract:In the field of robotics, robot teleoperation for remote or hazardous environments has become increasingly vital. A major challenge is the lag between command and action, negatively affecting operator awareness, performance, and mental strain. Even with advanced technology, mitigating these delays, especially in long-distance operations, remains challenging. Current solutions largely focus on machine-based adjustments. Yet, there's a gap in using human perceptions to improve the teleoperation experience. This paper presents a unique method of sensory manipulation to help humans adapt to such delays. Drawing from motor learning principles, it suggests that modifying sensory stimuli can lessen the perception of these delays. Instead of introducing new skills, the approach uses existing motor coordination knowledge. The aim is to minimize the need for extensive training or complex automation. A study with 41 participants explored the effects of altered haptic cues in delayed teleoperations. These cues were sourced from advanced physics engines and robot sensors. Results highlighted benefits like reduced task time and improved perceptions of visual delays. Real-time haptic feedback significantly contributed to reduced mental strain and increased confidence. This research emphasizes human adaptation as a key element in robot teleoperation, advocating for improved teleoperation efficiency via swift human adaptation, rather than solely optimizing robots for delay adjustment.

Robotics,Human-Computer Interaction

What problem does this paper attempt to address?

The paper aims to address the issues of operator situational awareness, performance, and cognitive load in robotic teleoperation caused by signal transmission delays. Specifically, the paper proposes a new method—inducing human adaptation to these delays through sensory manipulation to improve the teleoperation experience.

### Problems the Paper Attempts to Solve:
1. **Delay Issue**: In robotic teleoperation, delays are inevitable due to long-distance signal transmission and computer processing limitations. These delays severely affect the operator's task execution efficiency and control accuracy.
2. **Situational Awareness and Performance Impact**: Delays not only affect the operator's perception of the environment (situational awareness) but also increase cognitive load and may lead to operational errors.
3. **Limitations of Existing Solutions**: Current solutions mainly focus on combating delays through adjustments in the machine itself, such as predictive control and adaptive algorithms. However, these methods are limited in effectiveness under completely unpredictable delay patterns, especially when operators do not have sufficient time for training in emergency situations.

### Proposed New Method:
The paper proposes alleviating the operator's subjective perception of delays through sensory manipulation. This method draws on principles from the fields of motor learning and rehabilitation, suggesting that altering sensory stimuli can mitigate the negative effects of delays. Specifically, the study modifies tactile cues to reduce task completion time and enhance user perception of visual delays. Experimental results show that real-time tactile feedback significantly reduces cognitive load, boosts self-confidence, and decreases frustration.

### Experimental Design and Results:
- **Experimental Design**: The study designed an experiment involving 41 participants to explore the impact of modified tactile cues (generated through a high-fidelity physical engine) on teleoperation under delay conditions.
- **Results**: The results indicate that the modified tactile cues significantly reduce task time and enhance user perception of visual delays, thereby improving overall operational efficiency and user experience.

Through the above method, the paper provides a new perspective and potential solution for addressing delay issues in robotic teleoperation, emphasizing the importance of human adaptability in teleoperation.