Shared Telemanipulation with VR controllers in an anti slosh scenario

Max Grobbel,Balint Varga,Sören Hohmann

2023-09-14

Abstract:Telemanipulation has become a promising technology that combines human intelligence with robotic capabilities to perform tasks remotely. However, it faces several challenges such as insufficient transparency, low immersion, and limited feedback to the human operator. Moreover, the high cost of haptic interfaces is a major limitation for the application of telemanipulation in various fields, including elder care, where our research is focused. To address these challenges, this paper proposes the usage of nonlinear model predictive control for telemanipulation using low-cost virtual reality controllers, including multiple control goals in the objective function. The framework utilizes models for human input prediction and taskrelated models of the robot and the environment. The proposed framework is validated on an UR5e robot arm in the scenario of handling liquid without spilling. Further extensions of the framework such as pouring assistance and collision avoidance can easily be included.

Robotics,Systems and Control

What problem does this paper attempt to address?

The paper aims to address a series of challenges encountered in the application of remote operation technology, mainly including:

1. **Lack of Transparency**: Existing remote operation technologies fail to provide operators with sufficient information, leading to a lack of transparency in the operation process.
2. **Low Immersion**: Traditional remote operation methods lack a high degree of immersion, affecting the operator's perception and execution efficiency of tasks.
3. **Limited Feedback**: The current systems offer limited feedback mechanisms, which are insufficient to support the efficient completion of complex tasks.
4. **High Cost Issues**: Particularly, the high cost of haptic interfaces limits the widespread application of remote operation technology in fields such as elderly care.

To address the above issues, the paper proposes a new framework based on Nonlinear Model Predictive Control (NMPC) and low-cost virtual reality controllers. This framework utilizes human input prediction models and task-related models of the robot and environment to achieve efficient and stable remote operation by optimizing the control objective function. The experimental validation section demonstrates the application of this framework on the UR5e robotic arm, showing excellent performance in splash control when handling liquid containers. Additionally, the framework is extensible and can incorporate more auxiliary functions in the future, such as collision avoidance and pouring assistance.