Task Adaptation in Industrial Human-Robot Interaction: Leveraging Riemannian Motion Policies

Mike Allenspach,Michael Pantic,Rik Girod,Lionel Ott,Roland Siegwart

2024-06-25

Abstract:In real-world industrial environments, modern robots often rely on human operators for crucial decision-making and mission synthesis from individual tasks. Effective and safe collaboration between humans and robots requires systems that can adjust their motion based on human intentions, enabling dynamic task planning and adaptation. Addressing the needs of industrial applications, we propose a motion control framework that (i) removes the need for manual control of the robot's movement; (ii) facilitates the formulation and combination of complex tasks; and (iii) allows the seamless integration of human intent recognition and robot motion planning. For this purpose, we leverage a modular and purely reactive approach for task parametrization and motion generation, embodied by Riemannian Motion Policies. The effectiveness of our method is demonstrated, evaluated, and compared to \remove{state-of-the-art approaches}\add{a representative state-of-the-art approach} in experimental scenarios inspired by realistic industrial Human-Robot Interaction settings.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to achieve task adaptation in the industrial human - machine interaction environment. Specifically, in actual industrial applications, modern robots usually require human operators to make critical decisions and perform task synthesis. In order to achieve effective and safe cooperation between humans and robots, the system needs to be able to adjust its motion according to human intentions, thereby supporting dynamic task planning and adaptation. The paper proposes a motion control framework, aiming at:

1. **Eliminating the need for manual control of robots**: Reducing the operator's workload through automated motion control while retaining control rights.
2. **Facilitating the formulation and combination of complex tasks**: Enabling the system to process and combine complex tasks.
3. **Seamlessly integrating human intention recognition and robot motion planning**: Parameterizing tasks and generating motion through a modular and purely reactive approach.

To achieve these goals, the paper utilizes Riemannian Motion Policies (RMPs), a motion - generation framework based on local reactions, which provides simple and powerful mathematical and geometric consistency. The paper verifies the effectiveness of this method through experiments and compares it with existing advanced methods.

### Main contributions
1. **Designed a fully autonomous motion control framework** for dynamic task planning and adaptation.
2. **Demonstrated the effectiveness of the proposed method** and evaluated it through experiments.
3. **Discussed and compared the proposed method with existing advanced methods**.

### Technical details
#### 1. System overview
- **Robot**: The paper assumes the use of a robotic arm with a fully pose - controllable end - effector, whose configuration - space manifold \( Q \) is \( SE(3) \), and the pose and twist are represented as \( q_R\in\mathbb{R}^6 \) and \( \dot{q}_R\in\mathbb{R}^6 \) respectively.
- **RMP - based planner**: RMPs decompose the complex robot motion - generation problem into multiple independent policies, each operating on a specific manifold. These policies are mapped into the configuration space \( Q \) through pull - back operators and combined through metric - weighted averaging.
- **Human operator**: The input of the human operator is modeled as a vector for correcting the robot's motion to achieve the required task.

#### 2. Task adaptation
- **Policy likelihood**: Determine its likelihood by evaluating the degree of match between each task - specific RMP and the observed human input.
- **Policy scaling**: Adjust the importance of the policy according to the likelihood, giving priority to high - likelihood policies while reducing the importance of policies that conflict with other high - likelihood policies.

#### 3. Stability and robustness
- **Stability**: Since the motion control framework is driven by asymptotically stable motion policies and no energy is introduced from human manual control, the system is input - bounded and output - bounded stable.
- **Robustness**: Even in an uncertain environment, task adaptation can maintain stability and convergence because it is based on the instantaneous potential gradient of pre - defined task characteristics.

### Experimental setup
- **Task description**: The experiment simulates a non - destructive testing application, using a Franka Panda robotic arm and a prism - shaped end - effector. The experimental object is a cylinder with six detection points on its surface.
- **Task characteristics**:
- **RMP for maintaining normal alignment**: Ensure that the sensor is aligned with the surface normal \( n_S \).
- **RMP for maintaining distance**: Ensure a safe distance.
- **RMP for detection position**: Pull the end - effector towards each detection point.
- **RMP for detection rotation**: Rotate the sensor around \( n_S \) to the horizontal or vertical direction.

Through these settings, the paper verifies the effectiveness and robustness of the proposed motion control framework in dynamic task planning and adaptation.