Planning Human-Robot Co-manipulation with Human Motor Control Objectives and Multi-component Reaching Strategies

Kevin Haninger,Luka Peternel
2024-12-18
Abstract:For successful goal-directed human-robot interaction, the robot should adapt to the intentions and actions of the collaborating human. This can be supported by musculoskeletal or data-driven human models, where the former are limited to lower-level functioning such as ergonomics, and the latter have limited generalizability or data efficiency. What is missing, is the inclusion of human motor control models that can provide generalizable human behavior estimates and integrate into robot planning methods. We use well-studied models from human motor control based on the speed-accuracy and cost-benefit trade-offs to plan collaborative robot motions. In these models, the human trajectory minimizes an objective function, a formulation we adapt to numerical trajectory optimization. This can then be extended with constraints and new variables to realize collaborative motion planning and goal estimation. We deploy this model, as well as a multi-component movement strategy, in physical collaboration with uncertain goal-reaching and synchronized motion tasks, showing the ability of the approach to produce human-like trajectories over a range of conditions.
Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to enable robots to adapt to human motion intentions in human - robot collaboration. Specifically, the author aims to improve the collaborative behavior planning of robots by introducing a model based on the principles of human motion control. The following are the key problems that this paper attempts to solve: 1. **Lack of general human behavior estimation**: Existing musculoskeletal or data - driven human models are either limited to low - level functions (such as ergonomics) or have limited generalization ability and data efficiency. Therefore, a method that can provide general human behavior estimation and can be combined with robot planning methods is required. 2. **Optimize collaborative robot actions**: Optimize the motion trajectories of collaborative robots by using human motion control models based on speed - accuracy and cost - benefit trade - offs. These models can minimize an objective function, which can be adjusted through numerical trajectory optimization, thereby achieving collaborative motion planning and target estimation. 3. **Handle uncertainty and synchronization tasks**: In physical collaboration, especially in tasks with uncertain targets and synchronous motions, demonstrate that this method can generate human - like trajectories. ### Specific problem description #### 1. Incorporating human motion control models - **Problem**: How to incorporate human motion control models into robot planning to improve the understanding and prediction ability of human behaviors. - **Solution**: Utilize the existing research results on speed - accuracy and cost - benefit trade - offs to construct an optimization framework, enabling robots to adjust their actions according to these principles. #### 2. Multi - component reaching strategies - **Problem**: How to decompose human motion into multiple sub - motions in complex situations for local optimization of different purposes. - **Solution**: A multi - component motion strategy is proposed, in which the initial (ballistic) sub - motion is faster but less accurate, while the final (corrective) sub - motion is slower but more accurate. #### 3. Experimental verification - **Problem**: How to verify whether the proposed model conforms to the actual human motion characteristics. - **Solution**: The speed distribution of the model under different target widths and distances and the applicability of Fitts' law are verified through experiments. At the same time, the application effects in collaborative tasks, such as synchronization and authority transfer, are demonstrated. ### Mathematical formula representation In order to better understand the above problems and their solutions, the following are the Markdown representations of some key formulas: 1. **Objective function**: \[ J(\tau(t)) = E_{q, \dot{q}, \tau} \left[ \int_0^\infty e^{-t/\gamma} R(q, g) - \nu \|\tau(t)\|^2 \, dt \right] \] where: - \( q \in \mathbb{R}^{n_q} \) is the human joint position - \( \dot{q} \) is the joint velocity - \( x_{ee}(q) \in \mathbb{R}^3 \) is the end - effector position - \( g \in \mathbb{R}^3 \) is the target position - \( W \in \mathbb{R}^3 \) is the target radius - \( \gamma \) is the time discount factor - \( \nu \) is the metabolic cost weight factor 2. **Dynamics equation**: \[ M(q) \ddot{q} + D(\dot{q}) + G(q) = \tau (I + \epsilon) \] where: - \( M(q) \) is the inertia matrix - \( D(\dot{q}) \) is the damping matrix - \( G(q) \) is the gravity term - \( \epsilon \sim N(0, \kappa) \) is the neural noise 3. **Reward function**: \[ R(x_{ee}) = \frac{1}{\sqrt{2\pi |W|}} \exp \left( -\frac{