Abstract:Understanding human intentions is critical for safe and effective human-robot collaboration. While state of the art methods for human goal prediction utilize learned models to account for the uncertainty of human motion data, that data is inherently stochastic and high variance, hindering those models' utility for interactions requiring coordination, including safety-critical or close-proximity tasks. Our key insight is that robot teammates can deliberately configure shared workspaces prior to interaction in order to reduce the variance in human motion, realizing classifier-agnostic improvements in goal prediction. In this work, we present an algorithmic approach for a robot to arrange physical objects and project "virtual obstacles" using augmented reality in shared human-robot workspaces, optimizing for human legibility over a given set of tasks. We compare our approach against other workspace arrangement strategies using two human-subjects studies, one in a virtual 2D navigation domain and the other in a live tabletop manipulation domain involving a robotic manipulator arm. We evaluate the accuracy of human motion prediction models learned from each condition, demonstrating that our workspace optimization technique with virtual obstacles leads to higher robot prediction accuracy using less training data.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how robots can more accurately predict human action intentions in human - robot collaborative tasks. Specifically, due to the inherent randomness and high variance of human action data, the practicality of existing human - goal prediction models in tasks requiring coordination (such as safety - critical or close - range tasks) is limited. To improve this situation, the paper proposes an algorithmic approach. By arranging physical objects in the shared workspace by the robot and projecting "virtual obstacles" using augmented reality technology, the legibility of human actions is optimized, thereby improving the accuracy of the robot's prediction of human goals. ### Main Contributions 1. **Algorithm Development**: Proposed an optimization algorithm for placing physical and virtual objects in the shared human - robot workspace to maximize the legibility of human actions. 2. **Experimental Verification**: Through two actual human - subject experiments (one in the virtual 2D navigation domain and the other in the actual desktop - operation domain), the effectiveness of this algorithm was verified, proving that it can influence human behavior and thus improve the accuracy of the robot's prediction model. ### Solutions - **Environment Design**: By optimizing the workspace configuration, the uncertainty of human actions is reduced, making human behavior more predictable. - **Augmented Reality Technology**: Use augmented reality technology to project virtual obstacles, further constraining the possible action paths of humans without the need for additional changes to the physical environment. - **Quality - Diversity Algorithm**: Use the Multi - Dimensional Archive of Phenotypic Elites (MAP - Elites) algorithm to efficiently explore complex workspace configurations and find the environmental settings that are most likely to induce legible behavior. ### Mathematical Models - **Legibility Score**: \[ \text{EnvLegibility}(G_{\text{true}})=\begin{cases}-c|\xi_{S\rightarrow Q}|, & \text{if }\arg\max_{G\in G}P(G|\xi_{S\rightarrow Q})\neq G_{\text{true}}\\ \text{margin}(G|\xi_{S\rightarrow Q}) = G(n)-G(n - 1), & \text{otherwise} \end{cases} \] where \(G\) is the set of valid goals at the current time step, \(G_{\text{true}}\) is the human's true goal, \(c\) is a fixed penalty cost, \(|\xi_{S\rightarrow Q}|\) is the length of the sampled human trajectory, and \(\text{margin}(G|\xi_{S\rightarrow Q})\) is the difference between the two highest probabilities. - **Optimization Objective**: \[ \max\sum_{T'\in\text{permutations}(T)}1\{\text{valid}(T')\}\times\sum_{t\in T'}\sum_{G\in G}\text{EnvLegibility}(G) \] where \(T'\) is a valid sub - task sequence, \(T\) is all sub - tasks of the task, and \(G\) is the set of valid goals at a given time step. ### Experimental Results - **Overcooked Experiment**: In the virtual 2D navigation environment, by comparing four different workspace configurations (random, efficient, legible - efficient, legible), it was verified that the optimized environment can improve the accuracy of human - goal prediction. - **Desktop Experiment**: In the actual desktop - operation environment, by comparing the baseline condition and the optimized conditions (rearranging cubes only, projecting virtual obstacles only, optimizing both simultaneously), the effectiveness of the algorithm was further verified. In conclusion, this paper significantly improves the accuracy of robots' prediction of human goals by optimizing the configuration of the human - robot shared workspace, providing new ideas for achieving safer and more efficient collaboration.

Workspace Optimization Techniques to Improve Prediction of Human Motion During Human-Robot Collaboration

Improving Human Legibility in Collaborative Robot Tasks through Augmented Reality and Workspace Preparation

Goal Set Inverse Optimal Control and Iterative Re-planning for Predicting Human Reaching Motions in Shared Workspaces

Human Arm Motion Prediction for Collision Avoidance in a Shared Workspace

Motion Prediction with Gaussian Processes for Safe Human-Robot Interaction in Virtual Environments

Motion Prediction With Gaussian Processes for Safe Human–Robot Interaction in Virtual Environments

A Short-term Motion Prediction Approach for Guaranteed Collision-Free Planning.

Enhanced Human-Robot Collaboration using Constrained Probabilistic Human-Motion Prediction

A Universal Self-Adaption Workspace Mapping Method for Human–Robot Interaction Using Kinect Sensor Data

Experimental Evaluation of Human Motion Prediction: Toward Safe and Efficient Human Robot Collaboration

Data Driven Models for Human Motion Prediction in Human-Robot Collaboration

A Spatio-Temporal Transformer Network for Human Motion Prediction in Human-Robot Collaboration

Integrating Uncertainty-Aware Human Motion Prediction into Graph-Based Manipulator Motion Planning

Collaborative Behavior Models for Optimized Human-Robot Teamwork

A Hybrid Human Motion Prediction Approach For Human-Robot Collaboration

Enhancing Robotic Collaborative Tasks Through Contextual Human Motion Prediction and Intention Inference

Planning Coordinated Human-Robot Motions with Neural Network Full-Body Prediction Models

Fast human motion prediction for human-robot collaboration with wearable interfaces

Collaborative Interaction Models for Optimized Human-Robot Teamwork.

Adaptive Motion Planning for a Collaborative Robot Based on Prediction Uncertainty to Enhance Human Safety and Work Efficiency

Prediction-Based Human-Robot Collaboration in Assembly Tasks Using a Learning from Demonstration Model