Goal-Oriented End-User Programming of Robots

David Porfirio,Mark Roberts,Laura M. Hiatt

DOI: https://doi.org/10.1145/3610977.3634974

2024-03-21

Abstract:End-user programming (EUP) tools must balance user control with the robot's ability to plan and act autonomously. Many existing task-oriented EUP tools enforce a specific level of control, e.g., by requiring that users hand-craft detailed sequences of actions, rather than offering users the flexibility to choose the level of task detail they wish to express. We thereby created a novel EUP system, Polaris, that in contrast to most existing EUP tools, uses goal predicates as the fundamental building block of programs. Users can thereby express high-level robot objectives or lower-level checkpoints at their choosing, while an off-the-shelf task planner fills in any remaining program detail. To ensure that goal-specified programs adhere to user expectations of robot behavior, Polaris is equipped with a Plan Visualizer that exposes the planner's output to the user before runtime. In what follows, we describe our design of Polaris and its evaluation with 32 human participants. Our results support the Plan Visualizer's ability to help users craft higher-quality programs. Furthermore, there are strong associations between user perception of the robot and Plan Visualizer usage, and evidence that robot familiarity has a key role in shaping user experience.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to design an End - User Programming (EUP) tool in human - robot interaction that can fully utilize the robot's autonomous ability while giving users enough flexibility. Specifically, most existing EUP tools require users to write the action sequences of robots in detail, which limits the users' flexibility and may not match the users' actual needs. For example, in a nursing scenario, a nurse needs the robot to deliver lunch to a resident without having to specify each step in detail (such as going to the cafeteria, taking a tray, waiting for food, etc.). Instead, the nurse can utilize the robot's autonomous planning ability and achieve the task simply by providing the target state (such as "lunch has been delivered").

To solve these problems, the author proposes a goal - oriented EUP system named Polaris. The main features of Polaris are as follows:

1. **Goal Predicates as Basic Building Blocks**: Users can omit the specific details of achieving a particular effect (i.e., "target state" or simply "target") by selecting and parameterizing goal predicates.
2. **Flexible Task Description**: Users can choose low - supervision (expressing the fewest goals and letting the robot solve the details on its own) or high - supervision (specifying more details to constrain the robot) according to their domain knowledge.
3. **Plan Visualization**: Polaris includes a Plan Visualizer, which shows the content of the plan to the user before running to ensure that the plan meets the user's expectations.

Through these designs, Polaris aims to balance the relationship between user control and robot autonomous planning, improve the user's ability to create high - quality programs, and enhance the user experience.