Abstract:Robots are widespread across diverse application contexts. Teaching robots to perform tasks, in their respective contexts, demands a high domain and programming expertise. However, robot programming faces high entry barriers due to the complexity of robot programming itself. Even for experts robot programming is a cumbersome and error-prone task where faulty robot programs can be created, causing damage when being executed on a real robot. To simplify the process of robot programming, we combine Augmented Reality (AR) with principles of end-user development. By combining them, the real environment is extended with useful virtual artifacts that can enable experts as well as non-professionals to perform complex robot programming tasks. Therefore, Simple Programming Environment in Augmented Reality with Enhanced Debugging (SPEARED) was developed as a prototype for an AR-assisted robot programming environment. SPEARED makes use of AR to project a robot as well as a programming environment onto the target working space. To evaluate our approach, expert interviews with domain experts from the area of industrial automation, robotics, and AR were performed. The experts agreed that SPEARED has the potential to enrich and ease current robot programming processes.
What problem does this paper attempt to address?
The problems that this paper attempts to solve mainly focus on simplifying the process of robot programming, especially reducing the complexity of robot programming by combining the principles of augmented reality (AR) and end - user development. Specifically, the paper proposes solutions to the following six main challenges:
1. **Program State Visualization** (Program State Visualization, C1): In robot programming, visualizing the robot in its current state and its parameters is a challenge. To verify the path trajectory, the target of the next movement, and the state of the end - effector, an intuitive visualization method is required to display context information.
2. **Root Cause Analysis** (Root Cause Analysis, C2): Programming errors may lead to unexpected changes in robot behavior, so being able to correctly perform root cause analysis is crucial for identifying and solving problems.
3. **Vendor - Specific Robot Programming Language Proficiency** (Vendor Robot Programming Language Proficiency, C3): Reduce the need for vendor - specific programming languages to facilitate programming across different brands of robots.
4. **3 - Dimensional Thinking** (3 - Dimensional Thinking, C4): Correctly determining and interpreting three - dimensional data is very important for creating effective robot programs, especially when converting between different coordinate systems.
5. **Environment - Specific Information Representation** (Environment - Specific Information, C5): Ensure that the constraints in the working environment, such as the position of physical obstacles, can be accurately represented.
6. **Modification of Existing Code** (Modification of Existing Code, C6): When dealing with existing robot program code bases, ensure that functional modifications can produce the expected behavioral changes, and that existing code parts can be imported and modified in the same way as creating new programs.
To address these challenges, the authors developed a new AR - assisted robot programming environment named SPEARED (Simple Programming Environment in Augmented Reality with Enhanced Debugging). SPEARED aims to support different stages of the robot programming process, namely design, construction, test, and deployment, while addressing the above - mentioned challenges. By using head - mounted AR devices, robot simulators, and non - AR devices, SPEARED provides an intuitive programming interface, enabling both experts and non - professionals to complete complex robot programming tasks more easily.