Raúl Calderón-Sesmero,Jaime Duque-Domingo,Jaime Gómez-García-Bermejo,Eduardo Zalama
Abstract:The growing demand for projects with collaborative robots, known as "cobots", underlines the need to efficiently address the execution of tasks with speed and flexibility, without neglecting safety in human–robot interaction. In general terms, this practice requires knowledge of robotics programming and skill in the use of hardware. The proposed solution consists of a mixed reality (MR) application integrated into a mixed reality head-mounted device (HMD) that accelerates the process of programming the complex manoeuvres of a cobot. This advancement is achieved through voice and gesture recognition, in addition to the use of digital panels. This allows any user, regardless of his or her robotics experience, to work more efficiently. The Robot Operating System (ROS) platform monitors the cobot and manages the transfer of data between the two. The system uses QR (Quick Response) codes to establish a precise frame of reference. This solution has proven its applicability in industrial processes, by automating manoeuvres and receiving positive feedback from users who have evaluated its performance. This solution promises to revolutionize the programming and operation of cobots, and pave the way for efficient and accessible collaborative robotics.
engineering, electrical & electronic,computer science, information systems,physics, applied
What problem does this paper attempt to address?
The paper primarily aims to address the complexity and efficiency issues of programming collaborative robots (cobots) in industrial environments, especially for non-professional users. Specifically, the paper proposes a method to simplify the trajectory planning of collaborative robots using Mixed Reality (MR) technology.
The main problems the paper attempts to solve are as follows:
1. **Lowering the Programming Threshold**: Existing collaborative robot programming methods typically require specialized knowledge and skills, such as robot programming languages and hardware operation techniques. This limits the use by non-professional users and increases the cost and time for companies to train employees.
2. **Improving Programming Efficiency**: Traditional hand-guided programming methods, while intuitive, have many limitations in practical operations, such as joint inertia and uncontrolled movements, the size and weight of the robot, etc. These factors make the programming process inefficient and prone to errors.
3. **Enhancing User Experience**: Some existing remote control solutions may not be intuitive enough and lack close integration with the physical environment, leading to inaccurate user perception of the robot's working range, and the layout of elements in the virtual environment may not match the actual situation.
To address the above challenges, the paper proposes an innovative human-machine interaction interface based on a Mixed Reality Head-Mounted Device (HMD). This interface accelerates the complex motion programming of collaborative robots through voice recognition, gesture recognition, and digital panels. This method allows any user, regardless of their robot programming experience, to operate more efficiently. Additionally, the system uses Quick Response (QR) codes to establish precise reference frames and employs the Robot Operating System (ROS) to monitor the collaborative robot and manage data transmission.
In summary, the paper aims to develop an easy-to-use, intuitive, and efficient Mixed Reality application for the trajectory planning of collaborative robots, to promote human-machine interaction and improve flexibility and safety in industrial production.