Hamidreza Raei,Juan M. Gandarias,Elena De Momi,Pietro Balatti,Arash Ajoudani
Abstract:This letter introduces an innovative visuo-haptic interface to control Mobile Collaborative Robots (MCR). Thanks to a passive detachable mechanism, the interface can be attached/detached from a robot, offering two control modes: local control (attached) and teleoperation (detached). These modes are integrated with a robot whole-body controller and presented in a unified close- and far-proximity control framework for MCR. The earlier introduction of the haptic component in this interface enabled users to execute intricate loco-manipulation tasks via admittance-type control, effectively decoupling task dynamics and enhancing human capabilities. In contrast, this ongoing work proposes a novel design that integrates a visual component. This design utilizes Visual-Inertial Odometry (VIO) for teleoperation, estimating the interface's pose through stereo cameras and an Inertial Measurement Unit (IMU). The estimated pose serves as the reference for the robot's end-effector in teleoperation mode. Hence, the interface offers complete flexibility and adaptability, enabling any user to operate an MCR seamlessly without needing expert knowledge. In this letter, we primarily focus on the new visual feature, and first present a performance evaluation of different VIO-based methods for teleoperation. Next, the interface's usability is analyzed in a home-care application and compared to an alternative designed by a commercial MoCap system. Results show comparable performance in terms of accuracy, completion time, and usability. Nevertheless, the proposed interface is low-cost, poses minimal wearability constraints, and can be used anywhere and anytime without needing external devices or additional equipment, offering a versatile and accessible solution for teleoperation.
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is how to design an efficient, low - cost and user - friendly interface to achieve close - range and long - range control of mobile collaborative robots (MCR). Specifically, the paper aims to overcome the limitations of existing tele - operation interfaces, such as the dependence on external sensors or complex and expensive tracking systems, and the deficiencies in flexibility and adaptability. By introducing an innovative visual - haptic interface, this research hopes to enable users to seamlessly switch between local operation and remote operation without relying on additional settings or external devices, thereby enhancing the application potential of MCR in complex and dynamic environments.
### Summary of Main Problems:
1. **Enhancing the Applicability and Autonomy of MCR**: Although MCR has excellent manipulation and stable movement capabilities, its large - scale application is limited by the lack of autonomy. Therefore, more intelligent interfaces need to be developed to improve the decision - making and interactive autonomy of MCR in complex and dynamic environments.
2. **Designing an Efficient Tele - operation System**: Existing tele - operation interfaces have some limitations, such as dependence on external sensors, high cost, and complex setup requirements. The paper proposes a new visual - haptic interface design, aiming to eliminate these limitations and provide a more flexible, portable and cost - effective solution.
3. **Achieving Seamless Switching between Local and Remote Operations**: By introducing a detachable passive mechanism, users can freely switch between local operation (the interface is attached to the robot) and remote operation (the interface is detached from the robot) without the need for an additional drive system. This enables users to select the most appropriate operation mode according to task requirements.
4. **Evaluating the Performance of Different VIO Methods**: To ensure the effectiveness of the new interface, the paper also conducts performance evaluations of different hardware and VIO methods, comparing the performance of multiple visual - inertial odometry (VIO) techniques in tele - operation.
5. **Verifying the Feasibility of the Interface in Practical Application Scenarios**: Through experiments in home - care scenarios, the paper compares the performance of the new interface with that of commercial motion - capture systems, verifying its advantages in terms of accuracy and ease of use.
### Overview of Solutions:
- **Innovative Visual - Haptic Interface**: Combines visual (Visual - Inertial Odometry, VIO) and haptic feedback, enabling users to perform precise tele - operations through handheld devices.
- **Low - Cost Hardware**: Uses simple and inexpensive hardware (such as stereo cameras and IMU), eliminating the need for external sensors and reducing the overall cost.
- **Flexible Operation Modes**: Through the detachable mechanism, users can seamlessly switch between local and remote operations, enhancing the adaptability and flexibility of the system.
- **Performance Evaluation and Comparison**: Through performance evaluations of different VIO methods and practical application tests in home - care scenarios, the effectiveness and superiority of the new interface are proven.
In summary, this paper is committed to developing an innovative visual - haptic interface to improve the tele - operation performance of MCR and enable it to be widely used in various complex environments.