Integrative Wrapping System for a Dual-Arm Humanoid Robot

Yukina Iwata,Shun Hasegawa,Kento Kawaharazuka,Kei Okada,Masayuki Inaba
2024-11-13
Abstract:Flexible object manipulation of paper and cloth is a major research challenge in robot manipulation. Although there have been efforts to develop hardware that enables specific actions and to realize a single action of paper folding using sim-to-real and learning, there have been few proposals for humanoid robots and systems that enable continuous, multi-step actions of flexible materials. Wrapping an object with paper and tape is more complex and diverse than traditional manipulation research due to the increased number of objects that need to be handled, as well as the three-dimensionality of the operation. In this research, necessary information is organized and coded based on the characteristics of each object handled in wrapping. We also generalize the hardware configuration, manipulation method, and recognition system that enable humanoid wrapping operations. The system will include manipulation with admittance control focusing on paper tension and state evaluation using point clouds to handle three-dimensional flexible objects. Finally, wrapping objects with different shapes is experimented with to show the generality and effectiveness of the proposed system.
Robotics
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to solve the challenges of performing complex multi - step operations on flexible objects (such as paper and cloth) in robot manipulation, especially using a two - armed humanoid robot to complete the wrapping task. Specifically, this research focuses on the following problems: 1. **Complexity of flexible object manipulation**: - Manipulating flexible objects (such as paper, cloth) is more complex than manipulating traditional rigid objects because they are prone to deformation, folding and wrinkling. - The wrapping task involves multiple objects (target object, wrapping material, sealing material) and requires continuous multi - step operations. 2. **Limitations of existing research**: - Existing research mainly focuses on specific hardware systems or single actions (such as origami), lacking solutions applicable to general hardware systems. - Most research has failed to achieve continuous multi - step operations, especially when dealing with three - dimensional flexible objects. 3. **Advantages and challenges of humanoid robots**: - Using humanoid robots can perform multiple tasks, but it is necessary to solve the problem of how to accurately manipulate flexible objects in three - dimensional space. - It is necessary to develop an integrated system that can handle multi - object, multi - step operations and can continuously adjust and evaluate the state during the operation process. 4. **Specific challenges of the wrapping task**: - The wrapping task not only includes covering the paper on the target object, but also requires fixing the paper with tape to ensure the firmness of the package. - Each sub - step in the wrapping process depends on the successful completion of the previous step, so it is necessary to design a system that can continuously execute these steps. ### Main contributions of the paper To solve the above problems, this paper proposes an integrated wrapping system with the following characteristics: - **Symbolic representation**: By symbolically representing the target object, wrapping material and sealing material, the understanding and operation of the system are simplified. - **Hardware configuration**: A hardware configuration suitable for two - armed humanoid robots is designed, enabling them to flexibly handle flexible objects. - **Recognition and operation methods**: A recognition system based on point cloud and color information and an operation method based on impedance control are developed to ensure appropriate tension and position during the wrapping process. - **Experimental verification**: The effectiveness and universality of the system on different - shaped objects (such as cuboids and cylinders) are verified through experiments. In short, the goal of this paper is to develop an integrated system capable of handling complex flexible object manipulation, especially suitable for two - armed humanoid robots to perform the wrapping task.