Abstract:Robots are required to autonomously respond to changing situations. Imitation learning is a promising candidate for achieving generalization performance, and extensive results have been demonstrated in object manipulation. However, cooperative work between humans and robots is still a challenging issue because robots must control dynamic interactions among themselves, humans, and objects. Furthermore, it is difficult to follow subtle perturbations that may occur among coworkers. In this study, we find that cooperative work can be accomplished by imitation learning using bilateral control. Thanks to bilateral control, which can extract response values and command values independently, human skills to control dynamic interactions can be extracted. Then, the task of serving food is considered. The experimental results clearly demonstrate the importance of force control, and the dynamic interactions can be controlled by the inferred action force.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in human - robot collaboration, how can the robot respond autonomously to the changing environment and conduct effective dynamic interactions with humans? Specifically, the research aims to enable the robot to handle complex dynamic interaction tasks, such as cooperative tasks like carrying food, through imitation learning and bilateral control. This includes: 1. **Handling dynamic interactions**: The robot needs to conduct dynamic interactions with humans, other robots and objects. Traditional imitation learning methods usually generate trajectories only based on position information and ignore force information, so it is difficult to handle complex dynamic interactions. 2. **Adapting to fast movements**: The robot needs to be able to operate as fast as humans, especially in tasks involving fast actions, such as carrying soft or irregular - shaped objects. Traditional methods assume that the controller has a high - enough performance, so they can only work at low - speed movements. 3. **Coping with uncertainties and changes**: The robot needs to adapt to unknown objects and environmental changes, such as changes in object shape, flexibility and quantity, as well as changes in human actions. To solve these problems, the paper proposes an imitation learning method based on 4 - channel bilateral control. This method independently extracts command values and response values through bilateral control, so it can capture the skills of humans in handling dynamic interactions and can achieve high - precision force control in fast movements. The experimental results show that this method performs well when handling objects of various shapes and flexibilities and can adapt to environmental changes and changes in human actions. ### Core contributions of the paper: - **Combining position and force control**: Through 4 - channel bilateral control, joint control of position and force is achieved, enabling the robot to better handle complex dynamic interactions. - **Fast - movement ability**: This method can maintain high precision in fast movements, enabling the robot to operate as fast as humans. - **High adaptability**: Through imitation learning, the robot can adapt to objects of different shapes and flexibilities, as well as environmental and human - action changes. These improvements make the robot more robust and efficient in human - robot collaboration tasks.

Imitation Learning Based on Bilateral Control for Human-Robot Cooperation

Imitation Learning for Object Manipulation Based on Position/Force Information Using Bilateral Control

Verification of Learning Model for Dual-arm Cooperative Motion in Imitation Learning based on Bilateral Control

Bilateral Control-Based Imitation Learning for Velocity-Controlled Robot

Bi-ACT: Bilateral Control-Based Imitation Learning via Action Chunking with Transformer

A Human-Robot Co-Manipulation Approach Based on Human Sensorimotor Information

Motion Generation Using Bilateral Control-Based Imitation Learning with Autoregressive Learning

Soft and Rigid Object Grasping With Cross-Structure Hand Using Bilateral Control-Based Imitation Learning

Human-robot co-manipulation of extended objects: Data-driven models and control from analysis of human-human dyads

Skill Learning Strategy Based on Dynamic Motion Primitives for Human–Robot Cooperative Manipulation

ILBiT: Imitation Learning for Robot Using Position and Torque Information based on Bilateral Control with Transformer

Imitating by Generating: Deep Generative Models for Imitation of Interactive Tasks

Bayesian Disturbance Injection: Robust Imitation Learning of Flexible Policies for Robot Manipulation

Proactive Robot Control for Collaborative Manipulation Using Human Intent

Assist Control for Dual Arm Cooperative Manipulation by Remote Controlled Robot

Language-Conditioned Imitation Learning for Robot Manipulation Tasks

Human-in-the-Loop Imitation Learning using Remote Teleoperation

BiRP: Learning Robot Generalized Bimanual Coordination using Relative Parameterization Method on Human Demonstration

Human-robot planar co-manipulation of extended objects: data-driven models and control from human-human dyads

Imitation Learning with Limited Actions via Diffusion Planners and Deep Koopman Controllers

Model-Based Reinforcement Learning Variable Impedance Control for Human-Robot Collaboration