Abstract:Purpose This paper aims to introduce an imitation learning framework for a wheeled mobile manipulator based on dynamical movement primitives (DMPs). A novel mobile manipulator with the capability to learn from demonstration is introduced. Then, this study explains the whole process for a wheeled mobile manipulator to learn a demonstrated task and generalize to new situations. Two visual tracking controllers are designed for recording human demonstrations and monitoring robot operations. The study clarifies how human demonstrations can be learned and generalized to new situations by a wheel mobile manipulator. Design/methodology/approach The kinematic model of a mobile manipulator is analyzed. An RGB-D camera is applied to record the demonstration trajectories and observe robot operations. To avoid human demonstration behaviors going out of sight of the camera, a visual tracking controller is designed based on the kinematic model of the mobile manipulator. The demonstration trajectories are then represented by DMPs and learned by the mobile manipulator with corresponding models. Another tracking controller is designed based on the kinematic model of the mobile manipulator to monitor and modify the robot operations. Findings To verify the effectiveness of the imitation learning framework, several daily tasks are demonstrated and learned by the mobile manipulator. The results indicate that the presented approach shows good performance for a wheeled mobile manipulator to learn tasks through human demonstrations. The only thing a robot-user needs to do is to provide demonstrations, which highly facilitates the application of mobile manipulators. Originality/value The research fulfills the need for a wheeled mobile manipulator to learn tasks via demonstrations instead of manual planning. Similar approaches can be applied to mobile manipulators with different architecture.

LSTM Learn Policy from Dynamical System of Demonstration Motions for Robot Imitation Learning

COMBINATION OF AFFINE DEFORMATION AND DYNAMIC MOVEMENT PRIMITIVE IN LEARNING HUMAN MOTION FOR REDUNDANT MANIPULATOR

Fast and Stable Learning of Dynamical Systems Based on Extreme Learning Machine.

Robot Policy Improvement With Natural Evolution Strategies for Stable Nonlinear Dynamical System

Learning Lyapunov-Stable Polynomial Dynamical Systems Through Imitation

Model Predictive Optimization for Imitation Learning from Demonstrations.

Fuzzy dynamical system for robot learning motion skills from human demonstration

Mobile Robot Learning from Human Demonstrations with Nonlinear Model Predictive Control

Imitation Learning of a Wheeled Mobile Manipulator Based on Dynamical Movement Primitives.

Learning Accurate and Stable Point-to-Point Motions: A Dynamic System Approach

Imitation Learning of Human Operation Based on Visual Demonstration.

Language-Conditioned Imitation Learning for Robot Manipulation Tasks

Learning from Demonstration with Implicit Nonlinear Dynamics Models

Prompt, Plan, Perform: LLM-based Humanoid Control via Quantized Imitation Learning

Proleptic Temporal Ensemble for Improving the Speed of Robot Tasks Generated by Imitation Learning

Learning Responsive Humanoid Motion Skills from Graph-Powered Motion Matching

Bi-Level Motion Imitation for Humanoid Robots

Deterministic Generative Adversarial Imitation Learning

Biologically Inspired Motion Modeling and Neural Control for Robot Learning From Demonstrations

Learning Feasibility to Imitate Demonstrators with Different Dynamics

Imitation Learning via Simultaneous Optimization of Policies and Auxiliary Trajectories