Abstract:In this study, we introduce a novel framework that combines human motion parameterization from a single inertial sensor, motion synthesis from these parameters, and biped robot motion control using the synthesized motion. This framework applies advanced deep learning methods to data obtained from an IMU attached to a human subject's pelvis. This minimalistic sensor setup simplifies the data collection process, overcoming price and complexity challenges related to multi-sensor systems. We employed a Bi-LSTM encoder to estimate key human motion parameters: walking velocity and gait phase from the IMU sensor. This step is followed by a feedforward motion generator-decoder network that accurately produces lower limb joint angles and displacement corresponding to these parameters. Additionally, our method also introduces a Fourier series-based approach to generate these key motion parameters solely from user commands, specifically walking speed and gait period. Hence, the decoder can receive inputs either from the encoder or directly from the Fourier series parameter generator. The output of the decoder network is then utilized as a reference motion for the walking control of a biped robot, employing a constraint-consistent inverse dynamics control algorithm. This framework facilitates biped robot motion planning based on data from either a single inertial sensor or two user commands. The proposed method was validated through robot simulations in the MuJoco physics engine environment. The motion controller achieved an error of ≤5° in tracking the joint angles demonstrating the effectiveness of the proposed framework. This was accomplished using minimal sensor data or few user commands, marking a promising foundation for robotic control and human-robot interaction.

Implementation of singularity-free inverse kinematics for humanoid robotic arm using Bayesian optimized deep neural network

A Bio-inspired Spiking Neural Network for Control of A 4-Dof Robotic Arm

Control of Antagonistic McKibben Muscles Via a Bio-inspired Approach

Automating the Learning of Inverse Kinematics for Robotic Arms with Redundant DoFs

Whole-Body Inverse Kinematics and Operation-Oriented Motion Planning for Robot Mobile Manipulation

Real Time Control Application of the Robotic Arm Using Neural Network Based Inverse Kinematics Solution

An Attention-Based Deep Learning Approach for Inertial Motion Recognition and Estimation in Human-Robot Collaboration

Deep Convolutional Generative Adversarial Network for Inverse Kinematics of Self-Assembly Robotic Arm Based on the Depth Sensor

A Deep Learning Approach for Biped Robot Locomotion Interface Using a Single Inertial Sensor

Bio-inspired Design and Inverse Kinematics Solution of an Omnidirectional Humanoid Robotic Arm with Geometric and Load Capacity Constraints

Predefined-Time Convergent Kinematic Control of Robotic Manipulators With Unknown Models Based on Hybrid Neural Dynamics and Human Behaviors

A Deep Reinforcement Learning Approach for Dynamically Stable Inverse Kinematics of Humanoid Robots

A New Artificial Neural Network Approach in Solving Inverse Kinematics of Robotic Arm (Denso VP6242)

Data-Driven Inverse Kinematics Approximation of a Delta Robot with Stepper Motors

Kinematic Motion Retargeting via Neural Latent Optimization for Learning Sign Language

Machine Learning Driven Human Skill Transferring for Control of Anthropomorphic Manipulators

Neural-Learning Trajectory Tracking Control of Flexible-Joint Robot Manipulators with Unknown Dynamics

Deep Neural Network Approach in Human-Like Redundancy Optimization for Anthropomorphic Manipulators.

Inverse Kinematics Analysis of Humanoid Robot Arm by Fusing Denavit–Hartenberg and Screw Theory to Imitate Human Motion With Kinect

Bio-Inspired Motion Emulation for Social Robots: A Real-Time Trajectory Generation and Control Approach