Abstract:As human-robot interaction becomes more prevalent in industrial and clinical settings, detecting changes in human posture has become increasingly crucial. While recognizing human actions has been extensively studied, the transition between different postures or movements has been largely overlooked. This study explores using two deep-learning methods, the linear Feedforward Neural Network (FNN) and Long Short-Term Memory (LSTM), to detect changes in human posture among three different movements: standing, walking, and sitting. To explore the possibility of rapid posture-change detection upon human intention, the authors introduced transition stages as distinct features for the identification. During the experiment, the subject wore an inertial measurement unit (IMU) on their right leg to measure joint parameters. The measurement data were used to train the two machine learning networks, and their performances were tested. This study also examined the effect of the sampling rates on the LSTM network. The results indicate that both methods achieved high detection accuracies. Still, the LSTM model outperformed the FNN in terms of speed and accuracy, achieving 91% and 95% accuracy for data sampled at 25 Hz and 100 Hz, respectively. Additionally, the network trained for one test subject was able to detect posture changes in other subjects, demonstrating the feasibility of personalized or generalized deep learning models for detecting human intentions. The accuracies for posture transition time and identification at a sampling rate of 100 Hz were 0.17 s and 94.44%, respectively. In summary, this study achieved some good outcomes and laid a crucial foundation for the engineering application of digital twins, exoskeletons, and human intention control.

Pose Analysis of Humanoid Robot Imitation Process Based on Improved MLP Network

Motion Imitation of a Humanoid Robot Via Pose Estimation

Humanoid Robot Imitation with Pose Similarity Metric Learning

Design of Kinect-Based Human Robot Interaction Systems for A Robocup Middle Size League Soccer Robot

Whole-body humanoid robot imitation with pose similarity evaluation

RBF Network Imitation Posture Judgment Algorithm Based on Improved PSO.

Modelling Human Body Pose for Action Recognition Using Deep Neural Networks

Bi-Level Motion Imitation for Humanoid Robots

HumanMimic: Learning Natural Locomotion and Transitions for Humanoid Robot via Wasserstein Adversarial Imitation

Human Posture Transition-Time Detection Based upon Inertial Measurement Unit and Long Short-Term Memory Neural Networks

High Efficient LSTM-based Network for Human Interaction Understanding

ImitationNet: Unsupervised Human-to-Robot Motion Retargeting via Shared Latent Space

Application of Neural Network in the Stability of Biped Robot and Embedded Control of Walking Mode

Imitation Learning for Human Pose Prediction

Robot Imitation from Video Demonstration

A Human–Robot Collaboration Method Using a Pose Estimation Network for Robot Learning of Assembly Manipulation Trajectories From Demonstration Videos

Deep Neural Network Approach in Human-Like Redundancy Optimization for Anthropomorphic Manipulators.

Human motion recognition information processing system based on LSTM Recurrent Neural Network Algorithm

Real-time Pose Estimation from Images for Multiple Humanoid Robots

Utilization of multilayer perceptron for determining the inverse kinematics of an industrial robotic manipulator

Hybrid Recurrent Neural Network Architecture-Based Intention Recognition for Human-Robot Collaboration