Abstract:Although commercial motion-capture systems have been widely used in various applications, the complex setup limits their application scenarios for ordinary consumers. To overcome the drawbacks of wearability, human posture reconstruction based on a few wearable sensors have been actively studied in recent years. In this paper, we propose a deep-learning-based sparse inertial sensor human posture reconstruction method. This method uses bidirectional recurrent neural network (Bi-RNN) to build an a priori model from a large motion dataset to build human motion, thereby the low-dimensional motion measurements are mapped to whole-body posture. To improve the motion reconstruction performance for specific application scenarios, two fundamental problems in the model construction are investigated: training data selection and sparse sensor placement. The problem of deep-learning training data selection is to select independent and identically distributed (IID) data for a certain scenario from the accumulated imbalanced motion dataset with sufficient information. We formulate the data selection into an optimization problem to obtain continuous and IID data segments, which comply with a small reference dataset collected from the target scenario. A two-step heuristic algorithm is proposed to solve the data selection problem. On the other hand, the optimal sensor placement problem is studied to exploit most information from partial observation of human movement. A method for evaluating the motion information amount of any group of wearable inertial sensors based on mutual information is proposed, and a greedy searching method is adopted to obtain the approximate optimal sensor placement of a given sensor number, so that the maximum motion information and minimum redundancy is achieved. Finally, the human posture reconstruction performance is evaluated with different training data and sensor placement selection methods, and experimental results show that the proposed method takes advantages in both posture reconstruction accuracy and model training time. In the 6 sensors configuration, the posture reconstruction errors of our model for walking, running, and playing basketball are 7.25°, 8.84°, and 14.13°, respectively.

Design and implementation of a human posture capture system based on AHRS

Healthy Human Sitting Posture Estimation in RGB-D Scenes Using Object Context

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Human Motion Capture Using Wireless Inertial Sensors

Design and Implementation of Motion Capture System Based on Wireless Inertial Sensor

An Integrated Wireless Wearable Sensor System for Posture Recognition and Indoor Localization

Sensor network oriented human motion capture via wearable intelligent system

A Low-Cost Inertial Measurement Unit Motion Capture System for Operation Posture Collection and Recognition

Human posture detection based on human body communication with muti-carriers modulation

Design of Human Motion Detection Based on the Human Body Communication

Design and implementation of a wearable human motion capture system

Research and Implementation of Human-Computer Interaction System Based on Human Body Attitude Recognition Algorithm

Attitude Algorithm of Human Motion Capture System for Teleoperation of Humanoid Robots

A Sitting Posture Surveillance System Based on Kinect

Human pose recovery using wireless inertial measurement units

Training Data Selection and Optimal Sensor Placement for Deep-Learning-Based Sparse Inertial Sensor Human Posture Reconstruction

A Novel Method for User-Defined Human Posture Recognition Using Kinect

Networked human motion capture system based on quaternion navigation

Design and Validation of Depth Camera-Based Static Posture Assessment System

3 D Adaptive Reconstruction of Human Motion From Multi-Sensors