Abstract:Although commercial motion-capture systems have been widely used in various applications, the complex setup limits their application scenarios for ordinary consumers. To overcome the drawbacks of wearability, human posture reconstruction based on a few wearable sensors have been actively studied in recent years. In this paper, we propose a deep-learning-based sparse inertial sensor human posture reconstruction method. This method uses bidirectional recurrent neural network (Bi-RNN) to build an a priori model from a large motion dataset to build human motion, thereby the low-dimensional motion measurements are mapped to whole-body posture. To improve the motion reconstruction performance for specific application scenarios, two fundamental problems in the model construction are investigated: training data selection and sparse sensor placement. The problem of deep-learning training data selection is to select independent and identically distributed (IID) data for a certain scenario from the accumulated imbalanced motion dataset with sufficient information. We formulate the data selection into an optimization problem to obtain continuous and IID data segments, which comply with a small reference dataset collected from the target scenario. A two-step heuristic algorithm is proposed to solve the data selection problem. On the other hand, the optimal sensor placement problem is studied to exploit most information from partial observation of human movement. A method for evaluating the motion information amount of any group of wearable inertial sensors based on mutual information is proposed, and a greedy searching method is adopted to obtain the approximate optimal sensor placement of a given sensor number, so that the maximum motion information and minimum redundancy is achieved. Finally, the human posture reconstruction performance is evaluated with different training data and sensor placement selection methods, and experimental results show that the proposed method takes advantages in both posture reconstruction accuracy and model training time. In the 6 sensors configuration, the posture reconstruction errors of our model for walking, running, and playing basketball are 7.25°, 8.84°, and 14.13°, respectively.

Human-posture-tracking sensor selection for motion recognition

Hand Posture Recognition and Tracking Based on Bag-of-Words for Human Robot Interaction

Human Body Recognition And Positioning With Multiple Cameras Based On "Vibration Signals" From Skin Surfaces

Full-body Human Motion Reconstruction with Sparse Joint Tracking Using Flexible Sensors

Sensor-Based Wearable Systems for Monitoring Human Motion and Posture: A Review

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition

Human posture tracking with flexible sensors for motion recognition

WristCam: A Wearable Sensor for Hand Trajectory Gesture Recognition and Intelligent Human–Robot Interaction

Human Posture Detection Method Based on Wearable Devices

Training Data Selection and Optimal Sensor Placement for Deep-Learning-Based Sparse Inertial Sensor Human Posture Reconstruction

Inertial sensors-based torso motion mode recognition for an active postural support brace*

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Research on the Human Motion Recognition Method Based on Wearable

Real-Time Human Movement Recognition Using Ultra-Wideband Sensors

Human Posture Tracking in a Multi-Camera Environment

Spatial-Related Sensors Matters: 3D Human Motion Reconstruction Assisted with Textual Semantics

Human Posture Recognition in Intelligent Healthcare

An Open-Source Platform for Human Pose Estimation and Tracking Using a Heterogeneous Multi-Sensor System

Human Posture Transition-Time Detection Based upon Inertial Measurement Unit and Long Short-Term Memory Neural Networks

DisPad: Flexible On-Body Displacement of Fabric Sensors for Robust Joint-Motion Tracking

Human Motion Tracking with Less Constraint of Initial Posture from a Single RGB-D Sensor