Abstract:IMU based inertial tracking plays an indispensable role in many mobility centric tasks, such as robotic control, indoor navigation and virtual reality gaming. Despite its mature application in rigid machine mobility (e.g., robot and aircraft), tracking human users via mobile devices remains a fundamental challenge due to the intractable gait/posture patterns. Recent data-driven models have tackled sensor drifting, one key issue that plagues inertial tracking. However, these systems still assume the devices are held or attached to the user body with a relatively fixed posture. In practice, natural body activities may rotate/translate the device which may be mistaken as whole body movement. Such motion artifacts remain as the dominating factor that fails existing inertial tracing systems in practical uncontrolled settings. Inspired by the observation that human heads induces far less intensive movement relative to the body during walking, compared to other parts, we propose a novel multi-stage sensor fusion pipeline called DeepIT, which realizes inertial tracking by synthesizing the IMU measurements from a smartphone and an associated earbud. DeepIT introduces a data-driven reliability aware attention model, which assesses the reliability of each IMU and opportunistically synthesizes their data to mitigate the impacts of motion noise. Furthermore, DeepIT uses a reliability aware magnetometer compensation scheme to combat the angular drifting problem caused by unrestricted motion artifacts. We validate DeepIT on the first large-scale inertial navigation dataset involving both smartphone and earbud IMUs. The evaluation results show that DeepIT achieves multiple folds of accuracy improvement on the challenging uncontrolled natural walking scenarios, compared with state-of-the-art closed-form and data-driven models.

Design And Implementation Of The Imu Human Body Motion Tracking System

A Sensor Glove Based on Inertial Measurement Unit for Robot Teleoperetion.

A Scalable and Wearable Self-Sensing IMU Sensor Network for Personalized Human Motion and Deformation Capture

Design and Implementation of Motion Tracking System Based on IMU

An IoT-Enabled Telerobotic-Assisted Healthcare System Based on Inertial Motion Capture.

The Design and Implementation of Natural Human-Robot Interaction System Based on Kinect Sensor

Custom IMU-Based Wearable System for Robust 2.4 GHz Wireless Human Body Parts Orientation Tracking and 3D Movement Visualization on an Avatar

Sensor network oriented human motion capture via wearable intelligent system

Human Localization And Tracking Using Distributed Motion Sensors And An Inertial Measurement Unit

Human Motion Capture Using Wireless Inertial Sensors

Towards an Ubiquitous Motion Capture System Using Inertial MEMS Sensors and ZigBee Network

Implementation and complexity analysis of orientation estimation algorithms for human body motion tracking using low-cost sensors

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Human-centric Application in Cyber-Physical System: an Inertial-based Motion Capture and Recognition System

3D Deformation Capture Via a Configurable Self-Sensing IMU Sensor Network

Inertial Motion Tracking on Mobile and Wearable Devices: Recent Advancements and Challenges

Cost-Effective Wearable Indoor Localization and Motion Analysis via the Integration of UWB and IMU

HMM-based IMU Data Processing for Arm Gesture Classification and Motion Tracking

Robust Inertial Motion Tracking Through Deep Sensor Fusion Across Smart Earbuds and Smartphone.

An Efficient Wireless Sensor Network for Real-Time Multiuser Motion Capture System

Ultra Inertial Poser: Scalable Motion Capture and Tracking from Sparse Inertial Sensors and Ultra-Wideband Ranging