Abstract:Optical tracking provides relatively high accuracy over a large workspace but requires line-of-sight between the camera and the markers, which may be difficult to maintain in actual applications. In contrast, inertial sensing does not require line-of-sight but is subject to drift, which may cause large cumulative errors, especially during the measurement of position. To handle cases where some or all of the markers are occluded, this paper proposes an inertial and optical sensor fusion approach in which the bias of the inertial sensors is estimated when the optical tracker provides full six degree-of-freedom (6-DOF) pose information. As long as the position of at least one marker can be tracked by the optical system, the 3-DOF position can be combined with the orientation estimated from the inertial measurements to recover the full 6-DOF pose information. When all the markers are occluded, the position tracking relies on the inertial sensors that are bias-corrected by the optical tracking system. Experiments are performed with an augmented reality head-mounted display (ARHMD) that integrates an optical tracking system (OTS) and inertial measurement unit (IMU). Experimental results show that under partial occlusion conditions, the root mean square errors (RMSE) of orientation and position are 0.04° and 0.134 mm, and under total occlusion conditions for 1 s, the orientation and position RMSE are 0.022° and 0.22 mm, respectively. Thus, the proposed sensor fusion approach can provide reliable 6-DOF pose under long-term partial occlusion and short-term total occlusion conditions.

Sensor Fusion Based Head Pose Tracking for Lightweight Flight Cockpit Systems

Sensor Fusion for Vision-Based Indoor Head Pose Tracking

Multi-sensor Data Fusion for Optical Tracking of Head Pose

Study on High Accurate and Robust Head Pose Tracker for Cockpit Environment

Sensing and Control of a Quadrotor Using a Visual Inertial Fusion Method

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

Inertial-Kinect Fusion for Robot Navigation based on the Extended Kalman Filter

Metric Sensing and Control of a Quadrotor Using a Homography-Based Visual Inertial Fusion Method.

Inertial-Aided Metric States and Surface Normal Estimation Using a Monocular Camera.

Body-Segment Orientation Estimation in Rider-Bicycle Interactions with an Un-Calibrated Monocular Camera and Wearable Gyroscopes

Fusion of Inertial and Vision Data for Accurate Tracking

An Inertial and Optical Sensor Fusion Approach for Six Degree-Of-Freedom Pose Estimation

Onboard Real-Time Multi-Sensor Pose Estimation for Indoor Quadrotor Navigation with Intermittent Communication

LIC-Fusion 2.0: LiDAR-Inertial-Camera Odometry with Sliding-Window Plane-Feature Tracking

A Low-Complexity Sensor Fusion Algorithm Based on a Fiber-Optic Gyroscope Aided Camera Pose Estimation System

Multi-sensor Fusion Method Using MARG for a Fixed-Wing Unmanned Aerial Vehicle

Research on multi-sensor data fusion for integrated navigation system

Sensor Fusion Based on Strong Tracking Filter for Augmented Reality Registration

A Marker-free Head Tracker Using Vision-based Head Pose Estimation with Adaptive Kalman Filter

Fusing Monocular Images and Sparse IMU Signals for Real-time Human Motion Capture

A Quaternion-Based Sensor Fusion Approach Using Orthogonal Observations from 9D Inertial and Magnetic Information