Abstract:Accurate and robust calibration is crucial to a multisensor fusion-based system. The calibration of heterogeneous sensors is particularly challenging because of the huge difference of the captured sensor data. On the other hand, many calibration approaches ignore temporal calibration that is in fact as important as spatial calibration. In this article, we focus on the temporal calibration of heterogeneous sensors, and the corresponding extrinsic rotation is also derived. Most existing methods are specialized for a certain sensor combination, such as an inertial measurement unit (IMU) camera or a camera-Lidar system. However, heterogeneous multisensor fusion is a tendency in the robotics area, so a unified calibration method is desired. To this end, we leverage the 3-D rotational motion feature for calibration, and auxiliary calibration boards are not needed since multiple odometry methods are available to capture 3-D sensor motion. Using a high-frequency IMU as the calibration reference, an IMU-centric scheme is designed to achieve a unified framework that adapts to various target sensors that can independently estimate 3-D rotational motion. By combining independent IMU-centric calibration pairs, an arbitrary pair of sensors can also be calibrated using the same reference IMU. Due to a novel 3-D motion correlation quantification and analysis mechanism, the temporal offset can be first estimated in real time. Given temporally aligned sensor motion, the extrinsic rotation can be derived in closed-form in the same 3-D motion correlation mechanism. Experimental results of certain sensor combinations show the accuracy and robustness of the proposed method through comparison with state-of-the-art calibration approaches, and the calibration result of a heterogeneous multisensor set demonstrates the scalability and versatility of our method.

Motion measurement using inertial sensors, ultrasonic sensors, and magnetometers with extended kalman filter for data fusion

Method for measuring non-stationary motion attitude based on MEMS-IMU array data fusion and adaptive filtering

A Dual-Linear Kalman Filter for Real-Time Orientation Determination System Using Low-Cost MEMS Sensors

Improved extended Kalman fusion method for upper limb motion estimation with inertial sensors

Cascaded Motion Estimation for Intelligent Vehicles in GNSS-Denied Scenes

Statistical Sensor Fusion of a 9-DoF MEMS IMU for Indoor Navigation

A Homography-Based Visual Inertial Fusion Method for Robust Sensing of a Micro Aerial Vehicle

A Robust Optical/inertial Data Fusion System for Motion Tracking of the Robot Manipulator

A Flexible Sensor and MIMU-Based Multisensor Wearable System for Human Motion Analysis

A Novel Adaptive Kalman Filtering Approach to Human Motion Tracking With Magnetic-Inertial Sensors

An Improved Double-Layer Kalman Filter Attitude Algorithm For Motion Capture System

Implementation and complexity analysis of orientation estimation algorithms for human body motion tracking using low-cost sensors

Tightly Coupled Algorithm of Visual Inertial Odometry and Magnetometer Fusion

Real-Time Human Motion Capture Based on Wearable Inertial Sensor Networks

Multi-sensor Data Fusion Using Adaptive Kalman Filter

MEMS Sensors Based Attitude Measurement System Using UKF

Driftless 3-D Attitude Determination and Positioning of Mobile Robots By Integration of IMU With Two RTK GPSs

High Accuracy Extend Kalman Filter for Posture Measurement Based on Attitude and Heading Reference System.

Real-Time Temporal and Rotational Calibration of Heterogeneous Sensors Using Motion Correlation Analysis

A Fusion Attitude Determination Method Based on Quaternion for MEMS Gyro/accelerometer/magnetometer

A Linear Fusion Algorithm for Attitude Determination Using Low Cost Mems-Based Sensors