Abstract:In this paper, we propose spatiotemporal co-attention hybrid neural network (SC-HNN), a novel hybrid neural network model with both spatial and temporal attention mechanisms for pose-invariant inertial odometry. The main idea is to extract both local and global features from a window of IMU measurements for velocity prediction. SC-HNN leverages the convolutional neural network (CNN) to capture the sectional features and long short-term memory (LSTM) recurrent neural network (RNN) to extract the long-range dependencies. Attention mechanisms are designed and embedded in both CNN and LSTM modules for better model representation. Specifically, in the CNN attention block, the convolved features are refined along both channel and element dimensions. For the LSTM module, softmax scoring is applied to update the weights of the hidden states along the temporal axis. We evaluate SC-HNN on the benchmark with the largest and most natural IMU data, RoNIN. Extensive ablation experiments demonstrate the effectiveness of our SC-HNN model. Compared with the state of the art, the 50th percentile accuracy of SC-HNN is 18.21% higher and the 90th percentile accuracy is 21.15% higher for all the phone holders not appeared in the training set. The real scenario inertial tracking trials in the CUHK campus further prove the superior generalization ability of the SC-HNN model. Note to Practitioners—This paper aims at improving the localization accuracy of deep inertial odometry. We focus on the problem of indoor localization only from the low-cost IMU embedded in the smartphone without any restriction on the phone’s daily use. IMU is a perfect solution for indoor localization because of its low power consumption, high privacy protection, and external infrastructure free. This paper suggests a novel hybrid convolutional and recurrent neural network with a set of carefully designed attention mechanisms to improve the representation ability of deep inertial odometry model. Specifically, the convolutional layer is applied to extract the local spatial features among the 6D IMU signals, following a cascaded channel attention module and element attention module to boost the representation ability of CNN. The complex long-term dependencies are then identified by the LSTM layers. To adaptively capture the temporal features of the multimodal inertial signals, an attention mechanism is applied to weigh the hidden states for the generation of the final features. The effectiveness of the SC-HNN design is validated by extensive ablation studies. To the best of our knowledge, our model is the first HNN fused attention mechanism for inertial tracking. Extensive experiments show that the proposed method outperforms the state of the art.

IMUNet: Efficient Regression Architecture for Inertial IMU Navigation and Positioning

IMU Data Processing For Inertial Aided Navigation: A Recurrent Neural Network Based Approach

Wavelet Transform-Based Inertial Neural Network for Spatial Positioning Using Inertial Measurement Units

InertialNet: Toward Robust SLAM Via Visual Inertial Measurement.

RNIN-VIO: Robust Neural Inertial Navigation Aided Visual-Inertial Odometry in Challenging Scenes

IDOL: Inertial Deep Orientation-Estimation and Localization

InertialNet: Inertial Measurement Learning for Simultaneous Localization and Mapping

CTIN: Robust Contextual Transformer Network for Inertial Navigation

NeurIT: Pushing the Limit of Neural Inertial Tracking for Indoor Robotic IoT

A Performance Enhancement Method for Redundant IMU Based on Neural Network and Geometric Constraint

Spatiotemporal Co-Attention Hybrid Neural Network for Pedestrian Localization Based on 6D IMU

Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and On-Device Inference

RIOT: Recursive Inertial Odometry Transformer for Localisation from Low-Cost IMU Measurements

End-to-End Deep Learning Framework for Real-Time Inertial Attitude Estimation using 6DoF IMU

RoNIN: Robust Neural Inertial Navigation in the Wild: Benchmark, Evaluations, and New Methods

IMU Preintegrated Features for Efficient Deep Inertial Odometry

Inertial Navigation on Extremely Resource-Constrained Platforms: Methods, Opportunities and Challenges

Deep Learning Assisted Inertial Dead Reckoning and Fusion

Artificial Neural Network Approach to Guarantee the Positioning Accuracy of Moving Robots by Using the Integration of IMU/UWB with Motion Capture System Data Fusion

A Robust and Fast GNSS-Inertial-LiDAR Odometry With INS-Centric Multiple Modalities by IESKF

Generalizable end-to-end deep learning frameworks for real-time attitude estimation using 6DoF inertial measurement units