Sky-GVIO: an enhanced GNSS/INS/Vision navigation with FCN-based sky-segmentation in urban canyon

Jingrong Wang,Bo Xu,Ronghe Jin,Shoujian Zhang,Kefu Gao,Jingnan Liu

2024-08-05

Abstract:Accurate, continuous, and reliable positioning is a critical component of achieving autonomous driving. However, in complex urban canyon environments, the vulnerability of a stand-alone sensor and non-line-of-sight (NLOS) caused by high buildings, trees, and elevated structures seriously affect positioning results. To address these challenges, a sky-view images segmentation algorithm based on Fully Convolutional Network (FCN) is proposed for GNSS NLOS detection. Building upon this, a novel NLOS detection and mitigation algorithm (named S-NDM) is extended to the tightly coupled Global Navigation Satellite Systems (GNSS), Inertial Measurement Units (IMU), and visual feature system which is called Sky-GVIO, with the aim of achieving continuous and accurate positioning in urban canyon environments. Furthermore, the system harmonizes Single Point Positioning (SPP) with Real-Time Kinematic (RTK) methodologies to bolster its operational versatility and resilience. In urban canyon environments, the positioning performance of S-NDM algorithm proposed in this paper is evaluated under different tightly coupled SPP-related and RTK-related models. The results exhibit that Sky-GVIO system achieves meter-level accuracy under SPP mode and sub-decimeter precision with RTK, surpassing the performance of GNSS/INS/Vision frameworks devoid of S-NDM. Additionally, the sky-view image dataset, inclusive of training and evaluation subsets, has been made publicly accessible for scholarly exploration at <a class="link-external link-https" href="https://github.com/whuwangjr/sky-view-images" rel="external noopener nofollow">this https URL</a> .

Computer Vision and Pattern Recognition,Signal Processing

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper aims to address the issue of high-precision positioning required for autonomous driving in complex urban canyon environments. Specifically, the paper proposes a sky image segmentation algorithm based on Fully Convolutional Networks (FCN) to detect Non-Line-of-Sight (NLOS) errors in Global Navigation Satellite Systems (GNSS). It also introduces a new NLOS detection and mitigation algorithm (S-NDM) and extends it to a tightly coupled GNSS/Inertial Measurement Unit (IMU)/visual feature system (Sky-GVIO). This approach achieves continuous and accurate positioning in urban canyon environments.

### Main Contributions

1. **Adaptive Sky Image Segmentation**: Introduces an adaptive sky image segmentation method based on Fully Convolutional Networks, which can adapt to different lighting conditions.
2. **Integrated GNSS/INS/Visual Model**: Proposes an integrated model that combines GNSS, INS, and visual information, and extends the S-NDM method to this model.
3. **Performance Evaluation**: Conducts a comprehensive evaluation of the effectiveness of the S-NDM algorithm under different GNSS positioning frameworks.
4. **Open-Source Sky Image Dataset**: Provides an open-source sky image dataset containing training and testing data, offering valuable resources to the research community.