Robust and accurate visual geo-localization using prior map constructed by handheld LiDAR SLAM with camera image and terrestrial LiDAR point cloud
Zhiyuan Yang Jing Li Haitao Wu Sisi Zlatanova Weiwei Wang Jonathan Fox Banghui Yang Yong Tang Ruizhuo Zhang Jianhua Gong Xinpeng Wang Jiahui Wang Yuzhu Wang Shuhao Sun a International Research Center of Big Data for Sustainable Development Goals,Beijing,People's Republic of Chinab Key Laboratory of Digital Earth Science,Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing,People's Republic of Chinac National Engineering Research Center for Geoinformatics,Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing,People's Republic of Chinad College of Resources and Environment,University of Chinese Academy of Sciences,Beijing,People's Republic of Chinae Aerospace Information Research Institute,Chinese Academy of Sciences,Beijing,People's Republic of Chinaf School of Built Environment,Arts,Design Architecture,UNSW Sydney,Sydney,Australiag Qilu Research Institute,Shandong,People's Republic of Chinah College of Resources,Environment and Tourism,Capital Normal University,Beijing,People's Republic of Chinai Key Laboratory of 3D Information Acquisition and Application,Ministry of Education,Capital Normal University,Beijing,People's Republic of Chinaj School of Information Engineering,China University of Geosciences,Beijing,People's Republic of Chinak School of Geology and Geomatics,Tianjin Chengjian University,Tianjin,People's Republic of China
DOI: https://doi.org/10.1080/17538947.2024.2416468
IF: 4.606
2024-10-22
International Journal of Digital Earth
Abstract:Visual geo-localization using prior map of known environments has extensive applications in the fields such as self-driving, augmented reality and navigation. Currently, such prior maps are usually constructed by visual SLAM or SFM. However, the recent advances in LiDAR SLAM technology with RGB camera demonstrate great potential in efficient and accurate prior map construction and visual geo-localization. In this research, we developed a novel prior map construction approach which seamlessly integrates a handheld LiDAR SLAM system, a global LiDAR localization algorithm and a sparse set of terrestrial LiDAR scans as accurate control within a factor graph optimization framework. The developed LiDAR SLAM system augmented by terrestrial LiDAR scans achieves an improved mapping accuracy of 8 cm under GNSS-denied conditions in the areas over 50,000 m 2 while the state-of-art FAST-LIO2 alone fails and produces a mapping error over 30 m. The results show that a competitive accuracy of visual geo-localization on a mobile phone using the constructed prior map is achieved (i.e. 60 and 76 cm in two tests respectively). Finally, this work also demonstrates a novel LiDAR point cloud fusion method that produces optimized and consistent coarse-to-fine 3D reconstruction in large and complex scenes.
geography, physical,remote sensing