Abstract:The growing interest and the market for indoor Location Based Service (LBS) have been drivers for a huge demand for building data and reconstructing and updating of indoor maps in recent years. The traditional static surveying and mapping methods can’t meet the requirements for accuracy, efficiency and productivity in a complicated indoor environment. Utilizing a Simultaneous Localization and Mapping (SLAM)-based mapping system with ranging and/or camera sensors providing point cloud data for the maps is an auspicious alternative to solve such challenges. There are various kinds of implementations with different sensors, for instance LiDAR, depth cameras, event cameras, etc. Due to the different budgets, the hardware investments and the accuracy requirements of indoor maps are diverse. However, limited studies on evaluation of these mapping systems are available to offer a guideline of appropriate hardware selection. In this paper we try to characterize them and provide some extensive references for SLAM or mapping system selection for different applications. Two different indoor scenes (a L shaped corridor and an open style library) were selected to review and compare three different mapping systems, namely: (1) a commercial Matterport system equipped with depth cameras; (2) SLAMMER: a high accuracy small footprint LiDAR with a fusion of hector-slam and graph-slam approaches; and (3) NAVIS: a low-cost large footprint LiDAR with Improved Maximum Likelihood Estimation (IMLE) algorithm developed by the Finnish Geospatial Research Institute (FGI). Firstly, an L shaped corridor (2nd floor of FGI) with approximately 80 m length was selected as the testing field for Matterport testing. Due to the lack of quantitative evaluation of Matterport indoor mapping performance, we attempted to characterize the pros and cons of the system by carrying out six field tests with different settings. The results showed that the mapping trajectory would influence the final mapping results and therefore, there was optimal Matterport configuration for better indoor mapping results. Secondly, a medium-size indoor environment (the FGI open library) was selected for evaluation of the mapping accuracy of these three indoor mapping technologies: SLAMMER, NAVIS and Matterport. Indoor referenced maps were collected with a small footprint Terrestrial Laser Scanner (TLS) and using spherical registration targets. The 2D indoor maps generated by these three mapping technologies were assessed by comparing them with the reference 2D map for accuracy evaluation; two feature selection methods were also utilized for the evaluation: interactive selection and minimum bounding rectangles (MBRs) selection. The mapping RMS errors of SLAMMER, NAVIS and Matterport were 2.0 cm, 3.9 cm and 4.4 cm, respectively, for the interactively selected features, and the corresponding values using MBR features were 1.7 cm, 3.2 cm and 4.7 cm. The corresponding detection rates for the feature points were 100%, 98.9%, 92.3% for the interactive selected features and 100%, 97.3% and 94.7% for the automated processing. The results indicated that the accuracy of all the evaluated systems could generate indoor map at centimeter-level, but also variation of the density and quality of collected point clouds determined the applicability of a system into a specific LBS.

A Realistic Evaluation and Comparison of Indoor Location Technologies: Experiences and Lessons Learned

The Microsoft Indoor Localization Competition: Experiences and Lessons Learned

The Wisdom of 1,170 Teams: Lessons and Experiences from a Large Indoor Localization Competition

A Review of Smartphones‐based Indoor Positioning: Challenges and Applications

Off-Line Evaluation of Indoor Positioning Systems in Different Scenarios: The Experiences From IPIN 2020 Competition

Real-Time and Accurate Acoustic Indoor Localization with A Smartphone

Theories and Methods for Indoor Positioning Systems: A Comparative Analysis, Challenges, and Prospective Measures

A Review of Indoor Localization Methods Leveraging Smartphone Sensors and Spatial Context

Evaluation of An Indoor Localization Engine

The Accuracy Comparison of Three Simultaneous Localization and Mapping (SLAM)-Based Indoor Mapping Technologies

The Technology of Crowd-Sourcing Landmarks-Assisted Smartphone in Indoor Localization

Experience: Practical Indoor Localization for Malls.

A Performance Comparison between Different Industrial Real-Time Indoor Localization Systems for Mobile Platforms

A Survey of 3D Indoor Localization Systems and Technologies

A Survey of Indoor Localization Systems and Technologies

Towards Ubiquitous Indoor Localization Service Leveraging Environmental Physical Features

On Indoor Localization Using WiFi, BLE, UWB, and IMU Technologies

Robust, cost-effective and scalable localization in large indoor areas

A Three-Dimensional Wireless Indoor Localization System

BLE-Based Indoor Localization: Analysis of Some Solutions for Performance Improvement

A Real Independent Centimeter-Grade 3D Indoor Localization System on Smartphone