Abstract:Unlike traditional visualization methods, augmented reality (AR) inserts virtual objects and information directly into digital representations of the real world, which makes these objects and data more easily understood and interactive. The integration of AR and GIS is a promising way to display spatial information in context. However, most existing AR-GIS applications only provide local spatial information in a fixed location, which is exposed to a set of problems, limited legibility, information clutter and the incomplete spatial relationships. In addition, the indoor space structure is complex and GPS is unavailable, so that indoor AR systems are further impeded by the limited capacity of these systems to detect and display location and semantic information. To address this problem, the localization technique for tracking the camera positions was fused by Bluetooth low energy (BLE) and pedestrian dead reckoning (PDR). The multi-sensor fusion-based algorithm employs a particle filter. Based on the direction and position of the phone, the spatial information is automatically registered onto a live camera view. The proposed algorithm extracts and matches a bounding box of the indoor map to a real world scene. Finally, the indoor map and semantic information were rendered into the real world, based on the real-time computed spatial relationship between the indoor map and live camera view. Experimental results demonstrate that the average positioning error of our approach is 1.47 m, and 80% of proposed method error is within approximately 1.8 m. The positioning result can effectively support that AR and indoor map fusion technique links rich indoor spatial information to real world scenes. The method is not only suitable for traditional tasks related to indoor navigation, but it is also promising method for crowdsourcing data collection and indoor map reconstruction.

Fusion of building information and range imaging for autonomous location estimation in indoor environments

A Robust Localization Approach Using Multi-Sensor Fusion

Integrated IMU with Faster R-CNN Aided Visual Measurements from IP Cameras for Indoor Positioning.

A Visual Localization System for Complex Indoor Environment

Fusion of Object Tracking and Dynamic Occupancy Grid Map

Real-Time Point Cloud Fusion of Multi-LiDAR Infrastructure Sensor Setups with Unknown Spatial Location and Orientation

2D LiDAR and Camera Fusion Using Motion Cues for Indoor Layout Estimation

Visual Localization in Urban Area Using Orthogonal Building Boundaries and a GIS Database

IMU and Multiple RGB-D Camera Fusion for Assisting Indoor Stop-and-Go 3D Terrestrial Laser Scanning

Three-Dimensional Indoor Mobile Mapping With Fusion of Two-Dimensional Laser Scanner and RGB-D Camera Data

Multi-Sensor Integration for Indoor 3D Reconstruction

Mobile augmented reality based indoor map for improving geo-visualization

A Multi-Sensor Fusion Framework for Localization Using LiDAR, IMU and RGB-DCamera

Vision-Based Indoor Localization Approach Based On Surf And Landmark

Indoor Layout Estimation by 2D LiDAR and Camera Fusion

3D Visual Reconstruction as Prior Information for First Responder Localization and Visualization

A Method of Vision Aided GNSS Positioning Using Semantic Information in Complex Urban Environment

Seamless Navigation, 3D Reconstruction, Thermographic and Semantic Mapping for Building Inspection

Fusing vision and odometry for accurate indoor robot localization

Large-Scale Indoor Camera Positioning Using Fiducial Markers