Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

Developing a Mobile Mapping System for 3D GIS and Smart City Planning

3-D Map Reconstruction in Cross-country Environment

DEVELOPING AN IMAGE BASED LOW-COST MOBILE MAPPING SYSTEM FOR GIS DATA ACQUISITION

Active use of panoramic mobile mapping systems for as built surveying and heritage documentation

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Integration of mobile laser scanning data with uav imagery for very high resolution 3 d city modeling

Crossview Mapping with Graph-based Geolocalization on City-Scale Street Maps

Digital map using augmented reality on smart devices: Motivation, design, and implementation

JOINT PROCESSING OF UAV IMAGERY AND TERRESTRIAL MOBILE MAPPING SYSTEM DATA FOR VERY HIGH RESOLUTION CITY MODELING

Development of Mobile App to Enable Local Update on Mapping API: Construction Sites Monitoring through Digital Twin

The design and realization of the spatial information acquisition system based on mobile GIS

Integration and evaluation of SLAM-based backpack mobile mapping system

Visualization of urban development 3D layout plans with augmented reality

Augmented reality and photogrammetry: A synergy to visualize physical and virtual city environments

Urban Three-dimensional (3-D) Road Surface Reconstruction Based on a Data Assimilation Algorithm Using a Mobile Laser Scanning (MLS) System

DEVELOPING A 3-D GIS MODEL FOR URBAN PLANNING. CASE STUDY: AMPANG JAYA, MALAYSIA

Automated texture mapping CityJSON 3D city models from oblique and nadir aerial imagery

THE IMPLEMENTATION OF SEMI-AUTOMATED ROAD SURFACE MARKINGS EXTRACTION SCHEMES UTILIZING MOBILE LASER SCANNED POINT CLOUDS FOR HD MAPS PRODUCTION

System Development of Making an Image Map Based on Google Earth

Fully Automated Segmentation of 2D and 3D Mobile Mapping Data for Reliable Modeling of Surface Structures Using Deep Learning

Semi-Automatic Geographic Information System Framework for Creating Photo-Realistic Digital Twin Cities to Support Autonomous Driving Research