Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

Towards automatic digital documentation and progress reporting of mechanical construction pipes using smartphones

Point Cloud and Machine Learning-Based Automated Recognition and Measurement of Corrugated Pipes and Rebars for Large Precast Concrete Beams

Automated generation of FE mesh of concrete structures from 3D point cloud using computer vision technology

3D Reconstruction of Small-diameter Pipes Inner Surface Based on Structural Light

Automatic Detection and Modeling of Underground Pipes Using a Portable 3D LiDAR System

A 3D Reconstruction Pipeline of Urban Drainage Pipes Based on MultiviewImage Matching Using Low-Cost Panoramic Video Cameras

Monocular Video Frame Optimization Through Feature-Based Parallax Analysis for 3D Pipe Reconstruction

Automated Progress Controlling and Monitoring Using Daily Site Images and Building Information Modelling

Acquiring Semantic Information of Precast Concrete Pipe Using Geometric Feature Extraction from Mobile Laser Scanning Point Cloud

3D modelling of industrial piping systems using digital photogrammetry and laser scanning

Automatic Recognition of Common Structural Elements from Point Clouds for Automated Progress Monitoring and Dimensional Quality Control in Reinforced Concrete Construction

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

A Mobile Augmented Reality System for the Real-Time Visualization of Pipes in Point Cloud Data with a Depth Sensor

THE APPLICATION OF SMARTPHONE BASED STRUCTURE FROM MOTION (SFM) PHOTOGRAMMETRY IN GROUND VOLUME MEASUREMENT

Sewer defect instance segmentation, localization, and 3D reconstruction for sewer floating capsule robots

3D Pipe Network Reconstruction Based on Structure from Motion with Incremental Conic Shape Detection and Cylindrical Constraint

The Combined Use of Terrestrial Laser Scanner and Handheld 3D Scanner for 3D Modeling of Piping Instrumentation at Oil and Gas Company

Smart rebar progress monitoring using 3D point cloud model

On Building Pipe Network Operation Management Using Cloud Computing and Building Information Modeling

Evaluation of the State-of-the-Art Automated Construction Progress Monitoring and Control Systems

Monitoring road base course construction progress by photogrammetry-based 3D reconstruction