Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

Mobile Imaging and Computing for Intelligent Structural Damage Inspection

A Framework for Digital Twin of Civil Infrastructure— Challenges & Opportunities

Computer vision and deep learning-based post-earthquake intelligent assessment of engineering structures: Technological status and challenges

Application of Computer Vision Technology to Structural Health Monitoring of Engineering Structures

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Automated damage detection of bridge’s sub-surface defects from infrared images using machine learning

Smartphone-based structural crack detection using pruned fully convolutional networks and edge computing

Damage detection with image processing: a comparative study

Automated Damage Localization and Quantification in Concrete Bridges Using Point Cloud-Based Surface-Fitting Strategy

Fast and Robust Structural Damage Analysis of Civil Infrastructure Using UAV Imagery

Computer-Aided Road Inspection: Systems and Algorithms

Rapid Building Damage Assessment System Using Mobile Phone Technology

Distributed Displacement Response Investigation Technique for Bridge Structures Using Smartphones

Concrete Surface Damage Volume Measurement Based on Three-Dimensional Reconstruction by Smartphones

3D vision technologies for a self-developed structural external crack damage recognition robot

An Integrated Framework for Image Acquisition, Processing, and Analysis Procedures for Automated Damage Evaluation of Concrete Surfaces

Bridge Damage Detection Approach Using a Roving Camera Technique

Building defect inspection and data management using computer vision, augmented reality, and BIM technology

In-situ observation and calibration for structure safety diagnosis through finite element analysis and mixed reality

Automatic identification method of bridge structure damage area based on digital image

A novel intelligent inspection robot with deep stereo vision for three-dimensional concrete damage detection and quantification