Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

A new room decoration assistance system based on 3D reconstruction and integrated service

The Design and Development of A Full Range of Display System for 3d Images Based on Android Smartphone

3D Virtual Walkthrough System Based on Web Services

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

A 3D Reconstruction and Visualization App Using Monocular Vision Service.

Construction of interior design platform based on 3D virtual vision and wireless network

Mobile3DRecon: Real-time Monocular 3D Reconstruction on a Mobile Phone

Image-Based Walkthrough over Internet on Mobile Devices.

Live Three-Dimensional Reconstruction System with Stereo Vision Display

Online 3D Presentation System for Goods

Home Environment Augmented Reality System Based on 3D Reconstruction of a Single Furniture Picture

Old House New Home: Facilitating Interior Design with RedesignUS in Virtual Reality

Research and Implementation of Web-based Mobile Phone Customized System

3D Communication System Integrating 3D Reconstruction and Rendering Display

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

Scene-Planning System Based on Augmented Reality Technique

Design and implementation of 3D scene walkthrough system based on augmented reality

Artificial Intelligence Technology for Interactive Mobile Devices and Its Application in 3D Visual Design

Real-time cloud-based 3D reconstruction and interaction with a stereo smartphone

Research and Implementation of 3D Virtual Digital Pavilion Based on Web

Design and Implementation of Three Dimensional Virtual Roaming System for Modern Park