Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

3D reconstruction framework via combining one 3D scanner and multiple stereo trackers

Two-Stage Multi-Camera Constrain Mapping Pipeline for Large-Scale 3D Reconstruction

Large-scale three-dimensional measurement based on LED marker tracking

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Large-scale Three-Dimensional Measurement Via Combining 3D Scanner and Laser Rangefinder

Robust 3D Reconstruction with an RGB-D Camera

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

3D Reconstruction System for Collaborative Scanning Based on Multiple RGB-D Cameras.

Toward 3D Object Reconstruction from Stereo Images

High-precision Human Body Acquisition Via Multi-View Binocular Stereopsis

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

3D Reconstruction with Two Webcams and a Laser Line Projector

Gaze Tracking 3-D Reconstruction of Object With Large-Scale Motion

3-D Reconstruction Method for a Multiview System Based on Global Consistency

Object Reconstruction by Integrating 3D Discrete Points and Digital Images

3D Reconstruction of Unstructured Objects Using Information From Multiple Sensors

A Simple Method to Achieve Full-Field and Real-Scale Reconstruction Using a Movable Stereo Rig

A convenient 3D reconstruction model based on parallel-axis structured light system

A Scaled Monocular 3D Reconstruction Based on Structure from Motion and Multi-View Stereo

Integrated Fringe Projection 3D Scanning System for Large-Scale Metrology Based on Laser Tracker