Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

VIDAR: Data Quality Improvement for Monocular 3D Reconstruction Through In-situ Visual Interaction

In-Hand 3D Object Reconstruction from a Monocular RGB Video

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Visual Odometry Based 3D-Reconstruction

Mobile3DRecon: Real-time Monocular 3D Reconstruction on a Mobile Phone

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Real-time Underwater 3D Reconstruction Based on Monocular Image

VI3DRM:Towards meticulous 3D Reconstruction from Sparse Views via Photo-Realistic Novel View Synthesis

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Incremental Dense Reconstruction from Monocular Video with Guided Sparse Feature Volume Fusion

Real-Time 3D Reconstruction Method Based on Monocular Vision

VisFusion: Visibility-aware Online 3D Scene Reconstruction from Videos

A novel no-sensors 3D model reconstruction from monocular video frames for a dynamic environment

SST: Real-time End-to-end Monocular 3D Reconstruction via Sparse Spatial-Temporal Guidance

2L3: Lifting Imperfect Generated 2D Images into Accurate 3D

RobustFusion: Robust Volumetric Performance Reconstruction under Human-object Interactions from Monocular RGBD Stream

Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video

A New Volumetric Fusion Strategy with Adaptive Weight Field for RGB-D Reconstruction

Improving RGB-D-based 3D Reconstruction by Combining Voxels and Points

HVOFusion: Incremental Mesh Reconstruction Using Hybrid Voxel Octree

Visualization pipeline of autonomous driving scenes based on FCCR-3D reconstruction