Abstract:We present a novel online 3D scanning system for high-quality object reconstruction with a mobile device, called Mobile3DScanner. Using a mobile device equipped with an embedded RGBD camera, our system provides online 3D object reconstruction capability for users to acquire high-quality textured 3D object models. Starting with a simultaneous pose tracking and TSDF fusion module, our system allows users to scan an object with a mobile device to get a 3D model for real-time preview. After the real-time scanning process is completed, the scanned 3D model is globally optimized and mapped with multi-view textures as an efficient postprocess to get the final textured 3D model on the mobile device. Unlike most existing state-of-the-art systems which can only scan homeware objects such as toys with small dimensions due to the limited computation and memory resources of mobile platforms, our system can reconstruct objects with large dimensions such as statues. We propose a novel visual-inertial ICP approach to achieve real-time accurate 6DoF pose tracking of each incoming frame on the front end, while maintaining a keyframe pool on the back end where the keyframe poses are optimized by local BA. Simultaneously, the keyframe depth maps are fused by the optimized poses to a TSDF model in real-time. Especially, we propose a novel adaptive voxel resizing strategy to solve the out-of-memory problem of large dimension TSDF fusion on mobile platforms. In the post-process, the keyframe poses are globally optimized and the keyframe depth maps are optimized and fused to obtain a final object model with more accurate geometry. The experiments with quantitative and qualitative evaluation demonstrate the effectiveness of the proposed 3D scanning system based on a mobile device, which can successfully achieve online high-quality 3D reconstruction of natural objects with larger dimensions for efficient AR content creation.

Demo: A Novel 3D Environment-Aware Digital Twin Online Channel Modeling Platform

Demo: Scalable Digital Twin System for Mobile Networks with Generative AI

Demo: BuildTwin: Towards Real-Time High-Fidelity Digital Twin for Smart Building Management

ThreeDWorld: A Platform for Interactive Multi-Modal Physical Simulation

Dynamic Data-Driven Digital Twin Testbed for Enhanced First Responder Training and Communication

Digital Twin of a Network and Operating Environment Using Augmented Reality

42.4L: Late‐News Paper: Footprint of Scalable 3D Telecommunication: Using Integral Light Field Display and Kinect‐based Capture

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Rapid 3D Model Generation with Intuitive 3D Input

Digital Twin Brain: a simulation and assimilation platform for whole human brain

Vision-Assisted Digital Twin Creation for mmWave Beam Management

AI-assisted Agile Propagation Modeling for Real-time Digital Twin Wireless Networks

Demo: NetVision: Efficient Visualization Front-End for Packet-level Discrete-Event Network Simulation

Demo: A Digital Twin of the 5G Radio Access Network for Anomaly Detection Functionality

Generative adversarial networks based digital twin channel modeling for intelligent communication networks

Real-Time Digital Twin Platform: A Case Study on Core Network Selection in Aeronautical Ad-Hoc Networks

Building a digital twin for intelligent optical networks

Three-Dimensional Geometric-Physical Modeling of an Environment with an In-House-Developed Multi-Sensor Robotic System

Digital twin for mobile robot modeling and simulation

Digital Twins for Autonomous Driving: A Comprehensive Implementation and Demonstration

Building a Digital Twin for Large-Scale and Dynamic C+L-band Optical Networks