Abstract:Online 3D reconstruction of real-world scenes has been attracting increasing interests from both the academia and industry, especially with the consumer-level depth cameras becoming widely available. Recent most online reconstruction systems take live depth data from a moving Kinect camera and incrementally fuse them to a single high-quality 3D model in real time. Although most real-world scenes have static environment, the daily objects in a scene often move dynamically, which are non-trivial to reconstruct especially when the camera is also not still. To solve this problem, we propose a single depth camera-based real-time approach for simultaneous reconstruction of dynamic object and static environment, and provide solutions for its key issues. In particular, we first introduce a robust optimization scheme which takes advantage of raycasted maps to segment moving object and background from the live depth map. The corresponding depth data are then fused to the volumes, respectively. These volumes are raycasted to extract views of the implicit surface which can be used as a consistent reference frame for the next iteration of segmentation and tracking. Particularly, in order to handle fast motion of dynamic object and handheld camera in the fusion stage, we propose a sequential 6D pose prediction method which largely increases the registration robustness and avoids registration failures occurred in conventional methods. Experimental results show that our approach can reconstruct moving object as well as static environment with rich details, and outperform conventional methods in multiple aspects.

Depth Image Application in Analysis of Automatic 3D Reconstruction

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Visual Odometry Based 3D-Reconstruction

Real-time Underwater 3D Reconstruction Based on Monocular Image

Complete 3D Model Reconstruction Using a Depth Sensor

Spatio-Temporal Depth Recovery of Dynamic Scenes with Multiple Handheld Cameras

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Depth Estimation Using a Sliding Camera.

Real-time 3D Scene Reconstruction with Dynamically Moving Object Using a Single Depth Camera

Depth and Thermal Sensor Fusion to Enhance 3D Thermographic Reconstruction

Robust 3D Reconstruction with an RGB-D Camera

3d Reconstruction Of Dynamic Scenes With Multiple Handheld Cameras

3D Reconstruction of Indoor Scenes Via Image Registration

Depth Map Estimation of Dynamic Scenes Using Prior Depth Information

3D Scene Reconstruction Based on Improved ICP Algorithm

Automated 3D Scenes Reconstruction for Mobile Robots Using Laser Scanning

Preproessing and Modeling for Visual-Based 3D Indoor Scene Reconstruction

Depth images-based approach for 3D reconstruction

Indoor 3D Scene Reconstruction for Mobile Robots Using Microsoft Kinect Sensor

Hand-Held 3d Dense Map Construction System Based On Improved Icp Algorithm

Elaborate Scene Reconstruction with a Consumer Depth Camera