Abstract:Online 3D reconstruction of real-world scenes has been attracting increasing interests from both the academia and industry, especially with the consumer-level depth cameras becoming widely available. Recent most online reconstruction systems take live depth data from a moving Kinect camera and incrementally fuse them to a single high-quality 3D model in real time. Although most real-world scenes have static environment, the daily objects in a scene often move dynamically, which are non-trivial to reconstruct especially when the camera is also not still. To solve this problem, we propose a single depth camera-based real-time approach for simultaneous reconstruction of dynamic object and static environment, and provide solutions for its key issues. In particular, we first introduce a robust optimization scheme which takes advantage of raycasted maps to segment moving object and background from the live depth map. The corresponding depth data are then fused to the volumes, respectively. These volumes are raycasted to extract views of the implicit surface which can be used as a consistent reference frame for the next iteration of segmentation and tracking. Particularly, in order to handle fast motion of dynamic object and handheld camera in the fusion stage, we propose a sequential 6D pose prediction method which largely increases the registration robustness and avoids registration failures occurred in conventional methods. Experimental results show that our approach can reconstruct moving object as well as static environment with rich details, and outperform conventional methods in multiple aspects.

Kinect-Based easy 3D object reconstruction

Robust 3D Reconstruction with an RGB-D Camera

Precise 3d reconstruction from a single image

In-Hand 3D Object Reconstruction from a Monocular RGB Video

3D reconstruction based on Kinect

3D Surface Reconstruction Based on Kinect

Reconstructing 3D Human Models with a Kinect

An Improved KinectFusion 3D Reconstruction Algorithm

Single Kinect and Rotating Platform for Full-View 3D Reconstruction

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

A Robust and Real-Time Full 3D Reconstruction Method Based on Multiple Kinect

Visual Odometry Based 3D-Reconstruction

Data fusion method based on kinect depth images

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

3D Reconstruction of Indoor Environment Using the Kinect Sensor

3D-object reconstruction and point cloud sculpture based on Kinect

Real-time 3D Scene Reconstruction with Dynamically Moving Object Using a Single Depth Camera

Fast 3D Human Body Reconstruction from Kinects

3d Reconstruction With Multi-View Texture Mapping

3D Reconstruction of Indoor Scenes Via Image Registration

Real-time 3d reconstruction of dynamic scenes with multiple kinect v2 sensors