Abstract:Reconstruction of three-dimensional (3D) scenes is an active research topic in the field of computer vision and 3D display. It's a challenge to model 3D objects rapidly and effectively. A 3D model can be extracted from multiple images. The system only requires a sequence of images taken with cameras without knowing the parameters of camera, which provide flexibility to a high degree. We focus on quickly merging point cloud of the object from depth map sequences. The whole system combines algorithms of different areas in computer vision, such as camera calibration, stereo correspondence, point cloud splicing and surface reconstruction. The procedure of 3D reconstruction is decomposed into a number of successive steps. Firstly, image sequences are received by the camera freely moving around the object. Secondly, the scene depth is obtained by a non-local stereo matching algorithm. The pairwise is realized with the Scale Invariant Feature Transform (SIFT) algorithm. An initial matching is then made for the first two images of the sequence. For the subsequent image that is processed with previous image, the point of interest corresponding to ones in previous images are refined or corrected. The vertical parallax between the images is eliminated. The next step is to calibrate camera, and intrinsic parameters and external parameters of the camera are calculated. Therefore, The relative position and orientation of camera are gotten. A sequence of depth maps are acquired by using a non-local cost aggregation method for stereo matching. Then point cloud sequence is achieved by the scene depths, which consists of point cloud model using the external parameters of camera and the point cloud sequence. The point cloud model is then approximated by a triangular wire-frame mesh to reduce geometric complexity and to tailor the model to the requirements of computer graphics visualization systems. Finally, the texture is mapped onto the wire-frame model, which can also be used for 3D display. According to the experimental results, we can reconstruct a 3D point cloud model more quickly and efficiently than other methods.

Motion-based 3D Reconstruction and Applications to Virtual Reality

Real-time Indoor Scene Reconstruction with RGBD and Inertial Input.

3D Scene Reconstruction Based on Uncalibrated Image Sequences

Visual Odometry Based 3D-Reconstruction

FastFusion: Real-Time Indoor Scene Reconstruction with Fast Sensor Motion

3D Reconstruction of Indoor Scenes Via Image Registration

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

3d Reconstruction Based On Stereovision

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

A Real-Time Interactive System of Surface Reconstruction and Dynamic Projection Mapping with RGB-depth Sensor and Projector.

Robust 3D Reconstruction with an RGB-D Camera

3D Reconstruction Based on Long Image Sequence

3d Reconstruction Of Dynamic Scenes With Multiple Handheld Cameras

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

A 3D Reconstruction Framework from Image Sequences Based on Point and Line Features

Image-based 3D scene reconstruction and exploration in augmented reality

Real-time 3D Scene Reconstruction with Dynamically Moving Object Using a Single Depth Camera

3D Scene Reconstruction from Multi-Aperture Images

Reconstruction Of 3d Scenes From Sequences Of Images

Online Reconstruction of Indoor Scenes from Rgb-D Streams

A Robust and Real-Time Full 3D Reconstruction Method Based on Multiple Kinect