Abstract:Three-dimensional (3D) reconstruction of dynamic objects has broad applications, including object recognition and robotic manipulation. However, achieving high-accuracy reconstruction and robustness to motion simultaneously is a challenging task. In this paper, we present a novel method for 3D reconstruction of dynamic objectS, whose main features are as follows. Firstly, a structured-light multiplexing method is developed that only requires 3 patterns to achieve high-accuracy encoding. Fewer projected patterns require shorter image acquisition time, thus, the object motion is reduced in each reconstruction cycle. The three patterns, i.e. spatial-temporally encoded patterns, are generated by embedding a specifically designed spatial-coded texture map into the temporal-encoded three-step phase-shifting fringes. A temporal codeword and three spatial codewords are extracted from the composite patterns using a proposed extraction algorithm. The two types of codewords are utilized separately in stereo matching: the temporal codeword ensures the high accuracy, while the spatial codewords are responsible for removing phase ambiguity. Secondly, we aim to eliminate the reconstruction error induced by motion between frames abbreviated as motion induced error (MiE). Instead of assuming the object to be static when acquiring the 3 images, we derive the motion of projection pixels among frames. Using the extracted spatial codewords, correspondences between different frames are found, i.e. pixels with the same codewords are traceable in the image sequences. Therefore, we can obtain the phase map at each image-acquisition moment without being affected by the object motion. Then the object surfaces corresponding to all the images can be recovered. Experimental results validate the high reconstruction accuracy and precision of the proposed method for dynamic objects with different motion speeds. Comparative experiments show that the presented method demonstrates superior performanc- with various types of motion, including translation in different directions and deformation.

A Stereo Matching Based 3D Building Reconstruction Algorithm

A Flexible Method for 3D Reconstruction of Urban Building

Improved Fast 3D Reconstruction Algorithm Based on Laser Scanning Point Cloud

Advanced-Technological UAVs-Based Enhanced Reconstruction of Edges for Building Models

Dynamic Limited-Search Matching Algorithm Based on Geometric Properties of Stereo Imaging

Disparity Refinement Of Building Edges Using Robustly Matched Straight Lines For Stereo Matching

Accurate Real-Time Stereo Correspondence Using Intra- and Inter-Scanline Optimization

Outdoor Scene 3D Reconstruction from Multiple Point Cloud

Hybrid stereo matching by dynamic programming with enhanced cost entry for real-time depth generation

Fast Stereo Matching Algorithm Based on Adaptive Window

A Stereo Algorithm Using Edge-Based Orthogonal Dynamic Programming

A Method for 3D Reconstruction of Complex Scenes from Two Uncalibrated Views

The 3D Reconstruction of Face Model with Active Structured Light and Stereo Vision Fusion

Improved Template Matching Based Stereo Vision Sparse 3D Reconstruction Algorithm

Stereo Matching by Incorporating Depth Cues

Generalized Stereo Matching Method Based on Iterative Optimization of Hierarchical Graph Structure Consistency Cost for Urban 3D Reconstruction

Active stereo vision three-dimensional reconstruction by RGB dot pattern projection and ray intersection

Generalized Stereo Matching Based on Topological Structure Consistency for Urban 3D Reconstruction from Satellite Imagery

A binocular stereo-view 3D reconstruction algorithm based on contour extraction and depth screening

Automated 3D Building Modeling Based on Urban Aerial Stereopair

Accurate 3D Reconstruction of Dynamic Objects by Spatial-Temporal Multiplexing and Motion-Induced Error Elimination