Abstract:Three-dimensional (3D) reconstruction of dynamic objects has broad applications, including object recognition and robotic manipulation. However, achieving high-accuracy reconstruction and robustness to motion simultaneously is a challenging task. In this paper, we present a novel method for 3D reconstruction of dynamic objectS, whose main features are as follows. Firstly, a structured-light multiplexing method is developed that only requires 3 patterns to achieve high-accuracy encoding. Fewer projected patterns require shorter image acquisition time, thus, the object motion is reduced in each reconstruction cycle. The three patterns, i.e. spatial-temporally encoded patterns, are generated by embedding a specifically designed spatial-coded texture map into the temporal-encoded three-step phase-shifting fringes. A temporal codeword and three spatial codewords are extracted from the composite patterns using a proposed extraction algorithm. The two types of codewords are utilized separately in stereo matching: the temporal codeword ensures the high accuracy, while the spatial codewords are responsible for removing phase ambiguity. Secondly, we aim to eliminate the reconstruction error induced by motion between frames abbreviated as motion induced error (MiE). Instead of assuming the object to be static when acquiring the 3 images, we derive the motion of projection pixels among frames. Using the extracted spatial codewords, correspondences between different frames are found, i.e. pixels with the same codewords are traceable in the image sequences. Therefore, we can obtain the phase map at each image-acquisition moment without being affected by the object motion. Then the object surfaces corresponding to all the images can be recovered. Experimental results validate the high reconstruction accuracy and precision of the proposed method for dynamic objects with different motion speeds. Comparative experiments show that the presented method demonstrates superior performanc- with various types of motion, including translation in different directions and deformation.

Object motion characteristic reconstruction method based on random sampling consistency

A Submap Joining Algorithm for 3D Reconstruction Using an RGB-D Camera Based on Point and Plane Features

APPTracker Plus : Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking

Robust 3D Reconstruction with an RGB-D Camera

Articulated motion reconstruction from feature points

Mobility Fitting Using 4d Ransac

A 3D Human Motion Refinement Method Based on Sparse Motion Bases Selection.

Accurate 3D Reconstruction of Dynamic Objects by Spatial-Temporal Multiplexing and Motion-Induced Error Elimination

Dynamic Human Body Reconstruction and Motion Tracking with Low-Cost Depth Cameras

3d Reconstruction With Multi-View Texture Mapping

Skeleton Driven Non-rigid Motion Tracking and 3D Reconstruction

Reconstruction of segmentally articulated structure in freeform movement with low density feature points

Mobile3DScanner: an Online 3D Scanner for High-quality Object Reconstruction with a Mobile Device

Templateless Non-Rigid Reconstruction and Motion Tracking with a Single RGB-D Camera.

TC-SfM: Robust Track-Community-Based Structure-from-Motion

Unsupervised Articulated Skeleton Extraction from Point Set Sequences Captured by a Single Depth Camera

RGB‐D SLAM with Moving Object Tracking in Dynamic Environments

Simultaneous 3-D Human-Motion Tracking and Voxel Reconstruction

Online Global Non-rigid Registration for 3D Object Reconstruction Using Consumer-level Depth Cameras

Motion-Compensated Reconstruction Method Based on Rigid Motion Model with Multi-Object