Abstract:Three-dimensional (3D) reconstruction of dynamic objects has broad applications, including object recognition and robotic manipulation. However, achieving high-accuracy reconstruction and robustness to motion simultaneously is a challenging task. In this paper, we present a novel method for 3D reconstruction of dynamic objectS, whose main features are as follows. Firstly, a structured-light multiplexing method is developed that only requires 3 patterns to achieve high-accuracy encoding. Fewer projected patterns require shorter image acquisition time, thus, the object motion is reduced in each reconstruction cycle. The three patterns, i.e. spatial-temporally encoded patterns, are generated by embedding a specifically designed spatial-coded texture map into the temporal-encoded three-step phase-shifting fringes. A temporal codeword and three spatial codewords are extracted from the composite patterns using a proposed extraction algorithm. The two types of codewords are utilized separately in stereo matching: the temporal codeword ensures the high accuracy, while the spatial codewords are responsible for removing phase ambiguity. Secondly, we aim to eliminate the reconstruction error induced by motion between frames abbreviated as motion induced error (MiE). Instead of assuming the object to be static when acquiring the 3 images, we derive the motion of projection pixels among frames. Using the extracted spatial codewords, correspondences between different frames are found, i.e. pixels with the same codewords are traceable in the image sequences. Therefore, we can obtain the phase map at each image-acquisition moment without being affected by the object motion. Then the object surfaces corresponding to all the images can be recovered. Experimental results validate the high reconstruction accuracy and precision of the proposed method for dynamic objects with different motion speeds. Comparative experiments show that the presented method demonstrates superior performanc- with various types of motion, including translation in different directions and deformation.

Photonics Based Microwave Dynamic 3D Reconstruction of Moving Targets.

Panoramic Three-Dimensional Optical Digitization System Assisted by a Bi-Mirror.

Photonic THz InISAR for 3D Positioning with High Resolution

Physics-Inspired Target Shape Detection and Reconstruction in Mmwave Communication Systems

3-D Motion Imaging in a Multipath Coordinate Space Based on a TDM-MIMO Radar Sensor

Microwave Imaging of Non-Rigid Moving Target Using 2D Sparse MIMO Array

Image Reconstruction of Targets Undergoing Complex Motion Based on Optical Phased Array Compressed-Sensing Ghost Imaging Technology

Photonics-enabled Distributed MIMO Radar for High-Resolution 3D Imaging

Three-Dimensional Microwave Imaging for Concealed Weapon Detection Using Range Stacking Technique

3D Microwave Displacement Sensor: Three-dimensional Displacement Measurement Using a Single Microwave Transceiver

Trilateration-Based Photonic THz Radar for 3D Positioning

Photonics-based Simultaneous Distance and Velocity Measurement of Multiple Targets Utilizing Dual-Band Symmetrical Triangular Linear Frequency-Modulated Waveforms

Scanning‐Driven Photon‐Counting 3D Imaging through Scattering Media Via Asynchronous Polarization Modulation

Adaptive 3D Imaging for Moving Targets Based on a SIMO InISAR Imaging System in 0.2 THz Band

A Microwave Three-Dimensional Imaging Method Based on Optimal Wave Spectrum Reconstruction

Terahertz 3-D Imaging for Non-Cooperative On-the-Move Whole Body by Scanning MIMO-Array-Based Gaussian Fan-Beam

Single photon imaging based on a photon driven sparse sampling

Microwave Photonic Based High-Resolution ISAR Imaging System for High-Speed Target

Full Waveform Recovery Method of Moving Target for Photon Counting Lidar

3D and Moving Target Extraction from Dynamic Pushbroom Stereo Mosaics

Accurate 3D Reconstruction of Dynamic Objects by Spatial-Temporal Multiplexing and Motion-Induced Error Elimination