Abstract:Fringe projection profilometry (FPP) is one of the most widely used optical three-dimensional (3-D) perceiving techniques. However, when applied to cluttered scenes, acquiring accurate 3-D shapes is difficult because of the influences of indirect light caused by non-diffuse surfaces. In this paper, we first theoretically analyze and model the influences of indirect light in FPP, and then propose a scene-adaptive pattern coding-based method, which can design projection patterns based on the reflective properties of the scene’s surfaces, to achieve accurate 3-D perceiving in cluttered scenes. Specifically, the scene confidence analysis method is first proposed to identify the reflective properties of various surfaces and localize the camera pixels of the diffuse surface. The illumination status (i.e., "0" or "1") of each projector pixel can be determined according to the camera-projection coordinate mapping and spatial pattern coding, where only diffuse surfaces can be illuminated, thus fundamentally preventing the influences of indirect light from the point of view of the light source. The 3-D shapes of diffuse surfaces can be accurately reconstructed in cluttered scenes. Different from traditional reflective properties change or light separation solutions, the proposed method can achieve accurate 3-D perceiving of cluttered scenes without additional hardware or expensive calculation. Extensive experiments verify that the proposed method outperforms the traditional methods in terms of accuracy and robustness.

Large Depth-of-field Fringe Projection Profilometry Applied to Defocused Scenes

Extended Depth of Field Reconstruction with Complex Field Estimation

Multi-image-distance Imaging System for Extending Depth-of-field

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Multi-Depth-of-Field 3-D Profilometry for a Microscopic System With Telecentric Lens

Dynamic Projection Theory for Fringe Projection Profilometry.

Large Depth-of-field Three-Dimensional Shape Measurement with the Focal Sweep Technique

Weakly Supervised Depth Estimation for 3D Imaging with Single Camera Fringe Projection Profilometry

Adaptive Depth Measurement Based on Adversarial Relevance Vector Regression for Fringe Projection Profilometry

Multi-channel Residual Network Model for Accurate Estimation of Spatially-Varying and Depth-Dependent Defocus Kernels.

Scene-adaptive pattern coding-based fringe projection profilometry: diffuse surfaces identification and 3-D reconstruction in cluttered scenes

Defocusing Response Function Optimization in Depth Estimation of Boundary Complex Light Field Image

Autofocusing method for a digital fringe projection system with dual projectors

Fast Three-Dimensional Profilometry with Large Depth of Field

A Practical Micro Fringe Projection Profilometry for 3-D Automated Optical Inspection

Autofocusing Method for High-Resolution Three-Dimensional Profilometry

An adaptive fringe projection method for 3D measurement with high-reflective surfaces

Deep-learning-enabled temporally super-resolved multiplexed fringe projection profilometry: high-speed kHz 3D imaging with low-speed camera

Robust Fourier ptychographic microscopy via a physics-based defocusing strategy for calibrating angle-varied LED illumination

Deep Learning-Based 3D Measurements with Near-Infrared Fringe Projection