High-Resolution, Wide-Field-of-View, and Real-Time 3D Imaging Based on Spatial-Temporal Speckle Projection Profilometry with a VCSEL Projector Array

Wei Yin,Hang Zhao,Yifan Ji,Zhongda Deng,Ziheng Jin,Shijie Feng,Xiaolei Zhang,Huai Wang,Qian Chen,Chao Zuo

DOI: https://doi.org/10.1021/acsphotonics.3c01341

IF: 7

2024-01-01

ACS Photonics

Abstract:Structured light projection, especially fringe projection profilometry (FPP), is a mainstream high-precision noncontact 3D imaging technique for manufacturing, basic research, and engineering applications. However, FPP methods are severely limited by the complex structure and high cost of high-resolution spatial light modulation devices used for projecting high-quality fringe patterns, bringing tremendous challenges to miniaturized and low-cost 3D imaging applications. On the other hand, benefiting from advanced manufacturing processes, speckle projection profilometry (SPP), which utilizes highly integrated speckle projection devices based on a vertical-cavity surface-emitting laser (VCSEL), realizes fast 3D reconstruction by projecting only a single speckle pattern, opening up a new avenue for miniaturized depth sensing applications, such as scene reconstruction and face recognition. Nevertheless, SPP yields coarse 3D measurement results with low quality in terms of accuracy and resolution due to the poor performance of single-frame speckle matching and the complex reflection characteristics of the tested surfaces. In this paper, we present a high-resolution, wide-field-of-view, and real-time 3D imaging method using spatial-temporal speckle projection profilometry (ST-SPP), which integrates a set of VCSEL-based miniaturized speckle projectors to spatially and temporally encode the depth information on the measured scenes. A coarse-to-fine spatial-temporal matching strategy using digital image correlation is proposed to overcome the difficulty of applying speckle matching to complex surfaces, enabling high-precision and efficient subpixel disparity estimation. Experimental results prove that within the measurement range of 1 m (length) x 1.2 m (width) x 2 m (depth), ST-SPP achieves accurate and computationally efficient 3D imaging with a relative precision higher than 0.05%, exhibiting its advanced performance for long-range and real-time 3D reconstruction with fine details at 30 frames per second. The proposed ST-SPP is feasible for fast 3D modeling of dynamic scenes and large-scale objects with complex shapes, further enhancing the performance of optical metrology instruments based on SPP in terms of accuracy, resolution, measurement range, and portability.