High-speed 3D reconstruction with defocus composite fringes

Suyuan Shen,Rongsheng Lu,Hao Li,Pan He,Dahang Wan,Jiajie Yin

DOI: https://doi.org/10.1364/ao.542987

IF: 1.9

2024-12-11

Applied Optics

Abstract:Suyuan Shen, Rongsheng Lu, Hao Li, Pan He, Dahang Wan, Jiajie Yin Fringe projection contouring is a widely used technique in various three-dimensional (3D) reconstruction applications. However, achieving ... [Appl. Opt. 63, 9223-9231 (2024)]

optics

What problem does this paper attempt to address?

Simple Fringe Illumination Technique for Optical Superresolution

Anwar Hussain,Tariq Amin,Cuifang Kuang,Liangcai Cao,Xu Liu

DOI: https://doi.org/10.1364/josab.34.000b78

2017-01-01

Abstract:The simple and precise fringe-illumination technique has been implemented to retrieve the missing information of a two-dimensional object. The object placed in a 4f optical system is illuminated with fringes, generated by a reflective-mode spatial light modulator. A set of three fringes, shifted in phase, sequentially illuminate the object, and correspondingly, three images are captured through CCD. The fringes illuminate the object and higher spatial frequencies primarily fall outside the aperture along horizontal direction heterodyne into the passband. To heterodyne higher spatial frequencies in a vertical direction, the fringes are swapped by 90 deg, and three further images are captured through CCD. These recorded images are processed to retrieve the object information using the spectrum-domain image-processing algorithm. The final image is higher in resolution compared to the band-limited image. For validity of technique, the theoretical concept was simulated and supported through experimental results. The presented system is stable against environmental factors due to on-axis geometry. (C) 2017 Optical Society of America
Rapid 3d Reconstruction Based on Color Fringe Projection

Du Juan,Tan Jiansheng,Hu Yueming,Chen Ya

DOI: https://doi.org/10.1109/chicc.2016.7553973

2016-01-01

Abstract:A rapid 3D reconstruction method for IC chips based on color fringe projection is proposed in this paper. In the defect inspection of IC chips, the present methods of 3D reconstruction can't meet the requirement of high speed and high accuracy. In this paper, periodic color fringe patterns are designed for the projection. The relationship between fringe pattern offset and surface height of the object can be obtained from the mathematical model of the color fringe projection system. A new method using the duty ratio is proposed to calculate the fringe pattern offset. Only a single fringe image is needed to realize the 3D reconstruction of IC chips. Experimental results show that the proposed method can realize real time 3D reconstruction and obtain the 3D information accurately.
3D Object Reconstruction Algorithm Based on Dynamic Threshold Dithering Technique

Lai Jia-long,Zhou Peng,Wang Heng-yu,Lin Bin

DOI: https://doi.org/10.1117/12.2614014

2022-01-01

Abstract:Aiming at the problem of insufficient similarity between the binary defocus fringe generated by the traditional dithering algorithm in the binary surface structured light coding technology and the standard sinusoidal fringe, a dynamic threshold dithering algorithm based on the traditional Floyd-Steinberg dithering algorithm is proposed, which can generate the binary fringe pattern with high sinusoidal similarity, improving the accuracy of structured light three-dimensional reconstruction. Considering the influence of the pixel gray value in the vicinity of the pixel point on the threshold of the dithering algorithm, the parameters α and edge sensitivity coefficient 𝓂 are introduced to dynamically adjust the dithering threshold to improve the sinusoidal similarity of the dithering stripes. In addition, a total error calculation and evaluation method that takes into account the effects of gray error and phase error is used to improve the robustness of the algorithm. The simulation shows that when the parameters α and 𝓂 in the algorithm are set to 0.68 and 0.20 respectively, the total error is reduced by 82.97% at the fringe period T = 20 pixel. Corresponding experiments have been established to verify that the dynamic threshold can be displayed more clearly in the small change area of the model, which improves the image quality of the three-dimensional reconstructed object.
Extended Depth of Field Reconstruction with Complex Field Estimation

Jing Hu,Sunzheng Li,Yibing Shen,JinLei Zhang,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.optlastec.2022.108118

IF: 4.939

2022-01-01

Optics & Laser Technology

Abstract:The contradiction between high resolution and large depth of field (DOF) of microscopic imaging limits its application in imaging 3D distributed samples. Here, we propose a new technique to achieve extended depth of field reconstruction in bright-field microscopy through complex field estimation. The complex field is estimated by a phase retrieval algorithm with the four illumination modulation patterns and the corresponding captured Fourier intensities as dual constraints. Then, the digital refocusing strategy based on Fresnel propagator is integrated into reconstruction framework to achieve the reconstruction of high-resolution complex-valued information for each part of the sample, which ensures an effective extension of the DOF. The feasibility of the proposed method to maintain high resolution over extended DOF was verified in actual experiments with a tilted USAF target, biological sample and microlens array (MLA). The extended DOF reconstruction provides a robust method for imaging in both industrial inspection and biomedical research.
High Speed 3D Shape Measurements with Motion Compensation

Shijie Feng,Chao Zuo,Qian Chen,Guohua Gu

DOI: https://doi.org/10.1117/12.2270942

2017-01-01

Abstract:Fringe projection is an extensively used technique for high speed three-dimensional (3D) measurements of dynamic objects. However, the motion often leads to artifacts in reconstructions due to the sequential recording of the set of patterns. In order to reduce the adverse impact of the movement, we present a novel high speed 3D scanning technique combining the fringe projection and stereo. Firstly, promising measuring speed is achieved by modifying the traditional aperiodic sinusoidal patterns so that the fringe images can be cast at kilohertz with the widely used defocusing strategy. Next, a temporal intensity tracing algorithm is developed to further alleviate the influence of motion by accurately tracing the ideal intensity for stereo matching. Then, a combined cost measure is suggested to robustly estimate the cost for each pixel. In comparison with the traditional method where the effect of motion is not considered, experimental results show that the reconstruction accuracy for dynamic objects can be improved by an order of magnitude with the proposed method.
Motion-oriented High Speed 3-D Measurements by Binocular Fringe Projection Using Binary Aperiodic Patterns.

Shijie Feng,Qian Chen,Chao Zuo,Tianyang Tao,Yan Hu,Anand Asundi

DOI: https://doi.org/10.1364/oe.25.000540

IF: 3.8

2017-01-01

Optics Express

Abstract:Fringe projection is an extensively used technique for high speed three-dimensional (3-D) measurements of dynamic objects. To precisely retrieve a moving object at pixel level, researchers prefer to project a sequence of fringe images onto its surface. However, the motion often leads to artifacts in reconstructions due to the sequential recording of the set of patterns. In order to reduce the adverse impact of the movement, we present a novel high speed 3-D scanning technique combining the fringe projection and stereo. Firstly, promising measuring speed is achieved by modifying the traditional aperiodic sinusoidal patterns so that the fringe images can be cast at kilohertz with the widely used defocusing strategy. Next, a temporal intensity tracing algorithm is developed to further alleviate the influence of motion by accurately tracing the ideal intensity for stereo matching. Then, a combined cost measure is suggested to robustly estimate the cost for each pixel and lastly a three-step framework of refinement follows not only to eliminate outliers caused by the motion but also to obtain sub-pixel disparity results for 3-D reconstructions. In comparison with the traditional method where the effect of motion is not considered, experimental results show that the reconstruction accuracy for dynamic objects can be improved by an order of magnitude with the proposed method.
Fast 3D shape measurements with reduced motion artifacts

Shijie Feng,Chao Zuo,Qian Chen,Guohua Gu

DOI: https://doi.org/10.1117/12.2283371

2017-01-01

Abstract:Fringe projection is an extensively used technique for high speed three-dimensional (3D) measurements of dynamic objects. However, the motion often leads to artifacts in reconstructions due to the sequential recording of the set of patterns. In order to reduce the adverse impact of the movement, we present a novel high speed 3D scanning technique combining the fringe projection and stereo. Firstly, promising measuring speed is achieved by modifying the traditional aperiodic sinusoidal patterns so that the fringe images can be cast at kilohertz with the widely used defocusing strategy. Next, a temporal intensity tracing algorithm is developed to further alleviate the influence of motion by accurately tracing the ideal intensity for stereo matching. Then, a combined cost measure is suggested to robustly estimate the cost for each pixel. In comparison with the traditional method where the effect of motion is not considered, experimental results show that the reconstruction accuracy for dynamic objects can be improved by an order of magnitude with the proposed method.
Practical Considerations for High-Speed Real-Time 3-D Measurements by the Fringe Projection

Shijie Feng,Qian Chen,Chao Zuo,Anand Asundi

DOI: https://doi.org/10.1117/12.2266934

2017-01-01

Abstract:Fringe projection is an extensively applied technique for optical three-dimensional (3-D) shape measurements. Although showing favorable performance for motionless objects, it tends to have difficulties to retrieve surfaces globally or locally varying over time. The reason is that common methods developed for static scenes are prone to fail when measuring dynamic processes. Therefore, to facilitate the application of high-speed real-time measurements, we suggest considerations from four aspects to improve conventional fringe projection methods. The first two aspects are related to raising the measuring efficiency, which can be achieved by encoding the measured object robustly yet with less required patterns, and by increasing the rate of pattern projection which is a bottleneck restricting the measuring speed. The third consideration is to obtain accurate 3-D reconstructions by removing unreliable points induced by system and random errors during dynamic measurements. The last one is to handle moving shiny objects as it is supposed to be a time-consuming process for traditional approaches. We believe the mentioned considerations will help ease the efforts to achieve desired results for fast real-time measurements.
Real-time High Dynamic Range 3D Measurement Using Fringe Projection.

Liang Zhang,Qian Chen,Chao Zuo,Shijie Feng

DOI: https://doi.org/10.1364/oe.398814

IF: 3.8

2020-01-01

Optics Express

Abstract:Fringe projection profilometry (FPP) is a widely used technique for real-time three-dimensional (3D) shape measurement. However, it tends to compromise when measuring objects that have a large variation range of surface reflectivity. In this paper, we present a FPP method that can increase the dynamic range for real-time 3D measurements. First, binary fringe patterns are projected to generate grayscale sinusoidal patterns with the defocusing technique. Each pattern is then captured twice with different exposure values in one projection period. With image fusion, surfaces under appropriate exposure are retained. To improve the real-time performance of high dynamic range (HDR) 3D shape measurements, we build a binocular fringe projection profilometry system that saves the number of patterns by geometry constraint. Further, to ensure the accuracy and robustness of HDR 3D measurements, we propose a mixed phase unwrapping method that can reduce phase unwrapping errors for dense fringe patterns. Experiment results show that the proposed method can realize accurate and real-time 3D measurement for HDR scenes at 28 frames per second.
Fast Three-Dimensional Measurements for Dynamic Scenes with Shiny Surfaces

Shijie Feng,Qian Chen,Chao Zuo,Anand Asundi

DOI: https://doi.org/10.1016/j.optcom.2016.07.057

IF: 2.4

2017-01-01

Optics Communications

Abstract:This paper presents a novel fringe projection technique for fast three-dimensional (3-D) shape measurements of moving highly reflective objects. By combining the standard three-step phase-shifting fringe patterns with a digital speckle image, dynamic 3-D reconstructions of shiny surfaces can be efficiently achieved with only four projected patterns. The phase measurement is performed by three-step phase-shifting algorithm as it uses the theoretical minimum number of fringe patterns for phase-shifting profilometry. To avoid the camera saturation, a dual-camera fringe projection system is built to measure shiny objects from two different directions. The erroneous phase obtained from a saturated pixel is corrected by the phase of its corresponding pixel in the other view which is free from the saturation problem. To achieve high measurement accuracy, the corresponding high light intensity areas in cameras are found by sub-pixel matches of the speckle pattern in either view. Benefited from the trifocal tensor constraint, the corresponding points in the two wrapped phase maps can be directly established, and thus, the difficulties in determining the correct fringe order for the discontinuous or isolated surfaces can be effectively bypassed. Experimental results indicate that the proposed method is able to successfully measure highly reflective surfaces for both stationary and dynamic scenes.
Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system.

Tianyang Tao,Qian Chen,Jian Da,Shijie Feng,Yan Hu,Chao Zuo

DOI: https://doi.org/10.1364/OE.24.020253

IF: 3.8

2016-01-01

Optics Express

Abstract:In recent years, fringe projection has become an established and essential method for dynamic three-dimensional (3-D) shape measurement in different fields such as online inspection and real-time quality control. Numerous high-speed 3-D shape measurement methods have been developed by either employing high-speed hardware, minimizing the number of pattern projection, or both. However, dynamic 3-D shape measurement of arbitrarily-shaped objects with full sensor resolution without the necessity of additional pattern projections is still a big challenge. In this work, we introduce a high-speed 3-D shape measurement technique based on composite phase-shifting fringes and a multi-view system. The geometry constraint is adopted to search the corresponding points independently without additional images. Meanwhile, by analysing the 3-D position and the main wrapped phase of the corresponding point, pairs with an incorrect 3-D position or a considerable phase difference are effectively rejected. All of the qualified corresponding points are then corrected, and the unique one as well as the related period order is selected through the embedded triangular wave. Finally, considering that some points can only be captured by one of the cameras due to the occlusions, these points may have different fringe orders in the two views, so a left-right consistency check is employed to eliminate those erroneous period orders in this case. Several experiments on both static and dynamic scenes are performed, verifying that our method can achieve a speed of 120 frames per second (fps) with 25-period fringe patterns for fast, dense, and accurate 3-D measurement. (C) 2016 Optical Society of America
Rapid 3D reconstruction method based on the polarization-enhanced fringe pattern of an HDR object

Zhenmin Zhu,Duoduo You,Fuqiang Zhou,Sheng Wang,Yulin Xie,Duoduo you

DOI: https://doi.org/10.1364/OE.416179

IF: 3.8

2021-01-13

Optics Express

Abstract:Zhenmin Zhu, Duoduo You, Fuqiang Zhou, Sheng Wang, Yulin Xie Measurement of high dynamic range objects is an obstacle in structured light 3D measurement. They entail both over-exposed and low-exposed ... [Opt. Express 29, 2162-2171 (2021)]

optics
High dynamic range three-dimensional measurement using fringe projection technique

shijie feng,qian chen,chao zuo,yuzhen zhang

DOI: https://doi.org/10.1364/ISA.2014.ITu3C.4

2014-01-01

Abstract:This paper presents an approach to high dynamic range shape measurement for scenario of largely varying range of surface reflectivity, e.g. simultaneously containing very dark and bright surfaces.
Large Depth-of-field Fringe Projection Profilometry Applied to Defocused Scenes

Peng Chen,Yunjie Wu,Shixiang Wang,Lingbao Kong

DOI: https://doi.org/10.1364/oe.519459

IF: 3.8

2024-01-01

Optics Express

Abstract:Fringe projection profilometry (FPP) is a widely adopted technique for threedimensional (3D) reconstruction. However, its depth-of-field (DOF) is constrained when reconstructing defocused scenes, mainly due to limitations in the camera model and image blur. This study introduces a camera model based on the ideal optical system, which effectively reduces the systematic errors associated with the conventional pinhole camera model. A calibration method to determine the optical system parameters of the improved camera model is proposed. Additionally, the point spread function (PSF) of the camera is calibrated and the image is deblur red through non-blind deconvolution, thereby minimizing the phase aliasing resulting from defocus. Experimental results validate the potential of the proposed method for accurate 3D reconstruction in scenes with a wide depth range.
A Novel Defocus-Degree-Based Phase Unwrapping and Fusion Algorithm for High-Speed and Large-Depth-Range 3D Measurement

Zhuojun Zheng,Jian Gao,Lanyu Zhang,Xin Chen,Yun Chen

DOI: https://doi.org/10.1109/tie.2022.3176265

IF: 7.7

2022-12-17

IEEE Transactions on Industrial Electronics

Abstract:Binary defocusing technique is typically used in high-speed 3-D measurement. As the defocus degree varies with the measuring depth range, current defocusing technique has limitations while measuring large-depth-range (LDR) scene. Addressing this difficulty, this article proposes a novel defocus-degree-based phase unwrapping and phase fusion algorithm for LDR 3-D measurement. Firstly, we establish a mathematical model to present the relationship between defocus degree and phase, and present the defocus-degree-based phase unwrapping algorithm to directly obtain its accurate fringe order. Then, we derive a phase error model to estimate its phase error, and develop a phase fusion algorithm to obtain the lowest phase error by fusing two frequency phases based on the estimated error. With implementation of the proposed phase unwrapping and fusion algorithm, experiments are performed and the results demonstrate that our method can achieve a high-speed, high-precision and low-outlier 3-D measurement for LDR scene.

automation & control systems,engineering, electrical & electronic,instruments & instrumentation
Efficient 3D measurement of a HDR surface based on adaptive fringe projection

Jialing Hu,Jiangping Zhu,Pei Zhou

DOI: https://doi.org/10.1364/AO.470064

IF: 1.9

2022-10-20

Applied Optics

Abstract:Jialing Hu, Jiangping Zhu, Pei Zhou 3D measurement methods of a high-dynamic-range (HDR) surface based on adaptive fringe projection have aroused extensive research interest. ... [Appl. Opt. 61, 9028-9036 (2022)]

optics
High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system

Wei Yin,Shijie Feng,Tianyang Tao,Lei Huang,Maciej Trusiak,Qian Chen,Chao Zuo

DOI: https://doi.org/10.1364/OE.27.002411

2019-02-04

Abstract:In this paper, we propose a high-speed 3D shape measurement technique based on the optimized composite fringe patterns and stereo-assisted structured light system. Stereo phase unwrapping, as a new-fashioned method for absolute phase retrieval based on the multi-view geometric constraints, can eliminate the phase ambiguities and obtain a continuous phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which limits the accuracy of 3D measurement. To solve this problem, we develop an optimized method for designing the composite pattern, in which the speckle pattern is embedded into the conventional 4-step phase-shifting fringe patterns without compromising the fringe modulation, and thus the phase measurement accuracy. We also present a simple and effective evaluation criterion for the correlation quality of the designed speckle pattern in order to improve the matching accuracy significantly. When the embedded speckle pattern is demodulated, the periodic ambiguities in the wrapped phase can be eliminated by combining the adaptive window image correlation with geometry constraint. Finally, some mismatched regions are further corrected based on the proposed regional diffusion compensation technique (RDC). These proposed techniques constitute a complete computational framework that allows to effectively recover an accurate, unambiguous, and distortion-free 3D point cloud with only 4 projected patterns. Experimental results verify that our method can achieve high-speed, high-accuracy, robust 3D shape measurement with dense (64-period) fringe patterns at 5000 frames per second.
An investigation of high dynamic range imaging of highly reflective surfaces based on deep learning 3D fringe projection

wei gao,Shixiang Wang

DOI: https://doi.org/10.1117/12.3009055

2023-12-29

Abstract:Three-dimensional reconstruction of highly reflective surfaces has always been an important and difficult problem in structured light technology. In this paper, a novel method by combining optimal exposure with the adjustment of the intensity of projection fringes by deep learning is proposed a single frame method is used to extract the overexposed region in the optimal exposure time series for composite projection. By using the statistical histogram of the number of overexposed pixels of the measured object under different projection conditions, and combining with the proportion of pixels in the image that are not exposed, the optimal exposure time series is calculated and the overexposed area is automatically extracted. The single-frame composite high dynamic image is obtained by adjusting the projection intensity through absolute coordinates, which improves the single-frame high dynamic range technique for highly reflective surfaces. Several simulations and experiments were conducted. The experimental results show that the proposed method can effectively improve the 3D reconstruction accuracy of the highly reflective surface, and the number of effective pixels in the point cloud can reach more than 98%.

Engineering,Physics,Computer Science
High-speed 3-D shape measurement using composite structured-light patterns and multi-view system

Wei Yin,Chao Zuo,Shijie Feng,Tianyang Tao,Qian Chen

DOI: https://doi.org/10.1117/12.2500696

2018-01-01

Abstract:In this paper, we propose a high-speed 3-D shape measurement technique based on composite structured-light patterns and a multi-view system. Benefiting from the multi-view system, stereo phase unwrapping, as a novel method for the phase unwrapping algorithm, can eliminate the phase ambiguities and obtain absolute phase map without projecting any additional patterns. However, in order to ensure the stability of phase unwrapping, the period of fringe is generally around 20, which leads to the limited accuracy of 3D measurement. To solve the precision-limited problem reasonably, we mathematically developed an optimized design method of the composite pattern. By skillfully embedding speckles without compromising the phase measurement accuracy, we can realize phase unwrapping with high-frequency fringes. In addition, a computational framework will be provided to further achieve the robust and high-performance 3D acquisition. It is demonstrated by several experiments that our method can achieve a high-speed, dense, and accurate 3-D shape measurement with 64-period fringe patterns at 5000 frames per second.
Multi-view fringe projection profilometry for surfaces with intricate structures and high dynamic range

Guofeng Zhang,Yong Liu,Qian Yao,Huiwen Deng,Hongwei Zhao,Zonghua Zhang,Shuming Yang

DOI: https://doi.org/10.1364/oe.524898

IF: 3.8

2024-05-11

Optics Express

Abstract:Guofeng Zhang, Yong Liu, Qian Yao, Huiwen Deng, Hongwei Zhao, Zonghua Zhang, Shuming Yang Fringe projection profilometry plays an important role for quality control in production line. However, it is facing challenges in the ... [Opt. Express 32, 19146-19162 (2024)]

optics

High-speed 3D reconstruction with defocus composite fringes

Simple Fringe Illumination Technique for Optical Superresolution

Rapid 3d Reconstruction Based on Color Fringe Projection

3D Object Reconstruction Algorithm Based on Dynamic Threshold Dithering Technique

Extended Depth of Field Reconstruction with Complex Field Estimation

High Speed 3D Shape Measurements with Motion Compensation

Motion-oriented High Speed 3-D Measurements by Binocular Fringe Projection Using Binary Aperiodic Patterns.

Fast 3D shape measurements with reduced motion artifacts

Practical Considerations for High-Speed Real-Time 3-D Measurements by the Fringe Projection

Real-time High Dynamic Range 3D Measurement Using Fringe Projection.

Fast Three-Dimensional Measurements for Dynamic Scenes with Shiny Surfaces

Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system.

Rapid 3D reconstruction method based on the polarization-enhanced fringe pattern of an HDR object

High dynamic range three-dimensional measurement using fringe projection technique

Large Depth-of-field Fringe Projection Profilometry Applied to Defocused Scenes

A Novel Defocus-Degree-Based Phase Unwrapping and Fusion Algorithm for High-Speed and Large-Depth-Range 3D Measurement

Efficient 3D measurement of a HDR surface based on adaptive fringe projection

High-speed 3D shape measurement using the optimized composite fringe patterns and stereo-assisted structured light system

An investigation of high dynamic range imaging of highly reflective surfaces based on deep learning 3D fringe projection

High-speed 3-D shape measurement using composite structured-light patterns and multi-view system

Multi-view fringe projection profilometry for surfaces with intricate structures and high dynamic range