Focal plane coincidence method for a multi-view telecentric 3D imaging system

Dezhao Wang,Weihu Zhou,Zili Zhang,Fanchang Meng,Chao Gao

DOI: https://doi.org/10.1364/ol.516093

IF: 3.6

2024-02-10

Optics Letters

Abstract:Dezhao Wang, Weihu Zhou, Zili Zhang, Fanchang Meng, Chao Gao Multi-view microscopic fringe projection systems, which use high-resolution telecentric lenses and the Scheimpflug condition, face ... [Opt. Lett. 49, 919-922 (2024)]

optics

What problem does this paper attempt to address?

Focal plane coincidence method for a multi-view telecentric 3D imaging system

Dezhao Wang,Weihu Zhou,Zili Zhang,Fanchang Meng,Chao Gao

DOI: https://doi.org/10.1364/OL.516093

2024-02-15

Abstract:Multi-view microscopic fringe projection systems, which use high-resolution telecentric lenses and the Scheimpflug condition, face challenges in coinciding focal planes accurately, resulting in inconsistent measurements between views. In this Letter, we developed a sharpness evaluation function based on the total power of the line-spread function, which was subsequently used to generate a full-field sharpness distribution map. Then we employed the correlation between the sharpness map and orientation of the focal plane to precisely coincide the focal planes. Experimental results validate the proposed method and demonstrate its improved consistency in 3D reconstruction.
Compact Design of Projection Lens for 3D Profilometry Based on Interferometric Fringes

Yongjian Zhu,Weiqing Pan,Jianfeng Sun,Anhu Li,Yong Li

DOI: https://doi.org/10.1016/j.ijleo.2011.11.068

IF: 3.1

2013-01-01

Optik

Abstract:As for the new type of 3D fringe-based profilometry we proposed, a compact projection lens is designed to meet the requirements of interferometric fringes magnification. Fringe projection profilometry requires that the projection lens has super short focus length and wide field of view (FOV) as well as large projection area as possible. In this case, the measurement system is able to capture a frame of fringe map with enough information of object and achieve a high accuracy. Thus the projection lens was designed with focus length of 9.45 mm, F-number of 2.8 and FOV of 72.45°. The total track of lens was 76.355 mm, less than 80 mm. The projection resolutions were 800 × 600 pixels. The lens design showed that the modulation transfer function (MTF) is higher than 80% at 32 lp/mm for all field angles. The maximum distortion was about −3.0% at field angle of 72.45°. According to the size requirement of measured object, the projection area was 40″ at the distance of 1 m. Therefore, the compact lens design with super short focus length and wide FOV as well as large projection area is absolutely adaptable for the 3D fringe-based profilometry which is shown in this paper. Meanwhile, the proposed lens design could also be used for the mini LCoS (Liquid Crystal on Silicon) projector.
Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Anhu Li,Ye Ding,Wei Wang,Yongjian Zhu,Zhizhong Li

DOI: https://doi.org/10.1117/12.2022557

2013-01-01

Abstract:The paper reviews the recent research progresses of vision measurement. The general methods of the depth detection used in the monocular stereo vision are compared with each other. As a result, a novel bifocal imaging measurement system based on the zoom method is proposed to solve the problem of the online 3D measurement. This system consists of a primary lens and a secondary one with the different focal length matching to meet the large-range and high-resolution imaging requirements without time delay and imaging errors, which has an important significance for the industry application.
Multi-image-distance Imaging System for Extending Depth-of-field

Jixiang Tang,Xuanyin Wang,Huan Zhou,Jiayu Ji,Zhengxiao Li,Zijian Ye

DOI: https://doi.org/10.1016/j.ijleo.2023.170965

IF: 3.1

2023-01-01

Optik

Abstract:Depth of field (DoF) defines the longitudinal range of objects in sharp focus. Imaging systems for machine vision are generally limited to a small DoF by various conditions, constraining the visual inspection of objects with large depth. In this paper, we develop a multi-image-distance imaging system, which can extend the DoF by capturing multi-focus images for fusion. A three-way beam-splitter prism is designed to support independent imaging of three image sensors. Through adjusting the sensors to different back focal lengths, multiple images focusing at different depths are captured in a single exposure. Finally, the focused regions of each image are fused for extending the DoF. Analyses of the proposed DoF extension strategy illustrate excellent enhancement more than three times. Moreover, we introduce a DoF measurement method based on the estimation of the point spread function, and measurement experiments are conducted using the fabricated prototype. Imaging experiments for various scenes demonstrate great imaging quality and DoF extension performance. The proposed multi-image-distance imaging system provides an effective and practical DoF extension solution for close-range visual inspection.
Autofocusing method for a digital fringe projection system with dual projectors

Min Zhong,Xiaowei Hu,Feng Chen,Chao Xiao,Duan Peng,Song Zhang

DOI: https://doi.org/10.1364/OE.392006

IF: 3.8

2020-01-01

Optics Express

Abstract:This paper presents a novel technique to achieve autofocusing for a three-dimensional (3D) profilometry system with dual projectors. The proposed system uses a camera that is attached with an electronically focus-tunable lens (ETL) that allows dynamic change of camera's focal plane such that the camera can focus on the object; the camera captures fringe patterns projected by each projector to establish corresponding points between two projectors, and two pre-calibrated projectors form triangulation for 3D reconstruction. We pre-calibrate the relationship between the depth and the current being used for each focal plane, perform a 3D shape measurement with an unknown focus level, and calculate the desired current value based on the initial 3D result. We developed a prototype system that can automatically focus on an object positioned between 450 mm to 850 mm. (C) 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Microscopic fringe projection profilometry comparison based on stereoscopic microscope and telecentric lenses

Yan Hu,Yichao Liang,Tianyang Tao,Wei Yin,Jiaming Qian,Shijie Feng,Chao Zuo,Qian Chen

DOI: https://doi.org/10.1117/12.2537483

2019-01-01

Abstract:As the digital projector develops, fringe projection profilometry has been widely used in the fast 3D measurement. However, the field of view of traditional 3D measurement systems is commonly in decimeters, which limits the 3D reconstruction accuracy to tens of microns. If we want to improve the accuracy further, we have to minimize the field of view and meanwhile increase the fringe density in space. For this purpose, we developed two kinds of systems based on a stereo-microscope and telecentric lenses, respectively. We also studied the corresponding calibration frameworks and developed fast 3D measurement methods with both Fourier transform and phaseshifting algorithms for real-time 3D reconstruction of micro-scale objects.
Multiview Fringe Matching Profilometry in a Projector-Camera System.

XiaoPeng Guo,Hong Zhao,PingPing Jia,KeJia Li

DOI: https://doi.org/10.1364/ol.43.003618

2018-01-01

Abstract:This Letter proposes a novel approach, called multiview fringe matching profilometry (MFMP), for three-dimensional (3D) measurement in a projector-camera system. An essential difference from the traditional optical profilometries in our MFMP test is that a projector will be regarded as a camera with the reverse lightpath and not just as a coding projection device. Therefore, profiting by a maximum utilization of a multiview matching relationship, the homonymy points can be directly found with the geometric constraint of the corresponding fringe images between the projector and cameras. Meanwhile, the 3D object reconstruction can be obtained quickly and accurately from a single fringe pattern without phase unwrapping, even if the discontinuous surface shape is also easily measurable in our MFMP. Experiment results are provided to verify the effectiveness of our approach.
Accurate and Flexible Calibration Method for a 3D Microscopic Structured Light System with Telecentric Imaging and Scheimpflug Projection.

Huiwen Deng,Pengyu Hu,Guofeng Zhang,Chengsheng Xia,Yindi Cai,Shuming Yang

DOI: https://doi.org/10.1364/oe.480333

2022-01-01

SSRN Electronic Journal

Abstract:3D imaging and metrology of complex micro-structures is a critical task for precision manufacturing and inspection. In this paper, an accurate and flexible calibration method for 3D microscopic structured light system with telecentric imaging and Scheimpflug projector is proposed. Firstly, a fringe projection 3D microscopy (FP-3DM) system consisting of a telecentric camera and a Scheimpflug projector is developed, which can take full advantage of the depth of field (DOF) and increase the measurement depth range. Secondly, an accurate and flexible joint calibration method is proposed to calibrate the developed system, which utilizes the established pinhole imaging model and Scheimpflug distortion model to calibrate telecentric imaging, and fully considers the correction and error optimization of the Scheimpflug projection model. Meanwhile, the optimized local homography is calculated to obtain more accurate sub-pixel correspondence between the camera and the projector, and the perspective-n-point (PnP) method make the 3D coordinate estimation of the feature point more accurate. Finally, a prototype and a dedicated calibration program are developed to realize high-resolution and high-precision 3D imaging. The experimental results demonstrate that the re-projection error is less than 1µm, and the 3D repeated measurement error based on feature fitting is less than 4µm, within the calibrated volume of 10(H)mm × 50(W)mm × 40(D)mm.
High-speed multiview imaging approaching 4pi steradians using conic section mirrors: theoretical and practical considerations

Kevin C. Zhou,Al-Hafeez Dhalla,Ryan P. McNabb,Ruobing Qian,Sina Farsiu,Joseph A. Izatt

DOI: https://doi.org/10.1364/JOSAA.440592

2021-11-18

Abstract:Illuminating or imaging samples from a broad angular range is essential in a wide variety of computational 3D imaging and resolution-enhancement techniques, such as optical projection tomography (OPT), optical diffraction tomography (ODT), synthetic aperture microscopy, Fourier ptychographic microscopy (FPM), structured illumination microscopy (SIM), photogrammetry, and optical coherence refraction tomography (OCRT). The wider the angular coverage, the better the resolution enhancement or 3D resolving capabilities. However, achieving such angular ranges is a practical challenge, especially when approaching plus-or-minus 90 degrees or beyond. Often, researchers resort to expensive, proprietary high numerical aperture (NA) objectives, or to rotating the sample or source-detector pair, which sacrifices temporal resolution or perturbs the sample. Here, we propose several new strategies for multi-angle imaging approaching 4pi steradians using concave parabolic or ellipsoidal mirrors and fast, low rotational inertia scanners, such as galvanometers. We derive theoretically and empirically relations between a variety of system parameters (e.g., NA, wavelength, focal length, telecentricity) and achievable fields of view (FOVs) and importantly show that intrinsic tilt aberrations do not restrict FOV for many multi-view imaging applications, contrary to conventional wisdom. Finally, we present strategies for avoiding spherical aberrations at obliquely illuminated flat boundaries. Our simple designs allow for high-speed multi-angle imaging for microscopic, mesoscopic, and macroscopic applications.

Optics
Multiple-view 3D digital image correlation based on pseudo-overlapped imaging

Zhenning Chen,Xiaowen Li,Hao Li

DOI: https://doi.org/10.1364/ol.529123

IF: 3.6

2024-06-26

Optics Letters

Abstract:Zhenning Chen, Xiaowen Li, Hao Li The restriction of the field of view (FOV) enlargement and spatial resolution increase during optical monitoring was investigated. ... [Opt. Lett. 49, 3733-3736 (2024)]

optics
A Multi-view Camera Model for Line-Scan Cameras with Telecentric Lenses

Carsten Steger,Markus Ulrich

DOI: https://doi.org/10.1007/s10851-021-01055-x

IF: 1.627

2021-10-13

Journal of Mathematical Imaging and Vision

Abstract:Abstract We propose a novel multi-view camera model for line-scan cameras with telecentric lenses. The camera model supports an arbitrary number of cameras and assumes a linear relative motion with constant velocity between the cameras and the object. We distinguish two motion configurations. In the first configuration, all cameras move with independent motion vectors. In the second configuration, the cameras are mounted rigidly with respect to each other and therefore share a common motion vector. The camera model can model arbitrary lens distortions by supporting arbitrary positions of the line sensor with respect to the optical axis. We propose an algorithm to calibrate a multi-view telecentric line-scan camera setup. To facilitate a 3D reconstruction, we prove that an image pair acquired with two telecentric line-scan cameras can always be rectified to the epipolar standard configuration, in contrast to line-scan cameras with entocentric lenses, for which this is possible only under very restricted conditions. The rectification allows an arbitrary stereo algorithm to be used to calculate disparity images. We propose an efficient algorithm to compute 3D coordinates from these disparities. Experiments on real images show the validity of the proposed multi-view telecentric line-scan camera model.

mathematics, applied,computer science, software engineering, artificial intelligence
3D reconstruction from bifocus imaging

Xu Shu-shu,Wang Yuan-qing,Zhaoyang Zhang

DOI: https://doi.org/10.1109/ICALIP.2010.5684514

2010-01-01

Abstract:This paper presents a method to reconstruct the three-dimensional model in monocular stereo vision. Depth can be obtained from monocular disparity in bifocus images. The stereo disparity results from lenses' separation during imaging. Besides, 3D information can be acquired with depth and camera intrinsic parameters by means of camera calibration. Based on the characteristics of bifocus imaging, this paper develops a new method to detect and match feature, which fits monocular stereo vision much better .With only a pair of bifocus images and a calibrated camera, three-dimensional model of scene is constructed successfully. ©2010 IEEE.
Fast panoramic 3D shape measurement using the multi-view system with plane mirrors

Wei Yin,Chao Zuo,Shijie Feng,Tianyang Tao,Qian Chen

DOI: https://doi.org/10.1117/12.2547971

2019-01-01

Abstract:In this paper, we propose a fast panoramic 3D shape measurement technique based on the multi-view system with plane mirrors. Fringe projection profilometry (FPP), as an active 3D measurement technique based on structured light and triangulation, has been one of the most promising methods for measuring dynamic scenes, due to its inherent property of non-contact, full-field, high-precision, and high efficiency. However, for acquiring the 360-degree 3D information of the tested object with complex surfaces, multiple measurements from different perspectives and the complicated registration algorithms need to be implemented, which are time-consuming and low efficiency that limits the potential application of FPP. To solve this problem, by introducing plane mirrors into the traditional FPP system, we develop a mirror-assisted panoramic measurement system, which can capture deformed fringe images of the measured object from three different perspectives simultaneously including a real camera and two virtual cameras realized by plane mirrors. In addition, a robust calibration method is proposed to easily calibrate the mirror, which can be used to convert 3D data obtained from real and virtual perspectives into a common world coordinate system. Then, for low-modulation fringe regions, they are further corrected based on the proposed phase compensation technique. Finally, these proposed techniques constitute a complete computational framework that allows achieving a fast, high-accuracy, and panoramic 3D reconstruction results with high completeness.
Multi-Depth-of-Field 3-D Profilometry for a Microscopic System With Telecentric Lens

Xianshun Wang,Dongchen Zhu,Wenjun Shi,Jun Liu,Fengjie Fu,Jiamao Li,Xiaolin Zhang

DOI: https://doi.org/10.1109/tim.2021.3137156

IF: 5.6

2022-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Microscopic profilometry based on fringe projection is notable for its noncontact and robust nature and is widely used in industrial electronics. However, its ability to observe electronic packages is limited by the depth of field (DOF) of the lens. This article proposes a novel reconstruction scheme based on telecentric 3-D profilometry to overcome this limitation. The advantage of profilometry based on phase-shifting fringe projection is utilized through defocus detection to achieve high-precision contour measurement with a single DOF. After completing such local reconstruction, a complete 3-D model is registered from partial fragments in different DOFs, making it simple for the microscope system to measure the geometric structure of objects whose thickness exceeds three times the DOF. To accommodate occlusion in local reconstruction, a specific detection algorithm is designed based on intensity variance. Beyond that, we present a novel projection system calibration scheme to improve the calibration robustness and accuracy. Instead of directly using the detected phase to calculate the coordinates of the corners, we first model the relationship between the phase and pixel coordinates and then leverage the estimated parameters to recover the phase. Our proposed method reduces the influence of calibration board spraying errors on the calibration results. Experiments show the effectiveness of this new approach.

engineering, electrical & electronic,instruments & instrumentation
Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system.

Tianyang Tao,Qian Chen,Jian Da,Shijie Feng,Yan Hu,Chao Zuo

DOI: https://doi.org/10.1364/OE.24.020253

IF: 3.8

2016-01-01

Optics Express

Abstract:In recent years, fringe projection has become an established and essential method for dynamic three-dimensional (3-D) shape measurement in different fields such as online inspection and real-time quality control. Numerous high-speed 3-D shape measurement methods have been developed by either employing high-speed hardware, minimizing the number of pattern projection, or both. However, dynamic 3-D shape measurement of arbitrarily-shaped objects with full sensor resolution without the necessity of additional pattern projections is still a big challenge. In this work, we introduce a high-speed 3-D shape measurement technique based on composite phase-shifting fringes and a multi-view system. The geometry constraint is adopted to search the corresponding points independently without additional images. Meanwhile, by analysing the 3-D position and the main wrapped phase of the corresponding point, pairs with an incorrect 3-D position or a considerable phase difference are effectively rejected. All of the qualified corresponding points are then corrected, and the unique one as well as the related period order is selected through the embedded triangular wave. Finally, considering that some points can only be captured by one of the cameras due to the occlusions, these points may have different fringe orders in the two views, so a left-right consistency check is employed to eliminate those erroneous period orders in this case. Several experiments on both static and dynamic scenes are performed, verifying that our method can achieve a speed of 120 frames per second (fps) with 25-period fringe patterns for fast, dense, and accurate 3-D measurement. (C) 2016 Optical Society of America
A Three-Dimensional Reconstruction Method Based on Telecentric Epipolar Constraints

Qinsong Li,Zhendong Ge,Xin Yang,Xianwei Zhu

DOI: https://doi.org/10.3390/photonics11090804

IF: 2.536

2024-08-31

Photonics

Abstract:When calibrating a microscopic fringe projection profile system with a telecentric camera, the orthogonality of the camera causes an ambiguity in the positive and negative signs of its external parameters. A common solution is to introduce additional constraints, which often increase the level of complexity and the calibration cost. Another solution is to abandon the internal/external parameter models derived from the physical imaging process and obtain a numerically optimal projection matrix through the least squares solution. This paper proposes a novel calibration method, which derives a telecentric epipolar constraint model from the conventional epipolar constraint relationship and uses this constraint relationship to complete the stereo calibration of the system. On the one hand, since only the camera's intrinsic parameters are needed, there is no need to introduce additional constraints. On the other hand, the solution is optimized based on the full consideration of the imaging model to make the parameters confirm to the physical model. Our experiments proved the feasibility and accuracy of the method.

optics
Multi-plane imaging technology with constant imaging quality

Zhongsheng Zhai,Xiatian Yu,Zhen Zeng,Yi Zhang,Qinghua Lv,Da Liu,Jun Tu

DOI: https://doi.org/10.1364/ao.528431

IF: 1.9

2024-08-18

Applied Optics

Abstract:Zhongsheng Zhai, Xiatian Yu, Zhen Zeng, Yi Zhang, Qinghua Lv, Da Liu, Jun Tu To realize three-dimensional microscopic imaging with high time resolution and high space resolution at the same time, a multi-plane ... [Appl. Opt. 63, 6456-6467 (2024)]

optics
Long-depth-volume 3D Measurements Using Multithread Monocular Fringe Projection Profilometry

Minghui Duan,Ben Wang,Yabing Zheng,Yi Jin,Jinjin Zheng

DOI: https://doi.org/10.1117/12.2626748

2022-01-01

Abstract:Stereo-assisted fringe projection profilometry (FPP) has been broadly applied to 3-D measurements because of its accuracy and stability advantages. However, absolute phase unwrapping requires an ever-increasing number of cameras to continuously enlarge the measurement depth volume without spatial uncertainty, which inevitably reduces calibration reliability and system flexibility. This paper proposes a multithread monocular FPP to implement long-depth-volume 3-D measurements. For achieving the multithread FPP technique, a galvanomirrorbased camera-projector system with variable extrinsic parameters is developed. The typical combination of a camera and a projector is virtually converted into multiple monocular active vision systems through fast viewpoint switching. Based on the spatio-temporal correlation of multiple viewpoints, each wrapped phase can obtain a possible fringe order map. Subsequently, with the geometric constraints of the system, the wrapped phase maps extracted from image sequences are converted into relative phase distributions. Combining the possible fringe orders and the relative phase map, the absolute phase distribution is determined by choosing the correct phase map from all potential candidates. Experimental results demonstrate that the proposed method could accomplish long-depth-volume 3-D measurements with a measuring accuracy of 0.02 mm.
Optimal Layout of Fringe Projection for Three-Dimensional Measurements

Victor S. Cheng,Rongqian Yang,Chun Hui,Yazhu Chen

DOI: https://doi.org/10.1117/1.2931577

IF: 1.3

2008-01-01

Optical Engineering

Abstract:We optimize the layout of each light plane in a dual-view multistripe measurement system by employing spatial geometry analysis to avoid ambiguity. The imaging regions of every light plane can be labeled uniquely on two image planes within a certain measurement depth. Moreover, the flexible density of fringe patterns corresponding to the different measurement depths is immediately projected without the conventional coding procedure. Some experiments verify the effectiveness of the proposed method applied in high-resolution 3-D measurements. (c) 2008 Society of Photo-Optical Instrumentation Engineers.
Optical design of a variable view imaging system with the combination of a telecentric scanner and double wedge prisms

Xiaodong Tao,Hyungsuck Cho,Farrokh Janabi-Sharifi

DOI: https://doi.org/10.1364/AO.49.000239

2010-01-10

Abstract:Recent developments in micro-electro-mechanical systems and biotechnology have presented an emerging need for observation of dynamic targets in three-dimensional space. Unfortunately, conventional microscopes with fixed optical parameters have difficulty supplying sufficient vision information because of occlusion, small field of view, and low depth resolution. This paper introduces the design of a variable view imaging system that can supply a flexible view with a relatively large zenith angle and simple kinematics. Because of several performance factors, a multiobjective optimization process is applied to achieve an appropriate design. A prototype system is developed and used to verify the proposed design.

Focal plane coincidence method for a multi-view telecentric 3D imaging system

Focal plane coincidence method for a multi-view telecentric 3D imaging system

Compact Design of Projection Lens for 3D Profilometry Based on Interferometric Fringes

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Multi-image-distance Imaging System for Extending Depth-of-field

Autofocusing method for a digital fringe projection system with dual projectors

Microscopic fringe projection profilometry comparison based on stereoscopic microscope and telecentric lenses

Multiview Fringe Matching Profilometry in a Projector-Camera System.

Accurate and Flexible Calibration Method for a 3D Microscopic Structured Light System with Telecentric Imaging and Scheimpflug Projection.

High-speed multiview imaging approaching 4pi steradians using conic section mirrors: theoretical and practical considerations

Multiple-view 3D digital image correlation based on pseudo-overlapped imaging

A Multi-view Camera Model for Line-Scan Cameras with Telecentric Lenses

3D reconstruction from bifocus imaging

Fast panoramic 3D shape measurement using the multi-view system with plane mirrors

Multi-Depth-of-Field 3-D Profilometry for a Microscopic System With Telecentric Lens

Real-time 3-D shape measurement with composite phase-shifting fringes and multi-view system.

A Three-Dimensional Reconstruction Method Based on Telecentric Epipolar Constraints

Multi-plane imaging technology with constant imaging quality

Long-depth-volume 3D Measurements Using Multithread Monocular Fringe Projection Profilometry

Optimal Layout of Fringe Projection for Three-Dimensional Measurements

Optical design of a variable view imaging system with the combination of a telecentric scanner and double wedge prisms