Polarimetric 3D integral imaging profilometry under degraded environmental conditions

JIHEON LEE,Kashif Usmani,Bahram Javidi

DOI: https://doi.org/10.1364/oe.542625

IF: 3.8

2024-11-13

Optics Express

Abstract:Jiheon Lee, Kashif Usmani, Bahram Javidi We propose polarimetric three-dimensional (3D) integral imaging profilometry and investigate its performance under degraded environmental ... [Opt. Express 32, 43172-43183 (2024)]

optics

What problem does this paper attempt to address?

Deep learning polarimetric three-dimensional integral imaging object recognition in adverse environmental conditions

Kashif Usmani,Gokul Krishnan,Timothy O’Connor,Bahram Javidi

DOI: https://doi.org/10.1364/OE.421287

IF: 3.8

2021-04-06

Optics Express

Abstract:Kashif Usmani, Gokul Krishnan, Timothy O'Connor, Bahram Javidi Polarimetric imaging is useful for object recognition and material classification because of its ability to discriminate objects based on ... [Opt. Express 29, 12215-12228 (2021)]

optics
Three-dimensional polarimetric integral imaging in photon-starved conditions: performance comparison between visible and long wave infrared imaging

Kashif Usmani,Timothy O'Connor,Xin Shen,Pete Marasco,Artur Carnicer,Dipak Dey,Bahram Javidi

DOI: https://doi.org/10.1364/OE.395301

2020-06-22

Abstract:Three-dimensional (3D) polarimetric integral imaging (InIm) to extract the 3D polarimetric information of objects in photon-starved conditions is investigated using a low noise visible range camera and a long wave infrared (LWIR) range camera, and the performance between the two sensors is compared. Stokes polarization parameters and degree of polarization (DoP) are calculated to extract the polarimetric information of the 3D scene while integral imaging reconstruction provides depth information and improves the performance of low-light imaging tasks. An LWIR wire grid polarizer and a linear polarizer film are used as polarimetric objects for the LWIR range and visible range cameras, respectively. To account for a limited number of photons per pixel using the visible range camera in low light conditions, we apply a mathematical restoration model at each elemental image of visible camera to enhance the signal. We show that the low noise visible range camera may outperform the LWIR camera in detection of polarimetric objects under low illumination conditions. Our experiments indicate that for 3D polarimetric measurements under photon-starved conditions, visible range sensing may produce a signal-to-noise ratio (SNR) that is not lower than the LWIR range sensing. We derive the probability density function (PDF) of the 2D and 3D degree of polarization (DoP) images and show that the theoretical model demonstrates agreement to that of the experimentally obtained results. To the best of our knowledge, this is the first report comparing the polarimetric imaging performance between visible range and infrared (IR) range sensors under photon-starved conditions and the relevant statistical models of 3D polarimetric integral imaging.
Polarisation-modulated Photon-Counting 3D Imaging Based on a Negative Parabolic Pulse Model

Rui Liu,Xin Tian,Song Li

DOI: https://doi.org/10.1364/oe.427997

IF: 3.8

2021-01-01

Optics Express

Abstract:Indirect methods based on intensity for time-of-flight measurement have attracted considerable research interest in recent years because they can provide high spatial resolution in 3D imaging. However, the majority of indirect methods are inapplicable when echo signals are small (e.g., less than one photon). We propose a novel polarisation-modulated photon-counting 3D imaging method based on a negative parabolic pulse model (NPPM) to solve this problem. We measure weak signals using the number of received photons after repetitive pulsed laser emission. We establish a computational method by exploring the relationship between photon flight time that corresponds to the polarisation-modulated state of photons controlled by phase shift and calculated photon rates from received photon-counting values based on Poisson negative log-likelihood function to calculate the distance. We specifically utilise the NPPM to estimate distribution of echo signals and reduce ranging error given that echo signals are constantly time-varying. We build the first experimental system for polarisation-modulated photon-counting 3D imaging for verification by integrating it with a dual-axis galvo scanning device. Experimental results demonstrate that the proposed method can achieve ranging accuracy at the millimeter-level and exhibit superior 3D imaging performance even when the average received number of echo signals per pulsed laser emission is smaller than 0.05.
Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

Hengyu Wang,Yao Wang,Zhonghui Chen,Chuanwei Yao,Peng Zhou,Bin Lin

DOI: https://doi.org/10.1016/j.measurement.2024.115450

IF: 5.6

2025-01-01

Measurement

Abstract:Fringe projection profilometry is a significant method for three-dimensional measurement due to its non-contact and high accuracy. However, the motion-induced error will lead to the loss of measurement accuracy in dynamic scenes due to the disruption of the phase measurement process. In this paper, we introduce a novel motion error model that considers object motion causes the misalignment of the projection points on the camera, and propose the projection points tracking method to reduce the motion-induced error. First, the speckle pattern is added to projection sequences, after which the projection point displacements are determined using the digital image correlation (DIC) method between the adjacent speckle patterns. Finally, the fringe patterns are corrected using the image remapping method to calculate the 3D shape. Quantitative analysis and dynamic measurement experiments verify the feasibility of the proposed method. Different from 3D-DIC, we use one camera-projector system to realize high-accuracy measurement in dynamic scenes.
Single-Shot White-Light Dispersive Interferometric Profilometer

Pei Zhu,Kaiwei Wang,Shuangshuang Zhao

DOI: https://doi.org/10.1117/12.869987

2010-01-01

Abstract:Traditional interferometric profilemeter suffers from phase ambiguity problem and sensitivity to environmental disturbance, thus preventing their applications for on-line surface inspections. We propose a new method to obtain the object surface's two-dimensional profile in a single shot using a dispersive interferometer. An air-spaced Fabry-Perot etalon was applied in order to decompose the light from the broadband source into discrete monochromatic constituents with equal wavelength interval. A blazed grating is implemented to effectively separate the interferograms of difference wavelength. As a result, the interference patterns of different wavelengths distributed separately on the CCD camera. By analyzing these patterns one can get the configuration of the original surface. A one-dimensional profiling experiment is carried out to test a surface with steps and the mean error of the result is below 0.2 mu m.
Research on Two Optical Methods for Aspheric Measurement

Zhu Yongjian,Yin Shaohui,Sheng Xiaomin,Tang Kun

DOI: https://doi.org/10.3321/j.issn:1004-132x.2009.03.005

2009-01-01

Abstract:To realize the 3D profilometry,a four-step phase shifting method integrated with fringes projection was adopted.In the fringe-projection profilometry,a computer-simulated fringe patterns was projected on the free-form surface of object and the fringes were captured by the phase-shifting technique.Automatic image-processing software with the proposed DCT-based phase-reconstructing algorithm was developed to reconstruct the continuous phase map from fringe patterns.The final 3D profile of object was obtained from the phase map.The corresponding experiments were conducted independently.In interferometry,a new-type interferometer was proposed,which combined the radial shear interferometer with simultaneous phase-shifting technique.It was based on the optical path with two Jamin glass plates and realized the collection of four frames of fringe patterns according to the principle of polarized light.It can test the full-field surface with different sizes and be free from vibration.The theoretical accuracy of this interferometer can reach 1/100 wavelength.Because it enjoys high anti-Jamming performance,the proposed interferometer can realize the high-precision dynamic measurement of aspheric surface under the common conditions without any vibration-isolated setup.
Three-dimensional polarimetric ptychography

Chengcheng Chang,Hua Tao,Tonglu Xing,Qiang Lin,Huiling Huang,Liqing Wu,Xiaoliang He,Guowen Zhang,Cheng Liu,Jianqiang Zhu

DOI: https://doi.org/10.1364/oe.537585

IF: 3.8

2024-10-10

Optics Express

Abstract:Chengcheng Chang, Hua Tao, Tonglu Xing, Qiang Lin, Huiling Huang, Liqing Wu, Xiaoliang He, Guowen Zhang, Cheng Liu, Jianqiang Zhu A three-dimensional polarimetric ptychography (3D-PP) technique is proposed to reconstruct the residual stress distribution in optical ... [Opt. Express 32, 38668-38678 (2024)]

optics
High dynamic range 3D measurement based on polarization and multispectrum co-modulation

Haorui Huang,Fuqian Li,Chenglin Zuo,Yajun Wang

DOI: https://doi.org/10.1364/OE.506216

2023-12-04

Abstract:Three-dimensional (3D) shape measurement serves an important role in many areas, and fringe projection profilometry (FPP) is a widely used 3D measurement technique due to its non-physical contact and high speed. The real measurement scenarios are often mixtures of specular and diffuse reflections, causing overexposed and underexposed areas to co-exist. Currently, utilizing FPP to simultaneously measure overexposed and underexposed areas remains a challenge. To solve this problem, we propose a mixed reflection model and what we believe to be a novel high dynamic range (HDR) 3D measurement method based on polarization and multispectrum co-modulation. In mixed reflection, the fringe images captured by the polarized color camera can be modulated to different intensities between different channels due to the co-modulation effect. By synthesizing all sub-images, high-modulation fringe images are formed and simultaneous reconstruction of overexposed and underexposed surfaces is finally achieved. Compared to conventional methods, the proposed method is more effective for measuring complex reflection situations, especially when objects with specular and diffuse surfaces simultaneously exist in the scene. And what we believe to be a novel no-registration-error calibration framework for multi-channel cameras has also been proposed, which both acquires a significant amount of information in the region with HDR problems and avoids the registration error due to the physical distances between different channels. Experiments were conducted to verify the effectiveness of the proposed method.
3D Imaging of Complex Specular Surfaces by Fusing Polarimetric and Deflectometric Information

Jiazhang Wang,Oliver Cossairt,Florian Willomitzer

2024-06-04

Abstract:Accurate and fast 3D imaging of specular surfaces still poses major challenges for state-of-the-art optical measurement principles. Frequently used methods, such as phase-measuring deflectometry (PMD) or shape-from-polarization (SfP), rely on strong assumptions about the measured objects, limiting their generalizability in broader application areas like medical imaging, industrial inspection, virtual reality, or cultural heritage analysis. In this paper, we introduce a measurement principle that utilizes a novel technique to effectively encode and decode the information contained in a light field reflected off a specular surface. We combine polarization cues from SfP with geometric information obtained from PMD to resolve all arising ambiguities in the 3D measurement. Moreover, our approach removes the unrealistic orthographic imaging assumption for SfP, which significantly improves the respective results. We showcase our new technique by demonstrating single-shot and multi-shot measurements on complex-shaped specular surfaces, displaying an evaluated accuracy of surface normals below $0.6^\circ$.

Computer Vision and Pattern Recognition,Optics
An on-line phase measuring profilometry: Processed modulation using for pixel matching

Yingchun Wu,Yiping Cao,Yanshan Xiao,Xu Zheng

DOI: https://doi.org/10.1016/j.ijleo.2012.02.026

IF: 3.1

2013-01-01

Optik

Abstract:An novel on-line phase measuring profilometry (PMP) is proposed, which is more helpful and accurate than the dynamic Fourier-transform profilometry (FTP) in solving the problem where the object motion is along a straight line. It can be used for industrial on-line 3-D shape inspection. In PMP, the phase shifting technique is adopted and the phase calculation from N frames deformed patterns to wrapped phase is a point-to-point performance. The movement of the object results in the displacement of images in deformed pattern, so pixel matching is carried out to modify the positions of images to meet the PMP. Modulation represents the contour of the object, which is used to guide the pixel matching in this paper. Delamination and binarization of the modulation patterns further improve the pixel matching's accuracy and speed. Experiments verify the feasibility and effectiveness of the proposed method.
Rotating linear differential polarization imaging for quantitative characterization of superficial tissues

Xiaoyu Jiang,Wei Li,Tianliang Yun,Nan Zeng,Yonghong He,Hui Ma

DOI: https://doi.org/10.1109/aoe.2007.4410883

2007-01-01

Abstract:Differential polarization images corresponding to different incident and exit polarizations are recorded and fitted to an analytical expression. The fitted parameters correlated quantitatively to the structural and optical properties of the superficial tissues.
Analysis of Polarization Detector Performance Parameters on Polarization 3D Imaging Accuracy

Pengzhang Dai,Dong Yao,Tianxiang Ma,Honghai Shen,Weiguo Wang,Qingyu Wang

DOI: https://doi.org/10.3390/s23115129

IF: 3.9

2023-05-28

Sensors

Abstract:Three-dimensional (3D) reconstruction of objects using the polarization properties of diffuse light on the object surface has become a crucial technique. Due to the unique mapping relation between the degree of polarization of diffuse light and the zenith angle of the surface normal vector, polarization 3D reconstruction based on diffuse reflection theoretically has high accuracy. However, in practice, the accuracy of polarization 3D reconstruction is limited by the performance parameters of the polarization detector. Improper selection of performance parameters can result in large errors in the normal vector. In this paper, the mathematical models that relate the polarization 3D reconstruction errors to the detector performance parameters including polarizer extinction ratio, polarizer installation error, full well capacity and analog-to-digital (A2D) bit depth are established. At the same time, polarization detector parameters suitable for polarization 3D reconstruction are provided by the simulation. The performance parameters we recommend include an extinction ratio ≥ 200, an installation error ∈ [−1°, 1°], a full-well capacity ≥ 100 Ke−, and an A2D bit depth ≥ 12 bits. The models provided in this paper are of great significance for improving the accuracy of polarization 3D reconstruction.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Full Poincare polarimetry enabled through physical inference

Chao He,Jianyu Lin,Jintao Chang,Jacopo Antonello,Ben Dai,Jingyu Wang,Jiahe Cui,Ji Qi,Min Wu,Daniel S. Elson,Peng Xi,Andrew Forbes,Martin J. Booth

DOI: https://doi.org/10.1364/OPTICA.452646

IF: 10.4

2022-01-01

Optica

Abstract:While polarization sensing is vital in many areas of research, with applications spanning from microscopy to aerospace, traditional approaches are limited by method-related error amplification, accumulation, and pre-processing steps, constraining the performance of single-shot polarimetry. Here, we propose a measurement paradigm that circumvents these limitations, based on the use of a universal full Poincare generator to map all polarization analyzer states into a single vectorially structured light field. All vector components are analyzed in a single shot, extracting the vectorial state through inference from a physical model of the resulting image, providing a single-step sensing procedure. To demonstrate the feasibility of our approach, we use a common graded index (GRIN) optic as our mapping device and show mean errors of <1% for each vector component. Our work paves the way for next-generation polarimetry, impacting a wide variety of applications that rely on vector measurement. Published by Optica Publishing Group under the terms of the Creative Commons Attribution 4.0 License.
Near-infrared monocular 3D computational polarization imaging of surfaces exhibiting nonuniform reflectance

Xuan Li,Fei Liu,Pingli Han,Shichao Zhang,Xiaopeng Shao

DOI: https://doi.org/10.1364/OE.423790

2021-05-10

Abstract:This paper presents a near-infrared (NIR) monocular 3D computational polarization imaging method to directly reconstruct the shape of surfaces exhibiting nonuniform reflectance. A reference gradient field is introduced to the weight constraints for globally correcting the ambiguity of the surface normal for a target with nonuniform reflectance. We experimentally demonstrated that our method can reconstruct the shape of surfaces exhibiting nonuniform reflectance in not only the near field but also the far field. Moreover, with the proposed method, the axial resolution can be kept constant even under different object distances as long as the ratio of the focal length to the object distance is fixed. The simplicity and robustness of the proposed method make it an attractive tool for the fast modeling of 3D scenes.
Three-dimensional reconstruction of polarized ambient light separation in complex illumination

Zhenmin Zhu,Xingning Zeng,Wenqing Long,Lifa He,Xiaokai Xu

DOI: https://doi.org/10.1364/oe.519650

IF: 3.8

2024-04-03

Optics Express

Abstract:Zhenmin Zhu, Xingning Zeng, Wenqing Long, Lifa He, Xiaokai Xu In current research, it is still a hot topic for 3D reconstruction under complex illumination. This paper uses a polarization camera ... [Opt. Express 32, 13932-13945 (2024)]

optics
Polarimetric Helmholtz Stereopsis

Yuqi Ding,Yu Ji,Zhang Chen,Mingyuan Zhou,Sing Bing Kang,Jinwei Ye

DOI: https://doi.org/10.1109/tpami.2024.3357100

IF: 23.6

2024-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:Helmholtz stereopsis (HS) exploits the reciprocity principle of light propagation (i.e., the Helmholtz reciprocity) for 3D reconstruction of surfaces with arbitrary reflectance. In this paper, we present the polarimetric Helmholtz stereopsis (polar-HS), which extends the classical HS by considering the polarization state of light in the reciprocal paths. With the additional phase information from polarization, polar-HS requires only one reciprocal image pair. We derive the reciprocity relationship of Mueller matrix and formulate new reciprocity constraint that takes polarization state into account. We also utilize polarimetric constraints and extend them to the case of perspective projection. For the recovery of surface depths and normals, we incorporate reciprocity constraint with diffuse/specular polarimetric constraints in a unified optimization framework. For depth estimation, we further propose to utilize the consistency of diffuse angle of polarization. For normal estimation, we develop a normal refinement strategy based on degree of linear polarization. Using a hardware prototype, we show that our approach produces high-quality 3D reconstruction for different types of surfaces, ranging from diffuse to highly specular.

computer science, artificial intelligence,engineering, electrical & electronic
Robust structured light 3D measurement method based on polarization-encoded projection patterns

Zhenmin Zhu,Yumeng Zhou,Wenquan Lu,Jing Zhang,Lisheng Zhou,Haoran Liu

DOI: https://doi.org/10.1364/AO.502522

2024-01-01

Abstract:Fringe projection profilometry (FPP) is widely used in 3D vision measurement because of its high robustness and measurement accuracy. In the case of HDR objects, due to the problem of surface reflectivity, the obtained image will be overexposed. This will cause the sinusoidality of the fringes projected on the surface of the object in the acquired image to be interfered, resulting in a phase error in the calculated wrapped phase. Therefore, a polarization-encoded sinusoidal structured light is proposed to enhance the sinusoidality of the fringe. The phase information contained in the polarized sinusoidal structured light fringe is only related to the polarization state, not to the light intensity. A polarization coding assisted structured light measurement strategy (PASM) is proposed. This method uses polarization coding assisted polarization phase-shifting fringes for phase unwrapping. The angle of the linear polarizer is set to zero in this method, and it does not require rotating the polarizer. It only needs a single exposure to improve the fringe quality and obtain a more stable unwrapping phase. The experimental results show that the obtained polarization fringes have better sinusoidality, and the phase unwrapping can be more accurate. The reconstructed 3D point cloud also does not appear missing and has better accuracy. It is a reliable method for vision measurement of HDR objects.
Direct fringe projection profilometry based on the spatial frequency distribution function in optical 3D imaging

Yongze Xu,Jinfeng Yang,Yanqing Dong,Peng Shi,Huarui Sun

DOI: https://doi.org/10.1016/j.optlastec.2024.110695

IF: 4.939

2024-07-01

Optics & Laser Technology

Abstract:Phase unwrapping has been a big hurdle in conventional optical three-dimensional (3D) measurement technologies, badly affecting speed and accuracy. To skip the complicated step of phase unwrapping, a direct fringe projection profilometry based on the spatial frequency distribution function is presented in this paper. First, the spatial frequency distribution function is defined according to the physical meaning of spatial frequency. Then, direct phase-shift method and direct Fourier transform profilometry are developed respectively with reference to the conventional fringe projection profilometry. Finally, both numerical simulations and experiments were carried out to test the proposed direct fringe projection profilometry. The direct phase-shift method without phase unwrapping combines the advantages of the conventional in terms of high accuracy, while the direct Fourier transform method does not get rid of the drawbacks of the conventional in spectral aliasing although it skips the phase unwrapping procedure.

optics,physics, applied
High-precision polarization imaging for three-dimensional reconstruction aided by a separate coarse depth map

Yao Hu,Chuheng Xu,Qun Hao,Shaohui Zhang,Ci Song,Yiming Liu,Zichen Wang,Chao Lin

DOI: https://doi.org/10.1364/ao.517452

IF: 1.9

2024-06-13

Applied Optics

Abstract:Yao Hu, Chuheng Xu, Qun Hao, Shaohui Zhang, Ci Song, Yiming Liu, Zichen Wang, Chao Lin For less-texture objects with highly reflective regions, traditional vision-based three-dimensional reconstruction techniques often fail to ... [Appl. Opt. 63, 4799-4808 (2024)]

optics
Pose Estimation Using Polarimetric Imaging in Low-Light Environment

Zhenhua Wan,Kaichun Zhao,Jinkui Chu

DOI: https://doi.org/10.1117/12.2617518

2022-01-01

Abstract:Visual pose estimation is of great significance in the field of precision measurement and navigation and positioning. However, under low-light illumination conditions, the feature extraction of traditional visual images is easy to fail, resulting in the failure of visual pose estimation. This paper proposes a pose estimation method based on polarimetric imaging under low-light illumination conditions. This method calculates the polarization information of the target environment and uses the polarization image to calculate the pose. Since the degree of polarization can highlight the contour of the target, this method combines the advantages of the polarization characteristics of the target environment to estimate the pose. Through environmental experiments, we found that the grayscale distribution of the polarization image is more uniform in the low-light environment, and the grayscale does not change significantly with the illumination. We verified the feasibility of the proposed posture estimation method based on polarimetric imaging. This method provides a technical reference for special scenarios (tunnels, underground parking lots).

Polarimetric 3D integral imaging profilometry under degraded environmental conditions

Deep learning polarimetric three-dimensional integral imaging object recognition in adverse environmental conditions

Three-dimensional polarimetric integral imaging in photon-starved conditions: performance comparison between visible and long wave infrared imaging

Polarisation-modulated Photon-Counting 3D Imaging Based on a Negative Parabolic Pulse Model

Real-time Motion-Induced Error Reduction for Phase-Shifting Profilometry with Projection Points Tracking Method

Single-Shot White-Light Dispersive Interferometric Profilometer

Research on Two Optical Methods for Aspheric Measurement

Three-dimensional polarimetric ptychography

High dynamic range 3D measurement based on polarization and multispectrum co-modulation

3D Imaging of Complex Specular Surfaces by Fusing Polarimetric and Deflectometric Information

An on-line phase measuring profilometry: Processed modulation using for pixel matching

Rotating linear differential polarization imaging for quantitative characterization of superficial tissues

Analysis of Polarization Detector Performance Parameters on Polarization 3D Imaging Accuracy

Full Poincare polarimetry enabled through physical inference

Near-infrared monocular 3D computational polarization imaging of surfaces exhibiting nonuniform reflectance

Three-dimensional reconstruction of polarized ambient light separation in complex illumination

Polarimetric Helmholtz Stereopsis

Robust structured light 3D measurement method based on polarization-encoded projection patterns

Direct fringe projection profilometry based on the spatial frequency distribution function in optical 3D imaging

High-precision polarization imaging for three-dimensional reconstruction aided by a separate coarse depth map

Pose Estimation Using Polarimetric Imaging in Low-Light Environment