Optimizing near-infrared polariscopic imaging for the living human eye

Quinn Jarecki,Meredith Kupinski

DOI: https://doi.org/10.1364/oe.520657

IF: 3.8

2024-05-02

Optics Express

Abstract:Quinn Jarecki, Meredith Kupinski Hardware architectures and image interpretation can be simplified by partial polarimetry. Mueller matrix (MM) polarimetry allows the ... [Opt. Express 32, 18113-18126 (2024)]

optics

What problem does this paper attempt to address?

Machine Learning Model for Complete Reconstruction of Diagnostic Polarimetric Images from partial Mueller polarimetry data

Sooyong Chae,Tongyu Huang,Omar Rodrıguez-Nunez,Théotim Lucas,Jean-Charles Vanel,Jérémy Vizet,Angelo Pierangelo,Gennadii Piavchenko,Tsanislava Genova,Ajmal Ajmal,Jessica C. Ramella-Roman,Alexander Doronin,Hui Ma,Tatiana Novikova

2024-09-20

Abstract:The translation of imaging Mueller polarimetry to clinical practice is often hindered by large footprint and relatively slow acquisition speed of the existing instruments. Using polarization-sensitive camera as a detector may reduce instrument dimensions and allow data streaming at video rate. However, only the first three rows of a complete 4x4 Mueller matrix can be measured. To overcome this hurdle we developed a machine learning approach using sequential neural network algorithm for the reconstruction of missing elements of a Mueller matrix from the measured elements of the first three rows. The algorithm was trained and tested on the dataset of polarimetric images of various excised human tissues (uterine cervix, colon, skin, brain) acquired with two different imaging Mueller polarimeters operating in either reflection (wide-field imaging system) or transmission (microscope) configurations at different wavelengths of 550 nm and 385 nm, respectively. The reconstruction performance was evaluated using various error metrics, all of which confirmed low error values. The execution time of the trained neural network algorithm was about 300 microseconds for a single image pixel. It suggests that a machine learning approach with parallel processing of all image pixels combined with the partial Mueller polarimeter operating at video rate can effectively substitute for the complete Mueller polarimeter and produce accurate maps of depolarization, linear retardance and orientation of the optical axis of biological tissues, which can be used for medical diagnosis in clinical settings.

Optics,Medical Physics
Complex Spatial Illumination Scheme Optimization of Backscattering Mueller Matrix Polarimetry for Tissue Imaging and Biosensing

Wei Jiao,Zheng Zhang,Nan Zeng,Rui Hao,Honghui He,Chao He,Hui Ma

DOI: https://doi.org/10.3390/bios14040208

2024-04-23

Biosensors

Abstract:Polarization imaging and sensing techniques have shown great potential for biomedical and clinical applications. As a novel optical biosensing technology, Mueller matrix polarimetry can provide abundant microstructural information of tissue samples. However, polarimetric aberrations, which lead to inaccurate characterization of polarization properties, can be induced by uneven biomedical sample surfaces while measuring Mueller matrices with complex spatial illuminations. In this study, we analyze the detailed features of complex spatial illumination-induced aberrations by measuring the backscattering Mueller matrices of experimental phantom and tissue samples. We obtain the aberrations under different spatial illumination schemes in Mueller matrix imaging. Furthermore, we give the corresponding suggestions for selecting appropriate illumination schemes to extract specific polarization properties, and then provide strategies to alleviate polarimetric aberrations by adjusting the incident and detection angles in Mueller matrix imaging. The optimized scheme gives critical criteria for the spatial illumination scheme selection of non-collinear backscattering Mueller matrix measurements, which can be helpful for the further development of quantitative tissue polarimetric imaging and biosensing.

chemistry, analytical,nanoscience & nanotechnology,instruments & instrumentation
Incidence-modularized 3 × 4 Mueller Matrix Polarimetry: A Targeted Tool with High Temporal Resolution for In-Vivo Tissue Imaging

Zheng Zhang,Nan Zeng,Wei Jiao,Changjiang Mi,Rui Hao,Honghui He,Chao He,Hui Ma

DOI: https://doi.org/10.1016/j.optlastec.2024.111275

IF: 4.939

2024-01-01

Optics & Laser Technology

Abstract:Mueller matrix (MM) polarimetry is prevalently used in biomedical research and clinical diagnosis, as it can provide comprehensive polarization information of tissue label-freely. However, the widely adopted constantstep rotating MM polarimetric systems often require a great deal of measuring time, thus can hardly be employed in dynamic biomedical application scenarios. In this study, we present a novel idea for generating multiple states of polarization using a filter -like sliding method instead of rotating quarter-wave plate, and analyze the superior characterization ability of additionally acquired circularly polarization information using the proposed incidence-modularized polarimetry system (IMPS) on dynamic tissue polarimetry. We design a polarization state generator assembled with multiple polarizer units for incident states of polarization modulation. Driven by a screw linear motor, the module polarizer units are traversed sequentially at a high speed to reduce the measurement time of a 3 x 4 MM to within 5 s. It is shown that the proposed IMPS can even achieve a faster measurement for specifically targeted polarimetry schemes. Besides, it can circumvent various measuring errors benefiting from its fixed and stationary polarizer units. Both transmission and backscattering tissue imaging results demonstrate that, the IMPS exhibits accurate imaging capability of providing polarization information such as circular diattenuation, retardance and birefringence orientation with high temporal resolution. With the appearance of various screw linear motors of advanced mechanical performance, the idea and system developed in this study can offer a potentially powerful tool of fast and informative imaging in various in -vivo clinical applications.
Time-efficient filtering of polarimetric data by checking physical realizability of experimental Mueller matrices

Tatiana Novikova,Alexey Ovchinnikov,Gleb Pogudin,Jessica C. Ramella-Roman

2024-02-29

Abstract:Imaging Mueller polarimetry has already proved its potential for metrology, remote sensing and biomedicine. The real-time applications of this modality require both video rate image acquisition and fast data post-processing algorithms. First, one must check the physical realizability of the experimental Mueller matrices in order to filter out non-physical data, i.e. to test the positive semi-definiteness of the 4x4 Hermitian coherency matrix calculated from the elements of the corresponding Mueller matrix pixel-wise. For this purpose, we compared the execution time for the calculations of i) eigenvalues, ii) Cholesky decomposition, iii) Sylvester's criterion, and iv) coefficients of the characteristic polynomial of the Hermitian coherency matrix using two different approaches, all calculated for the experimental Mueller matrix images (600 pixels x 700 pixels) of mouse uterine cervix. The calculations were performed using C++ and Julia programming languages. Our results showed the superiority of the algorithm iv), in particular, the version based on the simplification via Pauli matrices, in terms of execution time for our dataset, over other algorithms. The sequential implementation of the latter algorithm on a single core already satisfies the requirements of real-time polarimetric imaging in various domains. This can be further amplified by the proposed parallelization (for example, we achieve a 5-fold speed up on 6 cores).

Optics,Image and Video Processing,Medical Physics
Ray Ellipse Method of Analyzing the Power and Polarization State of Partially Polarized Light

Liu Chao,Cen Zhao-Feng,Li Xiao-Tong,Xu Wei-Cai,Shang Hong-Bo,Neng Fen,Chen Li

DOI: https://doi.org/10.7498/aps.61.134201

IF: 0.906

2012-01-01

Acta Physica Sinica

Abstract:It is difficult to cope with the changes in power and polarization for partially polarized light. The light polarization will also affect the image quality, especially for imaging with large numerical aperture. A novel method of analyzing the power and the polarization state of partially polarized light is proposed in this paper. This method has a good intuitiveness and requires much smaller computation. An aplanatic lens system is simulated. Polarization effect caused is analyzed with this method. The results show that for the imaging light the intensity of TM polarized light relatively increases because of large numerical aperture, which will influence image contrast. Imaging in high refractive index medium can be used to improve this problem.
Polaromics: Deriving Polarization Parameters from a Mueller Matrix for Quantitative Characterization of Biomedical Specimen

Pengcheng Li,Yang Dong,Jiachen Wan,Honghui He,Tariq Aziz,Hui Ma

DOI: https://doi.org/10.1088/1361-6463/ac292f

2022-01-01

Abstract:A Mueller matrix is a comprehensive representation of the polarization transformation properties of a sample, encoding very rich information on the microstructure of the scattering objects. However, it is often inconvenient to use individual Mueller matrix elements to characterize the microstructure due to a lack of explicit connections between the matrix elements and the physics properties of the scattering samples. In this review, we summarize the methods to derive groups of polarization parameters, which have clear physical meanings and associations with certain structural properties of turbid media, including various Mueller matrix decomposition (MMD) methods and the Mueller matrix transformation (MMT) technique. Previously, experimentalists have chosen the most suitable method for the specific measurement scheme. In this review, we introduce an emerging novel research paradigm called 'polaromics'. In this paradigm, both MMD and MMT parameters are considered as polarimetry basis parameters (PBP), which are used to construct polarimetry feature parameters (PFPs) for the quantitative characterization of complex biomedical samples. Machine learning techniques are involved to find PFPs that are sensitive to specific micro- or macrostructural features. The goal of this review is to provide an overview of the emerging 'polaromics' paradigm, which may pave the way for biomedical and clinical applications of polarimetry.
Analysis and Optimization of Aberration Induced by Oblique Incidence for In-Vivo Tissue Polarimetry.

Zheng Zhang,Rui Hao,Conghui Shao,Changjiang Mi,Honghui He,Chao He,E. Du,Shaoxiong Liu,Jian Wu,Hui Ma

DOI: https://doi.org/10.1364/ol.501365

2023-01-01

Abstract:For in-vivo polarimetry such as Mueller matrix endoscopy of human internal organ cavities, the complicated undulating tissue surfaces deliver an inescapable occurrence of oblique incidence, which induce a prominent aberration to backscattering tissue polarimetry. In this Letter, we quantitatively analyze such polarimetric aberration on polarization basic parameters derived from the Mueller matrix. A correlation heatmap is obtained as applicable criteria to select an appropriate incident angle for different polarization basic parameters. Based on the analyzing results, we propose two aberration optimization strategies of parameter selection and azimuth rotation, which are suitable for tissue samples with randomly and well-aligned fiber textures, respectively. Both strategies are demonstrated to be effective in the ex-vivo human gastric muscularis tissue experiment. The findings presented in this Letter can be useful to provide accurate polarization imaging results, widely applied on in-vivo polarimetric endoscopy for tissues with complicated surface topography.
Near-real-time Mueller polarimetric image processing for neurosurgical intervention

Stefano Moriconi,Omar Rodríguez-Núñez,Romain Gros,Leonard A. Felger,Theoni Maragkou,Ekkehard Hewer,Angelo Pierangelo,Tatiana Novikova,Philippe Schucht,Richard McKinley

DOI: https://doi.org/10.1007/s11548-024-03090-6

2024-03-21

International Journal of Computer Assisted Radiology and Surgery

Abstract:Wide-field imaging Mueller polarimetry is a revolutionary, label-free, and non-invasive modality for computer-aided intervention; in neurosurgery, it aims to provide visual feedback of white matter fibre bundle orientation from derived parameters. Conventionally, robust polarimetric parameters are estimated after averaging multiple measurements of intensity for each pair of probing and detected polarised light. Long multi-shot averaging, however, is not compatible with real-time in vivo imaging, and the current performance of polarimetric data processing hinders the translation to clinical practice.

engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
Ptychographic Mueller matrix imaging (PMMI): principle and proof-of-concept demonstration

Ming Gong,Li Lliu,Jinxiang Du,Bailin Zhuang,Jiamin Liu,Honggang Gu,Shiyuan Liu

DOI: https://doi.org/10.1364/ol.539100

IF: 3.6

2024-11-06

Optics Letters

Abstract:Ming Gong, Li Liu, Jinxiang Du, Bailin Zhuang, Jiamin Liu, Honggang Gu, Shiyuan Liu Quantitative characterization of optical anisotropies is extremely important for wide fields and applications. The Mueller matrix, ... [Opt. Lett. 49, 6409-6412 (2024)]

optics
Underdetermined Polarimetric Measurements for Mueller Extrapolations

Quinn Jarecki,Meredith Kupinski

DOI: https://doi.org/10.1117/1.OE.61.12.123104

2022-11-29

Abstract:Polarized light-matter interactions are mathematically described by the Mueller matrix (MM)-valued polarized bidirectional reflectance distribution function (pBRDF). A pBRDF is parameterized by 16 degrees of freedom that depend upon scattering geometry. A triple degenerate (TD) MM assumption reduces the degrees of freedom to eight: one for reflectance, six for non-depolarizing properties, and one for depolarization. When the non-depolarizing dominant process is known or assumed (e.g. Fresnel reflection), the degrees of freedom are further reduced to two. For a given material, if the TD model is appropriate and the dominant non-depolarizing process is known, then these two degrees of freedom can be estimated from as few as two polarimetric measurements. Thus, the MM can be extrapolated from a reduced number of measurements. The primary contribution of this work is the development and demonstration of a linear estimator for a MM's dominant eigenvalue (i.e. single depolarization parameter) which requires fewer measurements than a full MM reconstruction. MM extrapolations from single snapshot acquisitions with a Sony Triton 5.0MP Polarization Camera are performed at 30 acquisition geometries and two wavelengths on an ensemble of LEGO bricks treated to have varying surface roughness. These extrapolated MMs are compared to MMs reconstructed from a complete dual rotating retarder (DRR) Mueller imaging polarimeter. The flux error mean and mode are 11.06% and 1.03%, respectively, despite a 10x reduction in the number of polarimetric measurements.

Optics
Full Poincare polarimetry enabled through physical inference

Chao He,Jianyu Lin,Jintao Chang,Jacopo Antonello,Ben Dai,Jingyu Wang,Jiahe Cui,Ji Qi,Min Wu,Daniel S. Elson,Peng Xi,Andrew Forbes,Martin J. Booth

DOI: https://doi.org/10.1364/OPTICA.452646

IF: 10.4

2022-01-01

Optica

Abstract:While polarization sensing is vital in many areas of research, with applications spanning from microscopy to aerospace, traditional approaches are limited by method-related error amplification, accumulation, and pre-processing steps, constraining the performance of single-shot polarimetry. Here, we propose a measurement paradigm that circumvents these limitations, based on the use of a universal full Poincare generator to map all polarization analyzer states into a single vectorially structured light field. All vector components are analyzed in a single shot, extracting the vectorial state through inference from a physical model of the resulting image, providing a single-step sensing procedure. To demonstrate the feasibility of our approach, we use a common graded index (GRIN) optic as our mapping device and show mean errors of <1% for each vector component. Our work paves the way for next-generation polarimetry, impacting a wide variety of applications that rely on vector measurement. Published by Optica Publishing Group under the terms of the Creative Commons Attribution 4.0 License.
Mueller Matrix Imaging Optimized by Uniform Illumination

Wei Guo,Jiawei Song,Nan Zeng,Hui Ma

DOI: https://doi.org/10.3389/fphy.2022.931958

IF: 3.718

2022-01-01

Frontiers in Physics

Abstract:In this study, we present a flat-field Mueller matrix imaging system to reduce the reconstruction error caused by critical illumination. This study demonstrates that the signal-to-noise ratio (SNR) of the reconstructed images is improved by about eight times by adding a beam shaping module made up of microlens arrays to a traditional Mueller system. The scalar diffraction theory and polarization numerical simulation show the ability of the new device in minimizing the adverse effects of light source noise on polarization reconstruction results. Finally, the experiment results on standard resolution board, porous anodic alumina, and real pathological slices further confirm the superiority of the flat-field Mueller system in precisely identifying sample structure and quantitative differences between various polarization parameters (depolarization ratio Delta, linear retardance delta, and birefringence orientation theta), demonstrating the potential of flat-field polarization imaging in pathological diagnosis and tissue characteristic extraction.
Simple near-monostatic Mueller polarimeter

Nathaniel J. Field,Joseph A. Shaw

DOI: https://doi.org/10.1364/ao.538901

IF: 1.9

2024-09-27

Applied Optics

Abstract:Nathaniel J. Field, Joseph A. Shaw Inferring material properties from active or passive polarimetric remote sensing requires knowledge of the polarized bidirectional ... [Appl. Opt. 63, 7540-7546 (2024)]

optics
Mueller Matrix Polarimetry: A Label-Free, Quantitative Optical Method for Clinical Diagnosis

Shen Yuanxing,Yao Yue,He Honghui,Liu Shaoxiong,Ma Hui

DOI: https://doi.org/10.3788/cjl202047.0207001

2020-01-01

Chinese Journal of Lasers

Abstract:Of late, with the emergence of new optical devices and technological advances in data processing, polarization techniques arc being increasingly used in biomedicine. Mueller matrix calculus is suitable for describing the polarization properties of biomedical specimens because of its mathematical completeness and compatibility with common optical equipment. Compared with traditional non-polarization optical methods, Mueller matrix polarimetry is sensitive to the scattering induced by subwavelength structures and can provide more information about anisotropic optical properties, including the birefringence and diattenuation of a sample. In this review, we introduce Mueller matrix calculus and related technologies that have great application potential in biomedical studies, including the Mueller matrix decomposition and transformation methods, transmission Mueller matrix microscopes, backscattering Mueller matrix imaging equipment, Mueller matrix endoscopes, and polarization staining techniques. Further, we summarize the improvements in clinical diagnosis made using Mueller matrix polarimetry, such as detection of liver cancer, gastrointestinal cancer, and breast ductal carcinoma tissues. As a label -free, noninvasive, quantitative, and rapid imaging method, Mueller matrix polarimetry has broad application prospects in biomedical studies and clinical diagnosis.
Near-infrared monocular 3D computational polarization imaging of surfaces exhibiting nonuniform reflectance

Xuan Li,Fei Liu,Pingli Han,Shichao Zhang,Xiaopeng Shao

DOI: https://doi.org/10.1364/OE.423790

2021-05-10

Abstract:This paper presents a near-infrared (NIR) monocular 3D computational polarization imaging method to directly reconstruct the shape of surfaces exhibiting nonuniform reflectance. A reference gradient field is introduced to the weight constraints for globally correcting the ambiguity of the surface normal for a target with nonuniform reflectance. We experimentally demonstrated that our method can reconstruct the shape of surfaces exhibiting nonuniform reflectance in not only the near field but also the far field. Moreover, with the proposed method, the axial resolution can be kept constant even under different object distances as long as the ratio of the focal length to the object distance is fixed. The simplicity and robustness of the proposed method make it an attractive tool for the fast modeling of 3D scenes.
Lensless Mueller holographic microscopy with robust noise reduction for multiplane polarization imaging

Maria J. Lopera,Mikołaj Rogalski,Piotr Arcab,Marzena Stefaniuk,Yunfeng Nie,Heidi Ottevaere,Carlos Trujillo,Maciej Trusiak

DOI: https://doi.org/10.1016/j.optlastec.2024.111936

IF: 4.939

2024-10-10

Optics & Laser Technology

Abstract:Lensless holographic microscopy has emerged as a powerful and cost-effective tool for computational imaging, offering high resolution over a large field of view, beneficial for various biological applications. However, conventional approaches can struggle with contrast and accurate visualization of diverse components over the samples, which can directly affect the diagnostic precision of the techniques. Mueller imaging, while offering detailed, stain-free observations of polarized light responses in samples, often has a limited field of view and single plane information. This is due to the use of high NA microscope objectives and generally complex hardware setups, thus narrowing its practical effectiveness. This work introduces a Lensless Mueller Holographic Microscopy (LMHM) system that overcomes these limitations, enabling large field of view, volumetric multi-layer imaging, and Mueller matrix computation using in-line lens-free holography setup. The proposed system provides precision visualization of polarization information in samples, offering high-quality features due to the incorporation of a numerical multi-height Gerchberg-Saxton reconstruction algorithm with additional complex field filtering and a physical rotating diffuser. The proposed LMHM framework is validated with a calibrated USAF 1951 birefringent test target. A multiplane sample containing cloth fiber is utilized to study the LMHM capabilities of imaging volumetric samples. Finally, the LMHM is used to analyze two mice's brain slices, effectively showcasing this organ's anatomy. Among other structures in the brain, the proposed method easily allows the visualization of, e.g., the corpus callosum. These results constitute a proof-of-concept evaluation for bioimaging applications.

optics,physics, applied
Broadband extended source imaging Mueller-matrix polarimeter

Juan Manuel López-Téllez,Russell A Chipman,Lisa W Li,Scott C McEldowney,Matthew H Smith

DOI: https://doi.org/10.1364/OL.44.001544

2019-04-01

Abstract:An imaging Mueller matrix polarimeter, named the red-green-blue (RGB)950, takes images of medium-sized (tens of centimeters) objects by using a very bright source, large polarization state generator, and high-quality camera. Its broadband extended light source switches between red, green, blue, and near-infrared light to allow taking polarimetric images for comparison with RGB camera images. The large diffuse source makes shadow transitions gradual and spreads out the specular reflected spot into a larger less conspicuous area.
Kalman filtering approach to polarimetric calibration of an optical imager

Daniel Letros,Adam Bourassa,Doug Degenstein

DOI: https://doi.org/10.1364/ao.522809

IF: 1.9

2024-06-04

Applied Optics

Abstract:Daniel Letros, Adam Bourassa, Doug Degenstein The Mueller matrix of an optical instrument describes the polarimetric effects the instrument will have on the optical observations it ... [Appl. Opt. 63, 4566-4582 (2024)]

optics
A method for obtaining the full field of view Mueller matrix of optical systems by fitting the Orientation Zernike Polynomial parameters

Chunming Jiang,Dong Yao,Honghai Shen,Feifan Shi

DOI: https://doi.org/10.1016/j.optlaseng.2024.108196

IF: 5.666

2024-03-28

Optics and Lasers in Engineering

Abstract:Polarization imaging technology expands the dimensions of the object and enriches its basic information compared to traditional imaging methods. During the imaging process, the polarization information of the object is changed by the aberration of the optical system, which affects the detection accuracy. In this article, we analyzed the Cassegrain system and the double Gaussian system. By using the Orientation Zernike Polynomial (OZP), we decomposed the system's diattenuation pupil and retardance pupil. We discovered a functional relationship between the OZP coefficients and the field of view. By fitting this relationship, we obtained the Mueller matrix for the full field of view. Compared to previous method of tracing a large number of polarized optical rays and integrating to obtain the Mueller matrix in optical software, this approach is more convenient and efficient. Furthermore, the obtained full-field Mueller matrix can provide theoretical guidance for the experimental calibration and system correction of optical system Mueller matrices.

optics

Optimizing near-infrared polariscopic imaging for the living human eye

Machine Learning Model for Complete Reconstruction of Diagnostic Polarimetric Images from partial Mueller polarimetry data

Complex Spatial Illumination Scheme Optimization of Backscattering Mueller Matrix Polarimetry for Tissue Imaging and Biosensing

Incidence-modularized 3 × 4 Mueller Matrix Polarimetry: A Targeted Tool with High Temporal Resolution for In-Vivo Tissue Imaging

Time-efficient filtering of polarimetric data by checking physical realizability of experimental Mueller matrices

Ray Ellipse Method of Analyzing the Power and Polarization State of Partially Polarized Light

Polaromics: Deriving Polarization Parameters from a Mueller Matrix for Quantitative Characterization of Biomedical Specimen

Analysis and Optimization of Aberration Induced by Oblique Incidence for In-Vivo Tissue Polarimetry.

Near-real-time Mueller polarimetric image processing for neurosurgical intervention

Ptychographic Mueller matrix imaging (PMMI): principle and proof-of-concept demonstration

Underdetermined Polarimetric Measurements for Mueller Extrapolations

Full Poincare polarimetry enabled through physical inference

Mueller Matrix Imaging Optimized by Uniform Illumination

Simple near-monostatic Mueller polarimeter

Mueller Matrix Polarimetry: A Label-Free, Quantitative Optical Method for Clinical Diagnosis

Near-infrared monocular 3D computational polarization imaging of surfaces exhibiting nonuniform reflectance

Lensless Mueller holographic microscopy with robust noise reduction for multiplane polarization imaging

Broadband extended source imaging Mueller-matrix polarimeter

Kalman filtering approach to polarimetric calibration of an optical imager

A method for obtaining the full field of view Mueller matrix of optical systems by fitting the Orientation Zernike Polynomial parameters