Solving the Photon Maze for Sensing and Imaging Inside Scattering Media

Cheng Ma

DOI: https://doi.org/10.1364/apos.2016.w1a.7

2016-01-01

Abstract:This paper summarizes some of our recent achievements in suppressing light scattering. These technologies may have profound impacts in biomedical applications since most biological tissues are opaque to visible or near-infrared photons due to scattering.

What problem does this paper attempt to address?

Solving the Inverse Scattering Problem in Reflection-Mode Dynamic Speckle-Field Phase Microscopy (conference Presentation)

Renjie Zhou,Peter T. C. So,Zahid Yaqoob,Di Jin,Poorya Hosseini,Cuifang Kuang,Vijay Raj Singh,Yang-Hyo Kim,Ramachandra R. Dasari

DOI: https://doi.org/10.1117/12.2251378

2017-01-01

Abstract:Most of the quantitative phase microscopy systems are unable to provide depth-resolved information for measuring complex biological structures. Optical diffraction tomography provides a non-trivial solution to it by 3D reconstructing the object with multiple measurements through different ways of realization. Previously, our lab developed a reflection-mode dynamic speckle-field phase microscopy (DSPM) technique, which can be used to perform depth resolved measurements in a single shot. Thus, this system is suitable for measuring dynamics in a layer of interest in the sample. DSPM can be also used for tomographic imaging, which promises to solve the long-existing “missing cone” problem in 3D imaging. However, the 3D imaging theory for this type of system has not been developed in the literature. Recently, we have developed an inverse scattering model to rigorously describe the imaging physics in DSPM. Our model is based on the diffraction tomography theory and the speckle statistics. Using our model, we first precisely calculated the defocus response and the depth resolution in our system. Then, we further calculated the 3D coherence transfer function to link the 3D object structural information with the axially scanned imaging data. From this transfer function, we found that in the reflection mode excellent sectioning effect exists in the low lateral spatial frequency region, thus allowing us to solve the “missing cone” problem. Currently, we are working on using this coherence transfer function to reconstruct layered structures and complex cells.
Guiding Photons Through the Scattering Maze: Progress and Challenges in Optical Wavefront Shaping

Cheng Ma,Lihong V. Wang

DOI: https://doi.org/10.1364/acpc.2016.as3h.2

2016-01-01

Abstract:This paper summarizes some of our recent achievements in suppressing the effect of light scattering. These technologies may have profound impacts on biomedical optics because scattering makes most biological tissues opaque.
Single-photon 3D imaging of room-scale scenes through scattering media

Jianwei Zeng,Wei Li,Yijun Zhou,Feihu Xu

DOI: https://doi.org/10.1364/oe.538003

IF: 3.8

2024-10-26

Optics Express

Abstract:Jianwei Zeng, Wei Li, Yijun Zhou, Feihu Xu Light detection and ranging (LiDAR) utilizes eye-safe laser beams to perceive the world in three-dimensional (3D) detail, offering machines ... [Opt. Express 32, 40706-40718 (2024)]

optics
Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Yiwen Zhang,Minh Dinh,Zeyu Wang,Tianhao Zhang,Tianhang Chen,Chia Wei Hsu

2024-06-04

Abstract:The multiple scattering of light makes materials opaque and obstructs imaging. Wavefront shaping can reverse the scattering process, but imaging with physical wavefront shaping has limitations such as requiring physical guidestars, being restricted within a small isoplanatic volume, and relying on slow wavefront updates, with some approaches only working for planar targets outside the scattering media. Here, we introduce scattering matrix tomography (SMT): measure the hyperspectral scattering matrix of the sample, use it to digitally scan a synthesized confocal spatiotemporal focus and construct a volumetric image of the sample, and then use the tomograms as virtual guidestars in a nonconvex optimization to find the pulse shape, input wavefront, and output wavefront that can compensate for aberrations and scattering. SMT combines the strengths of wavefront shaping, spatiotemporal gating, and computational adaptive optics, eliminating physical guidestars and enabling digital double-path wavefront corrections tailored for every isoplanatic volume. We demonstrate sub-micron lateral resolution and one-micron axial resolution at one millimeter beneath ex vivo mouse brain tissue and over three transport mean free paths inside an opaque colloid, where existing imaging methods all fail due to the overwhelming multiple scattering. As a noninvasive and label-free method that works both inside and outside the scattering media, SMT may be applied broadly across medical imaging, biological science, device inspection, and colloidal physics.

Optics,Biological Physics
Single photon single pixel imaging into thick scattering medium

Long Pan,Yuecheng Shen,Ji Qi,Junhui Shi,Xiaohua Feng

DOI: https://doi.org/10.1364/oe.484874

IF: 3.8

2023-04-13

Optics Express

Abstract:Long Pan, Yuecheng Shen, Ji Qi, Junhui Shi, Xiaohua Feng Imaging into thick scattering medium is a long-standing challenge. Beyond the quasi-ballistic regime, multiple scattering scrambles the ... [Opt. Express 31, 13943-13958 (2023)]

optics
3D Object Imaging through Scattering Media

Xiangsheng Xie,Huichang Zhuang,Hexiang He,Xiaoqing Xu,Haowen Liang,Yikun Liu,Jianying Zhou

DOI: https://doi.org/10.48550/arXiv.1711.11356

2017-11-30

Abstract:Human ability to visualize an image is usually hindered by optical scattering. Recent extensive studies have promoted imaging technique through turbid materials to a reality where color image can be restored behind scattering media in real time. The big challenge now is to recover a 3D object in a large field of view with depth resolving ability. Here, we reveal a new physical relationship between speckles generated from objects at different planes. With a single given point spread function, 3D imaging through scattering media is achieved even beyond the depth of field (DOF). Experimental testing of standard scattering media shows that the original DOF can be extended up to 5 times and the physical mechanism is depicted. This extended 3D imaging is expected to have important applications in science, technology, bio-medical, security and defense.

Optics,Biological Physics
Full-wave simulations of tomographic optical imaging inside scattering media

Zeyu Wang,Yiwen Zhang,Chia Wei Hsu

2023-12-28

Abstract:Label-free tomographic optical imaging inside scattering media is important for medical diagnosis, biological science, colloidal physics, and device inspection. An outstanding challenge is that the ground-truth structure is often unknown, so one cannot rigorously assess and compare different imaging schemes. Here we demonstrate full-wave simulations of tomographic optical imaging deep inside scattering media, which provide not only the ground truth but also the flexibility to tailor the structure and the convenience of comparing different imaging schemes in the same virtual setup with minimal cost. We model reflectance confocal microscopy, optical coherence tomography, optical coherence microscopy, interferometric synthetic aperture microscopy, and the recently proposed scattering matrix tomography for imaging nanoparticle targets embedded in a large scattering medium. The ground truth enables the identification of artifacts that would typically be mistaken as being correct while setting a rigorous and uniform standard across different methods. This work shows how full-wave simulations can fill the gaps of experiments for studying imaging inside scattering media.

Optics
Controlling light in scattering media noninvasively using the photo-acoustic transmission-matrix

T. Chaigne,O. Katz,A.C. Boccara,M. Fink,E. Bossy,S. Gigan

DOI: https://doi.org/10.1038/nphoton.2013.307

2013-05-27

Abstract:Optical wavefront-shaping has emerged as a powerful tool to manipulate light in strongly scattering media. It enables diffraction-limited focusing and imaging at depths where conventional microscopy techniques fail. However, while most wavefront-shaping works to-date exploited direct access to the target or implanted probes, the challenge is to apply it non-invasively inside complex samples. Ultrasonic-tagging techniques have been recently demonstrated but these require a sequential point-by- point acquisition, a major drawback for imaging applications. Here, we introduce a novel approach to non-invasively measure the optical transmission-matrix inside a scattering medium, exploiting the photo-acoustic effect. Our approach allows for the first time to simultaneously discriminate, localize, and selectively focus light on multiple targets inside a scattering sample, as well as to recover and exploit the scattering medium properties. Combining the powerful approach of the transmission-matrix with the advantages of photoacoustic imaging opens the path towards deep-tissue imaging and light-delivery utilizing endogenous optical contrast.

Optics
Simulation of Light Scattering in Biological Tissues: the Coherent Component

JQ Lu,XH Hu,Z Song,K Dong

DOI: https://doi.org/10.1117/12.350035

1999-01-01

Abstract:Light propagating in turbid medium can be separated into two parts - the unattenuated part and the scattered part. The two parts coexist everywhere in the medium and can be described by radiative transport theory. In an optically thick sample of turbid medium, very small portion of the light remain unattenuated and the diffusion model is widely used to describe the propagation of light. Monte Carlo method, having the potential of reaching high accuracy, can be used to account for both parts of the light distribution and has acquired considerable attention lately. We have developed a new method of Monte Carlo simulation and conducted large-scale simulation of converging laser beam propagating through tissue phantoms in slab configurations. In our cases, the unique geometry of the converging laser beams gathers the unattenuated photons together near the focal point and makes it significant even for optically thick samples in comparison with the scattered part, Numerical results were obtained for tissue slabs of different parameters to study the variation of the distribution of the transmitted light. We have also investigated the possibility of characterizing biological tissues through the measurement of unattenuated photons.
Depth-resolved imaging through scattering media based on modified phasor field diffraction

Meiling Zhang,Yaoyao Shi,Wei Sheng,Yang Wei,Youwen Liu

DOI: https://doi.org/10.1016/j.optlaseng.2024.108530

IF: 5.666

2024-08-26

Optics and Lasers in Engineering

Abstract:The imaging through scattering media has significant applications in fields, including rescue and security. However, the phasor field algorithm ignores the effect of the additional optical path introduced by the scattering medium for the imaging of the hidden objects behind scattering media. To improve the accuracy, a modified phasor field diffraction method combined with the spatial average path for depth-resolved imaging through scattering media is proposed here. The additional optical path introduced by the scattering medium is resolved through the spatial average path, while the phasor field describes the free-space propagation of the light in air. We verify the feasibility and robustness of the proposed method on public transient data, real scenes and synthetic data. The results demonstrate that the higher-quality results with the proposed method are obtained, and the accurate depth information of objects is provided compared with the phasor field, as evidenced by evaluating the mean depth. This method has potential applications in medical imaging, remote sensing and other fields.

optics
Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering

Fei Xia,Caio Vaz Rimoli,Walther Akemann,Cathie Ventalon,Laurent Bourdieu,Sylvain Gigan,Hilton B de Aguiar

2024-03-22

Abstract:The intricate nature of the brain necessitates the application of advanced probing techniques to comprehensively study and understand its working mechanisms. Neurophotonics offers minimally invasive methods to probe the brain using optics at cellular and even molecular levels. However, multiple challenges persist, especially concerning imaging depth, field of view, speed, and biocompatibility. A major hindrance to solving these challenges in optics is the scattering nature of the brain. This perspective highlights the potential of complex media optics, a specialized area of study focused on light propagation in materials with intricate heterogeneous optical properties, in advancing and improving neuronal readouts for structural imaging and optical recordings of neuronal activity. Key strategies include wavefront shaping techniques and computational imaging and sensing techniques that exploit scattering properties for enhanced performance. We discuss the potential merger of the two fields as well as potential challenges and perspectives toward longer term in vivo applications.

Optics,Biological Physics,Computational Physics,Instrumentation and Detectors,Medical Physics
Deep Imaging in Scattering Media with Single Photon Selective Plane Illumination Microscopy (SPIM)

Adithya Kumar Pediredla,Shizheng Zhang,Ben Avants,Fan Ye,Shin Nagayama,Ziying Chen,Caleb Kemere,Jacob Robinson,Ashok Veeraraghavan

DOI: https://doi.org/10.1117/1.JBO.21.12.126009

2016-04-24

Abstract:In most biological tissues, light scattering due to small differences in refractive index limits the depth of optical imaging systems. Two-photon microscopy (2PM), which significantly reduces the scattering of the excitation light, has emerged as the most common method to image deep within scattering biological tissue. This technique, however, requires high-power pulsed lasers that are both expensive and difficult to integrate into compact portable systems. In this paper, using a combination of theoretical and experimental techniques, we show that Selective Plane Illumination Microscopy (SPIM) can image nearly as deep as 2PM without the need for a high-powered pulsed laser. Compared to other single photon imaging techniques like epifluorescence and confocal microscopy, SPIM can image more than twice as deep in scattering media (approximately 10 times the mean scattering length). These results suggest that SPIM has the potential to provide deep imaging in scattering media in situations where 2PM systems would be too large or costly.

Optics,Instrumentation and Detectors
Sub-Nyquist Sampling Boosts Targeted Light Transport Through Opaque Scattering Media.

Yuecheng Shen,Yan Liu,Cheng Ma,Lihong V. Wang

DOI: https://doi.org/10.1364/optica.4.000097

IF: 10.4

2017-01-01

Optica

Abstract:Optical time-reversal techniques are being actively developed to focus light through or inside opaque scattering media. When applied to biological tissue, these techniques promise to revolutionize biophotonics by enabling deep-tissue non-invasive optical imaging, optogenetics, optical tweezing, and phototherapy. In all previous optical time-reversal experiments, the scattered light field was well-sampled during wavefront measurement and wavefront reconstruction, following the Nyquist sampling criterion. Here, we overturn this conventional practice by demonstrating that even when the scattered field is under-sampled, light can still be focused through or inside scattering media. Even more surprisingly, we show both theoretically and experimentally that the focus achieved by under-sampling can be one order of magnitude brighter than that achieved under the well-sampling conditions used in previous works, where 3×3 to 5×5 pixels were used to sample one speckle grain on average. Moreover, sub-Nyquist sampling improves the signal-to-noise ratio and the collection efficiency of the scattered light. We anticipate that this newly explored under-sampling scheme will transform the understanding of optical time reversal and boost the performance of optical imaging, manipulation, and communication through opaque scattering media.
Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Long Pan,Yunan Wang,Yijie Lou,Xiaohua Feng

2024-10-08

Abstract:Imaging through thick scattering media presents significant challenges, particularly for three-dimensional (3D) applications. This manuscript demonstrates a novel scheme for single-image-enabled 3D imaging through such media, treating the scattering medium as a lens. This approach captures a comprehensive image containing information about objects hidden at various depths. By leveraging depth from focus and the reduced thickness of the scattering medium for single-pixel imaging, the proposed method ensures robust 3D imaging capabilities. We develop both traditional metric-based and deep learning-based methods to extract depth information for each pixel, allowing us to explore the locations of both positive and negative objects, whether shallow or deep. Remarkably, this scheme enables the simultaneous 3D reconstruction of targets concealed within the scattering medium. Specifically, we successfully reconstructed targets buried at depths of 5 mm and 30 mm within a total medium thickness of 60 mm. Additionally, we can effectively distinguish targets at three different depths. Notably, this scheme requires no prior knowledge of the scattering medium, no invasive procedures, reference measurements, or calibration.

Optics,Image and Video Processing
Photon Migration in Turbid Media: a Finite-Element Solution for the Most Favorable Path

J Zhou,J Bai

DOI: https://doi.org/10.1117/1.1499973

IF: 1.3

2002-01-01

Optical Engineering

Abstract:A better understanding of the fundamental principles of photon migration in highly scattering media is of great importance for developing new methods for disease diagnosis, imaging, and tomography. In this paper we present a most-favorable-path approach to the problem of light propagation in turbid media, based on the diffusion equation. The most favorable path, on which photons will be found, can be obtained from the path of the net flux propagation. The diffusion intensity and the direction of the net flux can be calculated with the finite-element method, which can deal with heterogeneous problems and frequency-domain problems within complex geometry, and can introduce boundary effects as well. Simulations were conducted for phantoms with different optical parameters and source-detector separations. Experiments have been performed to verify this new method. The most favorable path is found to be more sensitive to the source-detector separation and the absorption coefficient of the medium than to the scattering coefficient. The feasibility of using the theory in optical tomography for the recognition of objects hidden in turbid media is discussed. (C) 2002 Society or Photo-Optical Instrumentation Engineers.
A framework for scintillation in nanophotonics

Charles Roques-Carmes,Nicholas Rivera,Ali Ghorashi,Steven E Kooi,Yi Yang,Zin Lin,Justin Beroz,Aviram Massuda,Jamison Sloan,Nicolas Romeo,Yang Yu,John D Joannopoulos,Ido Kaminer,Steven G Johnson,Marin Soljačić,Steven E. Kooi,John D. Joannopoulos,Steven G. Johnson

DOI: https://doi.org/10.1126/science.abm9293

IF: 56.9

2022-02-25

Science

Abstract:Bombardment of materials by high-energy particles often leads to light emission in a process known as scintillation. Scintillation has widespread applications in medical imaging, x-ray nondestructive inspection, electron microscopy, and high-energy particle detectors. Most research focuses on finding materials with brighter, faster, and more controlled scintillation. We developed a unified theory of nanophotonic scintillators that accounts for the key aspects of scintillation: energy loss by high-energy particles, and light emission by non-equilibrium electrons in nanostructured optical systems. We then devised an approach based on integrating nanophotonic structures into scintillators to enhance their emission, obtaining nearly an order-of-magnitude enhancement in both electron-induced and x-ray–induced scintillation. Our framework should enable the development of a new class of brighter, faster, and higher-resolution scintillators with tailored and optimized performance.

multidisciplinary sciences
Progress and Prospect of Scattering Imaging

Jin Xin,Wang Xiaoyu,Du Dongyu,Fan Yuhui,Ji Xiangyang

DOI: https://doi.org/10.3788/l0p202158.1811002

2021-01-01

Abstract:Scattering media exist widely in our daily life. Imaging through the scattering media presents important scientific significance and large application value in medicine, autonomous driving, national security, and other fields. Here, we briefly review the current progress in scattering imaging and analyze the scattering characteristics of media via distinguishing the ballistic light and the scattered light. Existing scattering imaging techniques are divided into two categories: methods that utilize the scattered light and approaches that separate the scattered light from the ballistic light. Two groups of methods that exploit scattered light are summarized. They analyze the spatial characteristics of scattering media and model the light propagation in the scattering media, respectively. Also, the spatial or temporal separability between the scattered light and the ballistic light is introduced. The scattering imaging techniques are compared in terms of illumination, complexity of imaging devices, prior information dependency, type and strength of scattering media, and filed of view. Finally, the development trend is forecasted.
Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Jeffrey Alido,Joseph Greene,Yujia Xue,Guorong Hu,Yunzhe Li,Mitchell Gilmore,Kevin J. Monk,Brett T. DiBenedictis,Ian G. Davison,Lei Tian

2023-12-09

Abstract:Imaging through scattering is a pervasive and difficult problem in many biological applications. The high background and the exponentially attenuated target signals due to scattering fundamentally limits the imaging depth of fluorescence microscopy. Light-field systems are favorable for high-speed volumetric imaging, but the 2D-to-3D reconstruction is fundamentally ill-posed, and scattering exacerbates the condition of the inverse problem. Here, we develop a scattering simulator that models low-contrast target signals buried in heterogeneous strong background. We then train a deep neural network solely on synthetic data to descatter and reconstruct a 3D volume from a single-shot light-field measurement with low signal-to-background ratio (SBR). We apply this network to our previously developed Computational Miniature Mesoscope and demonstrate the robustness of our deep learning algorithm on scattering phantoms with different scattering conditions. The network can robustly reconstruct emitters in 3D with a 2D measurement of SBR as low as 1.05 and as deep as a scattering length. We analyze fundamental tradeoffs based on network design factors and out-of-distribution data that affect the deep learning model's generalizability to real experimental data. Broadly, we believe that our simulator-based deep learning approach can be applied to a wide range of imaging through scattering techniques where experimental paired training data is lacking.

Signal Processing,Biological Physics,Optics
Low Photon Number Non-Invasive Imaging Through Time-Varying Diffusers

Adrian Makowski,Wojciech Zwolinski,Pawel Szczypkowski,Bernard Gorzkowski,Sylvain Gigan,Radek Lapkiewicz

2024-09-27

Abstract:Scattering poses a significant challenge in optical imaging. In microscopy, it leads to progressive degradation of image quality preventing sample examination at increasing depths. As the thickness of the sample increases, the number of photons that can successfully pass through it decreases, leading to a reduced signal and preventing us from obtaining clear images. Imaging becomes even more difficult with dynamic scatterers like biological tissues that change over time. We demonstrate non-invasive imaging of fluorescent objects hidden behind dynamic diffusers. Our reconstruction uses a stack of images recorded for different diffuser realizations and works even when individual camera frames contain small photon numbers.

Optics,Biological Physics,Quantum Physics
Photon-Efficient Computational 3D and Reflectivity Imaging with Single-Photon Detectors

Dongeek Shin,Ahmed Kirmani,Vivek K Goyal,Jeffrey H. Shapiro

DOI: https://doi.org/10.48550/arXiv.1406.1761

2014-06-07

Abstract:Capturing depth and reflectivity images at low light levels from active illumination of a scene has wide-ranging applications. Conventionally, even with single-photon detectors, hundreds of photon detections are needed at each pixel to mitigate Poisson noise. We develop a robust method for estimating depth and reflectivity using on the order of 1 detected photon per pixel averaged over the scene. Our computational imager combines physically accurate single-photon counting statistics with exploitation of the spatial correlations present in real-world reflectivity and 3D structure. Experiments conducted in the presence of strong background light demonstrate that our computational imager is able to accurately recover scene depth and reflectivity, while traditional maximum-likelihood based imaging methods lead to estimates that are highly noisy. Our framework increases photon efficiency 100-fold over traditional processing and also improves, somewhat, upon first-photon imaging under a total acquisition time constraint in raster-scanned operation. Thus our new imager will be useful for rapid, low-power, and noise-tolerant active optical imaging, and its fixed dwell time will facilitate parallelization through use of a detector array.

Applications

Solving the Photon Maze for Sensing and Imaging Inside Scattering Media

Solving the Inverse Scattering Problem in Reflection-Mode Dynamic Speckle-Field Phase Microscopy (conference Presentation)

Guiding Photons Through the Scattering Maze: Progress and Challenges in Optical Wavefront Shaping

Single-photon 3D imaging of room-scale scenes through scattering media

Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Single photon single pixel imaging into thick scattering medium

3D Object Imaging through Scattering Media

Full-wave simulations of tomographic optical imaging inside scattering media

Controlling light in scattering media noninvasively using the photo-acoustic transmission-matrix

Simulation of Light Scattering in Biological Tissues: the Coherent Component

Depth-resolved imaging through scattering media based on modified phasor field diffraction

Neurophotonics beyond the Surface: Unmasking the Brain's Complexity Exploiting Optical Scattering

Deep Imaging in Scattering Media with Single Photon Selective Plane Illumination Microscopy (SPIM)

Sub-Nyquist Sampling Boosts Targeted Light Transport Through Opaque Scattering Media.

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Photon Migration in Turbid Media: a Finite-Element Solution for the Most Favorable Path

A framework for scintillation in nanophotonics

Progress and Prospect of Scattering Imaging

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Low Photon Number Non-Invasive Imaging Through Time-Varying Diffusers

Photon-Efficient Computational 3D and Reflectivity Imaging with Single-Photon Detectors