Single photon single pixel imaging into thick scattering medium

Long Pan,Yuecheng Shen,Ji Qi,Junhui Shi,Xiaohua Feng

DOI: https://doi.org/10.1364/oe.484874

IF: 3.8

2023-04-13

Optics Express

Abstract:Long Pan, Yuecheng Shen, Ji Qi, Junhui Shi, Xiaohua Feng Imaging into thick scattering medium is a long-standing challenge. Beyond the quasi-ballistic regime, multiple scattering scrambles the ... [Opt. Express 31, 13943-13958 (2023)]

optics

What problem does this paper attempt to address?

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Long Pan,Yunan Wang,Yijie Lou,Xiaohua Feng

2024-10-08

Abstract:Imaging through thick scattering media presents significant challenges, particularly for three-dimensional (3D) applications. This manuscript demonstrates a novel scheme for single-image-enabled 3D imaging through such media, treating the scattering medium as a lens. This approach captures a comprehensive image containing information about objects hidden at various depths. By leveraging depth from focus and the reduced thickness of the scattering medium for single-pixel imaging, the proposed method ensures robust 3D imaging capabilities. We develop both traditional metric-based and deep learning-based methods to extract depth information for each pixel, allowing us to explore the locations of both positive and negative objects, whether shallow or deep. Remarkably, this scheme enables the simultaneous 3D reconstruction of targets concealed within the scattering medium. Specifically, we successfully reconstructed targets buried at depths of 5 mm and 30 mm within a total medium thickness of 60 mm. Additionally, we can effectively distinguish targets at three different depths. Notably, this scheme requires no prior knowledge of the scattering medium, no invasive procedures, reference measurements, or calibration.

Optics,Image and Video Processing
Imaging and tracking through scattering medium with low bit depth speckle

Qinghuan Xu,Baoqing Sun,Jia Zhao,Zuojia Wang,Liuge Du,Chonglei Sun,Xianye Li,Xun Li

DOI: https://doi.org/10.1109/JPHOT.2020.2974898

IF: 2.4

2020-01-01

IEEE Photonics Journal

Abstract:Optical imaging/tracking through scattering medium is a difficult challenge. We demonstrate a method using speckles with multiple bit depths to image objects through scattering medium. The image of the object can be reconstructed even if the speckles are binary. Speckles with different bit depths are obtained by quantifying the original speckle. And we discuss the application of binarized speckles...
Passive imaging through dense scattering media

Yaoming Bian,Fei Wang,Yuanzhe Wang,Zhenfeng Fu,Haishan Liu,Haiming Yuan,Guohai Situ

DOI: https://doi.org/10.1364/prj.503451

IF: 7.6

2023-12-22

Photonics Research

Abstract:Yaoming Bian, Fei Wang, Yuanzhe Wang, Zhenfeng Fu, Haishan Liu, Haiming Yuan, Guohai Situ Imaging through non-static and optically thick scattering media such as dense fog, heavy smoke, and turbid water is crucial in various ... [Photon. Res. 12, 134-140 (2024)]

optics
Fast Optical High-Resolution Imaging Through Scattering Medium Based on Virtual Synthetic Aperture Model

Kai Qiao,Xiaorui Tian,Xiaojie Shi,Jie Yang,Meng Tang,Siqi Zhang,Chenfei Jin

DOI: https://doi.org/10.1016/j.optlastec.2024.111742

IF: 4.939

2024-01-01

Optics & Laser Technology

Abstract:High resolution real-time optical imaging through macro-scale scattering medium is challenging in applications. Based on prior spatiotemporal characteristics, existing methods have improved the imaging performance of simple scattering scenarios. Here, we introduce a virtual synthetic aperture model (VSAM) into optical scattering imaging, which focuses on real-time imaging with high resolution and robustness. Our experiments are conducted under the complex scenarios: imaging static or moving targets through acrylic plates or fog. Even though the exposure time is 0.488ms/pixel and average photon counts are less than 4, the proposed method can successfully reconstruct the target located at 1.5m away from acrylic plates or moving with 1m/s. Furthermore, for the fog with one-way optical thickness greater than 6.5 and spatial thickness similar to 50cm, our method is also applicable. The experiments indicate that the proposed method without prior knowledge outperforms the related methods in terms of resolution and scene robustness, which significantly benefits its application.
Extended Depth-Resolved Imaging Through a Thin Scattering Medium with PSF Manipulation

Xiangsheng Xie,Huichang Zhuang,Hexiang He,Xiaoqing Xu,Haowen Liang,Yikun Liu,Jianying Zhou

DOI: https://doi.org/10.1038/s41598-018-22966-7

IF: 4.6

2018-01-01

Scientific Reports

Abstract:Human ability to visualize an image is usually hindered by optical scattering. Recent extensive studies have promoted imaging technique through turbid materials to a reality where color image can be restored behind scattering media in real time. The big challenge now is to recover objects in a large field of view with depth resolving ability. Based on the existing research results, we systematically study the physical relationship between speckles generated from objects at different planes. By manipulating a given single point spread function, depth-resolved imaging through a thin scattering medium can be extended beyond the original depth of field (DOF). Experimental testing of standard scattering media shows that the DOF can be extended up to 5 times and the physical mechanism is depicted. This extended DOF is benefit to 3D imaging through scattering environment, and it is expected to have important applications in science, technology, bio-medical, security and defense.
Single-shot Imaging Through Scattering Media under Strong Background Interferences

Shunfu He,Wei Li,Teli Xi,Yangfan Sun,Jietao Liu,Xiaopeng Shao

DOI: https://doi.org/10.1364/cleo_qels.2021.fm3l.5

2021-01-01

Abstract:We report and demonstrate experimentally an approach to retrieving the object from a single-shot speckle pattern under a strong background light interference. This approach provides a practical solution to natural scene scattering imaging.
Single-Shot Compressed Photoacoustic Tomographic Imaging with a Single Detector in a Scattering Medium

Yuning Guo,Baowen Li,Xiaobo Yin

DOI: https://doi.org/10.1103/physrevapplied.13.044009

IF: 4.6

2020-01-01

Physical Review Applied

Abstract:Photon scattering imposes a fundamental restriction on optical imaging in turbid media. In this work, we propose a compressive-sensing-based photoacoustic imaging modality that allows single-shot tomography with a single detector in a scattering medium. The nonuniform optical speckle grains created in the diffusive regime, which act as a conventional drawback of optical modality, are used to generate ultrasound locally. The photoacoustic signals from spatial positions can be well extracted from a superimposed signal via introduction of locally modulated time delays. Taking advantage of the compressed measurement assisted by the acoustic mask, we demonstrate a theoretical compressed framework of three-dimensional photoacoustic surface tomography with a broad field of view after one-time optical illumination. This approach can increase the photoacoustic imaging efficiency greatly and reveals the potential for dynamic imaging in optically diffusive media.
Single-photon 3D imaging of room-scale scenes through scattering media

Jianwei Zeng,Wei Li,Yijun Zhou,Feihu Xu

DOI: https://doi.org/10.1364/oe.538003

IF: 3.8

2024-10-26

Optics Express

Abstract:Jianwei Zeng, Wei Li, Yijun Zhou, Feihu Xu Light detection and ranging (LiDAR) utilizes eye-safe laser beams to perceive the world in three-dimensional (3D) detail, offering machines ... [Opt. Express 32, 40706-40718 (2024)]

optics
Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Yiwen Zhang,Minh Dinh,Zeyu Wang,Tianhao Zhang,Tianhang Chen,Chia Wei Hsu

2024-06-04

Abstract:The multiple scattering of light makes materials opaque and obstructs imaging. Wavefront shaping can reverse the scattering process, but imaging with physical wavefront shaping has limitations such as requiring physical guidestars, being restricted within a small isoplanatic volume, and relying on slow wavefront updates, with some approaches only working for planar targets outside the scattering media. Here, we introduce scattering matrix tomography (SMT): measure the hyperspectral scattering matrix of the sample, use it to digitally scan a synthesized confocal spatiotemporal focus and construct a volumetric image of the sample, and then use the tomograms as virtual guidestars in a nonconvex optimization to find the pulse shape, input wavefront, and output wavefront that can compensate for aberrations and scattering. SMT combines the strengths of wavefront shaping, spatiotemporal gating, and computational adaptive optics, eliminating physical guidestars and enabling digital double-path wavefront corrections tailored for every isoplanatic volume. We demonstrate sub-micron lateral resolution and one-micron axial resolution at one millimeter beneath ex vivo mouse brain tissue and over three transport mean free paths inside an opaque colloid, where existing imaging methods all fail due to the overwhelming multiple scattering. As a noninvasive and label-free method that works both inside and outside the scattering media, SMT may be applied broadly across medical imaging, biological science, device inspection, and colloidal physics.

Optics,Biological Physics
Imaging Through Dynamical Scattering Media by Two-Photon Absorption Detectors.

Wei Liu,Zhihao Zhou,Lei Chen,Xin Luo,Yuehan Liu,Xianfeng Chen,Wenjie Wan

DOI: https://doi.org/10.1364/oe.433513

IF: 3.8

2021-01-01

Optics Express

Abstract:Imaging through a dynamical opaque scattering medium is an almost impossible task, where strong multiple light scattering from moving scatters dynamically prevents imaging formations even with state-of-art techniques like correlation imaging or adaptive optics. Meanwhile, a small number of ballistic photons can still penetrate through but require demanding detection in terms of a ultrashort time gate and high sensitivity. However, visible light is strongly scattered for most of scattering media. Here we experimentally demonstrate a non-invasive coherent imaging scheme based on two-photon absorption capable of imaging through dynamical scattering media with a length equivalent to 28 times mean free paths for single photon transport, where two-photon absorption in a conventional semiconductor photodetector when phase matching is not required works over a wide bandwidth so it can support a fast time gate down to femtosecond level, short enough to distinguish ballistic photons from scattering background, and allows accessing longer wavelengths for deeper penetration. This technique combined with successful optical coherence tomography may pave a new way for imaging through fog, storm, and rain as well as biomedical imaging applications.
Scattering-Assisted Computational Imaging

Yiwei Sun,Xiaoyan Wu,Jianhong Shi,Guihua Zeng

DOI: https://doi.org/10.3390/photonics9080512

IF: 2.536

2022-01-01

Photonics

Abstract:Imaging objects hidden behind an opaque shelter provides a crucial advantage when physically going around the obstacle is impossible or dangerous. Previous methods have demonstrated that is possible to reconstruct the image of a target hidden from view. However, these methods enable the reconstruction by using the reflected light from a wall which may not be feasible in the wild. Compared with the wall, the "plug and play" scattering medium is more naturally and artificially accessible, such as smog and fogs. Here, we introduce a scattering-assisted technique that requires only a remarkably small block of single-shot speckle to perform transmission imaging around in-line-of-sight barriers. With the help of extra inserted scattering layers and a deep learning algorithm, the target hidden from view can be stably recovered while the directly uncovered view is reduced to 0.097% of the whole field of view, successfully removing the influence of large foreground occlusions. This scattering-assisted computational imaging has wide potential applications in real-life scenarios, such as covert imaging, resuming missions, and detecting hidden adversaries in real-time.
Scalable Non-Invasive Imaging Through Dynamic Scattering Media at Low Photon Flux

Yiwei Sun,Xiaoyan Wu,Yuanyi Zheng,Jianping Fan,Guihua Zeng

DOI: https://doi.org/10.1016/j.optlaseng.2021.106641

IF: 5.666

2021-01-01

Optics and Lasers in Engineering

Abstract:When the intensity of light reduces to single-photon level, the shot noise becomes dominant. Random scatter, especially the time-varying media will highly increase the photon-limited imaging challenge that the traditional imaging means are inadequate to cope with. In this paper, we develop a new scalable "one to all" imaging approach which focuses on dynamic scattering imaging under photon-limited condition. When the dynamic media optical density is five, we apply this principle to inverse scattering problem and retrieve high-quality images in a real-time way using as little as similar to 0.4 valid detected photons per pixel on average successfully. The effects of lighting intensities and perturbations are analyzed to highlight special significance of the work. The ultimate results demonstrate that one trained strategy is robust to a wide range of statistical variations in dynamic media, which outperforms common "one to one" method and improves the practical utility efficaciously. This non-invasive imaging work promises a wide prospect in photon-limited scattering applications such as in vivo bioimaging and so on.
Imaging through scattering media via spatial-temporal encoded pattern illumination

Xingchen Zhao,Xiaoyu Nie,Zhenhuan Yi,Tao Peng,Marlan O. Scully

DOI: https://doi.org/10.1364/PRJ.456156

2021-12-26

Abstract:Optical imaging through scattering media is a long-standing challenge. Although many approaches have been developed to focus light or image objects through scattering media, they are either invasive, restricted to stationary or slowly-moving media, or require high-resolution cameras and complex algorithms to retrieve the images. Here we introduce a computational imaging technique that can overcome these restrictions by exploiting spatial-temporal encoded patterns (STEP). We present non-invasive imaging through scattering media with a single-pixel photodetector. We show that the method is insensitive to the motions of media. We further demonstrate that our image reconstruction algorithm is much more efficient than correlation-based algorithms for single-pixel imaging, which may allow fast imaging in currently unreachable scenarios.

Optics,Image and Video Processing
Real-time Scalable Imaging Through Dynamic Scattering Media at Ultra-low Light Level

Yiwei Sun,Xiaoyan Wu,Jianhong Shi,Guihua Zeng

DOI: https://doi.org/10.1364/cleo_at.2021.jw1a.24

2021-01-01

Abstract:We experimentally reconstruct high-quality images through dynamic media using as little as ~0.4 photons per pixel by proposed scalable method, which provides guidance on the real-time photon-limited time-varying scattering imaging applications such as in vivo bioimaging.
Single-shot fast 3D imaging through scattering media using structured illumination

Aiping Zhai,Yuancheng Li,Wenjing Zhao,Dong Wang

2021-01-01

Abstract: Conventional approaches for 3D imaging in or through scattering media are usually limited to 2D reconstruction of objects at some discontinuous locations, although the time-consuming iteration, guide-star, or complex system are implemented. How to quickly visualize dynamic 3D objects behind scattering media is still an open issue. Here, by using structured light illumination, we propose a single-shot technique that can quickly acquire continuous 3D surfaces of objects hidden behind the diffuser. The proposed method can realize the 3D imaging of single, multiple, and dynamic targets from the speckled structured light patterns under broad or narrow band light illumination, in which only once calibration of the imaging setup is needed before conducting the imaging. Our approach paves the way to quickly visualize dynamic objects behind scattering media in 3D and multispectral.
3D Object Imaging through Scattering Media

Xiangsheng Xie,Huichang Zhuang,Hexiang He,Xiaoqing Xu,Haowen Liang,Yikun Liu,Jianying Zhou

DOI: https://doi.org/10.48550/arXiv.1711.11356

2017-11-30

Abstract:Human ability to visualize an image is usually hindered by optical scattering. Recent extensive studies have promoted imaging technique through turbid materials to a reality where color image can be restored behind scattering media in real time. The big challenge now is to recover a 3D object in a large field of view with depth resolving ability. Here, we reveal a new physical relationship between speckles generated from objects at different planes. With a single given point spread function, 3D imaging through scattering media is achieved even beyond the depth of field (DOF). Experimental testing of standard scattering media shows that the original DOF can be extended up to 5 times and the physical mechanism is depicted. This extended 3D imaging is expected to have important applications in science, technology, bio-medical, security and defense.

Optics,Biological Physics
De-scattering with Excitation Patterning enables rapid wide-field imaging through scattering media

Cheng Zheng,Jong Kang Park,Murat Yildirim,Josiah R. Boivin,Yi Xue,Mriganka Sur,Peter T. C. So,Dushan N. Wadduwage

DOI: https://doi.org/10.1126/sciadv.aay5496

IF: 13.6

2021-07-09

Science Advances

Abstract:Computational imaging in combination with full-field multiphoton microscopy demonstrates rapid in vivo deep tissue imaging.

multidisciplinary sciences
Multitarget Imaging Through Scattering Media Beyond the 3D Optical Memory Effect.

Wei Li,Jietao Liu,Shunfu He,Lixian Liu,Xiaopeng Shao

DOI: https://doi.org/10.1364/ol.388552

IF: 3.6

2020-01-01

Optics Letters

Abstract:A robust method for efficient spatial separation optical imaging through scattering media regardless of the three-dimensional (3D) optical memory effect is proposed. In this method, the problems of imaging dealiasing, decomposition, and separation of speckle patterns are solved by employing independent component analysis. Multitarget imaging behind a scattering layer with diverse spatial positions is observed experimentally, for the first time, to the best of our knowledge. In this work, we demonstrate that, by knowing the number of targets and keeping each subtargets' size in the optical memory effect range while isolating them beyond this range without overlap in the axial direction, speckle dealiasing and multitarget imaging are solved effectively. The strategy provides a potentially useful means for incoherent imaging through scattering media in a wide class of fields such as optical microscopy, biomedical imaging, and astronomical imaging.
Ballistic Imaging Through Strongly Scattering Media by Using a Combination of Supercontinuum Illumination and Fourier Spatial Filtering

Junyi Tong,Yipeng Zheng,Wenjiang Tan,Cunxia Li,Jinhai Si

DOI: https://doi.org/10.3390/photonics9090624

IF: 2.536

2022-01-01

Photonics

Abstract:Imaging through turbid media is important but has created challenging issues for a long time. Previous research studies have shown that the object hidden in a turbid medium might be seen just by effectively suppressing the speckles by using low-coherent light sources, such as random laser and supercontinuum. However, the image contrast was seriously degraded due to the background noise of scattered photons. In this work, we demonstrate ballistic imaging for an object hidden behind strongly scattering media, in which the speckles are suppressed by the supercontinuum (SC) illumination and lots of scattered photons are simultaneously filtered by the Fourier spatial gate. Compared with speckle-free imaging from using SC illumination and ballistic imaging by Fourier spatial filtering, this method combines their advantages and shows a degree of synergism. When the optical depth of the scattering medium reaches 14, the image using this combined method is able to increase the image identifiability and the relative image contrast by about two times and four times compared to the method using only SC illumination, respectively. Our work offers a way for direct imaging through strongly turbid media without a complex image process.
Fast single-shot imaging through scattering media based on a captured speckle pattern without a guidestar

Yongcheng Hua,Minglong Hu,Junjie Zhou,Ding Yingchun,Liang Yin

DOI: https://doi.org/10.1063/5.0191172

IF: 4

2024-04-01

Applied Physics Letters

Abstract:To address the fundamental challenges of imaging light in scattering media, we report an imaging method based on the principle of speckle correlations. It does not require raster scanning of the shaped focus or an implanted guidestar to locate and control incident illumination. More importantly, our approach eliminates the need for collecting thousands of speckle patterns for real-time iterative optimization, as only one captured speckle pattern is needed. By incorporating the traditional wavefront shaping concept and calculating the optimal phase mask, our method enables image recovery from the speckle pattern, resulting in significant time savings.

physics, applied

Single photon single pixel imaging into thick scattering medium

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Imaging and tracking through scattering medium with low bit depth speckle

Passive imaging through dense scattering media

Fast Optical High-Resolution Imaging Through Scattering Medium Based on Virtual Synthetic Aperture Model

Extended Depth-Resolved Imaging Through a Thin Scattering Medium with PSF Manipulation

Single-shot Imaging Through Scattering Media under Strong Background Interferences

Single-Shot Compressed Photoacoustic Tomographic Imaging with a Single Detector in a Scattering Medium

Single-photon 3D imaging of room-scale scenes through scattering media

Deep imaging inside scattering media through virtual spatiotemporal wavefront shaping

Imaging Through Dynamical Scattering Media by Two-Photon Absorption Detectors.

Scattering-Assisted Computational Imaging

Scalable Non-Invasive Imaging Through Dynamic Scattering Media at Low Photon Flux

Imaging through scattering media via spatial-temporal encoded pattern illumination

Real-time Scalable Imaging Through Dynamic Scattering Media at Ultra-low Light Level

Single-shot fast 3D imaging through scattering media using structured illumination

3D Object Imaging through Scattering Media

De-scattering with Excitation Patterning enables rapid wide-field imaging through scattering media

Multitarget Imaging Through Scattering Media Beyond the 3D Optical Memory Effect.

Ballistic Imaging Through Strongly Scattering Media by Using a Combination of Supercontinuum Illumination and Fourier Spatial Filtering

Fast single-shot imaging through scattering media based on a captured speckle pattern without a guidestar