Single-photon 3D imaging of room-scale scenes through scattering media

Jianwei Zeng,Wei Li,Yijun Zhou,Feihu Xu

DOI: https://doi.org/10.1364/oe.538003

IF: 3.8

2024-10-26

Optics Express

Abstract:Jianwei Zeng, Wei Li, Yijun Zhou, Feihu Xu Light detection and ranging (LiDAR) utilizes eye-safe laser beams to perceive the world in three-dimensional (3D) detail, offering machines ... [Opt. Express 32, 40706-40718 (2024)]

optics

What problem does this paper attempt to address?

Long-range photon-efficient 3D imaging without range ambiguity

Chen Dai,Wen-Long Ye,Chao Yu,Xin Huang,Zheng-Ping Li,Feihu Xu

DOI: https://doi.org/10.1364/ol.485127

IF: 3.6

2023-03-18

Optics Letters

Abstract:Chen Dai, Wen-Long Ye, Chao Yu, Xin Huang, Zheng-Ping Li, Feihu Xu Single-photon light detection and ranging (LiDAR) has broad applications ranging from remote sensing to target recognition. In most cases, ... [Opt. Lett. 48, 1542-1545 (2023)]

optics
All-Time Single-Photon 3d Imaging Over 21 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/cleo_si.2019.sm1n.1

2019-01-01

Abstract:We experimentally demonstrate active three-dimensional (3D) imaging at a range of up to 21.6 km in daylight by constructing a high-efficiency single-photon LiDAR system and developing a long-range-tailored computational algorithm. (C) 2019 The Author(s)
Single-shot fast 3D imaging through scattering media using structured illumination

Aiping Zhai,Yuancheng Li,Wenjing Zhao,Dong Wang

2021-01-01

Abstract: Conventional approaches for 3D imaging in or through scattering media are usually limited to 2D reconstruction of objects at some discontinuous locations, although the time-consuming iteration, guide-star, or complex system are implemented. How to quickly visualize dynamic 3D objects behind scattering media is still an open issue. Here, by using structured light illumination, we propose a single-shot technique that can quickly acquire continuous 3D surfaces of objects hidden behind the diffuser. The proposed method can realize the 3D imaging of single, multiple, and dynamic targets from the speckled structured light patterns under broad or narrow band light illumination, in which only once calibration of the imaging setup is needed before conducting the imaging. Our approach paves the way to quickly visualize dynamic objects behind scattering media in 3D and multispectral.
Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Long Pan,Yunan Wang,Yijie Lou,Xiaohua Feng

2024-10-08

Abstract:Imaging through thick scattering media presents significant challenges, particularly for three-dimensional (3D) applications. This manuscript demonstrates a novel scheme for single-image-enabled 3D imaging through such media, treating the scattering medium as a lens. This approach captures a comprehensive image containing information about objects hidden at various depths. By leveraging depth from focus and the reduced thickness of the scattering medium for single-pixel imaging, the proposed method ensures robust 3D imaging capabilities. We develop both traditional metric-based and deep learning-based methods to extract depth information for each pixel, allowing us to explore the locations of both positive and negative objects, whether shallow or deep. Remarkably, this scheme enables the simultaneous 3D reconstruction of targets concealed within the scattering medium. Specifically, we successfully reconstructed targets buried at depths of 5 mm and 30 mm within a total medium thickness of 60 mm. Additionally, we can effectively distinguish targets at three different depths. Notably, this scheme requires no prior knowledge of the scattering medium, no invasive procedures, reference measurements, or calibration.

Optics,Image and Video Processing
Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Peng-Yu Jiang,Zheng-Ping Li,Wen-Long Ye,Yu Hong,Chen Dai,Xin Huang,Shui-Qing Xi,Jie Lu,Da-Jian Cui,Yuan Cao,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/oe.487560

IF: 3.8

2023-01-01

Optics Express

Abstract:Single-photon light detection and ranging (LiDAR) has emerged as a strong candidate technology for active imaging applications. In particular, the single-photon sensitivity and picosecond timing resolution permits high-precision three-dimensional (3D) imaging capability through atmospheric obscurants including fog, haze and smoke. Here we demonstrate an array-based single-photon LiDAR system, which is capable of performing 3D imaging in atmospheric obscurant over long ranges. By adopting the optical optimization of system and the photon-efficient imaging algorithm, we acquire depth and intensity images through dense fog equivalent to 2.74 attenuation lengths at distances of 13.4 km and 20.0 km. Furthermore, we demonstrate real-time 3D imaging for moving targets at 20 frames per second in mist weather conditions over 10.5 km. The results indicate great potential for practical applications of vehicle navigation and target recognition in challenging weather.
High-resolution 3D Imaging Through Dense Camouflage Nets Using Single-Photon LiDAR

Peng-Yu Jiang,Zheng-Ping Li,Wen-Long Ye,Ziheng Qiu,Da-Jian Cui,Feihu Xu

DOI: https://doi.org/10.3788/ai.2024.10001

2024-01-01

Abstract:The single-photon sensitivity and picosecond time resolution of single-photon light detection and ranging (LiDAR) can provide a full-waveform profile for retrieving the three-dimentional (3D) profile of the target separated from foreground clutter. This capability has made single-photon LiDAR a solution for imaging through obscurant, camouflage nets, and semitransparent materials. However, the obstructive presence of the clutter and limited pixel numbers of single-photon detector arrays still pose challenges in achieving high-quality imaging. Here, we demonstrate a single-photon array LiDAR system combined with tailored computational algorithms for high-resolution 3D imaging through camouflage nets. For static targets, we develop a 3D sub-voxel scanning approach along with a photon-efficient deconvolution algorithm. Using this approach, we demonstrate 3D imaging through camouflage nets with a 3× improvement in spatial resolution and a 7.5× improvement in depth resolution compared with the inherent system resolution. For moving targets, we propose a motion compensation algorithm to mitigate the net's obstructive effects, achieving video-rate imaging of camouflaged scenes at 20 frame/s. More importantly, we demonstrate 3D imaging for complex scenes in various outdoor scenarios and evaluate the advanced features of single-photon LiDAR over a visible-light camera and a mid-wave infrared (MWIR) camera. The results point a way forward for high-resolution real-time 3D imaging of multi-depth scenarios.
Single-photon Computational 3D Imaging at 45 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Weijie Jin,Chao Yu,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/prj.390091

IF: 7.6

2019-01-01

Photonics Research

Abstract:Single-photon light detection and ranging (lidar) offers single-photon sensitivity and picosecond timing resolution, which is desirable for high-precision three-dimensional (3D) imaging over long distances. Despite important progress, further extending the imaging range presents enormous challenges because only a few echo photons return and are mixed with strong noise. Here, we tackled these challenges by constructing a high-efficiency, low-noise coaxial single-photon lidar system and developing a long-range-tailored computational algorithm that provides high photon efficiency and good noise tolerance. Using this technique, we experimentally demonstrated active single-photon 3D imaging at a distance of up to 45 km in an urban environment, with a low return-signal level of ～1 photon per pixel. Our system is feasible for imaging at a few hundreds of kilometers by refining the setup, and thus represents a step towards low-power and high-resolution lidar over extra-long ranges.
Single photon imaging based on a photon driven sparse sampling

Zhen Chen,Huachuang Wang,Yang Yu,Bo Liu,Guangmeng Guo,Cheng He

DOI: https://doi.org/10.1364/OE.455544

2022-04-11

Abstract:Single photon three-dimensional (3D) imager can capture 3D profile details and see through obscuring objects with high sensitivity, making it promising in sensing and imaging applications. The key capabilities of such 3D imager lie on its depth resolution and multi-return discrimination. For conventional pulsed single photon lidar, these capabilities are limited by transmitter bandwidth and receiver bandwidth simultaneously. A single photon imager is proposed and experimentally demonstrated to implement time-resolved and multi-return imaging. Time-to-frequency conversion is performed to achieve millimetric depth resolution. Experimental results show that the depth resolution is better than 4.5 mm, even though time jitter of the SPAD reaches 1 ns and time resolution of the TCSPC module reaches 10 ns. Furthermore, photon driven sparse sampling mechanism allows us to discriminate multiple near surfaces, no longer limited by the receiver bandwidth. The simplicity of the system hardware enables low-cost and compact 3D imaging.
3D Object Imaging through Scattering Media

Xiangsheng Xie,Huichang Zhuang,Hexiang He,Xiaoqing Xu,Haowen Liang,Yikun Liu,Jianying Zhou

DOI: https://doi.org/10.48550/arXiv.1711.11356

2017-11-30

Abstract:Human ability to visualize an image is usually hindered by optical scattering. Recent extensive studies have promoted imaging technique through turbid materials to a reality where color image can be restored behind scattering media in real time. The big challenge now is to recover a 3D object in a large field of view with depth resolving ability. Here, we reveal a new physical relationship between speckles generated from objects at different planes. With a single given point spread function, 3D imaging through scattering media is achieved even beyond the depth of field (DOF). Experimental testing of standard scattering media shows that the original DOF can be extended up to 5 times and the physical mechanism is depicted. This extended 3D imaging is expected to have important applications in science, technology, bio-medical, security and defense.

Optics,Biological Physics
Linear Terrestrial Laser Scanning Using Array Avalanche Photodiodes As Detectors for Rapid Three-Dimensional Imaging.

Yinqiao Cai,Xiaohua Tong,Peng Tong,Hongyi Bu,Rong Shu

DOI: https://doi.org/10.1364/ao.49.000h11

IF: 1.9

2010-01-01

Applied Optics

Abstract:As an active remote sensor technology, the terrestrial laser scanner is widely used for direct generation of a three-dimensional (3D) image of an object in the fields of geodesy, surveying, and photogrammetry. In this article, a new laser scanner using array avalanche photodiodes, as designed by the Shanghai Institute of Technical Physics of the Chinese Academy of Sciences, is introduced for rapid collection of 3D data. The system structure of the new laser scanner is first presented, and a mathematical model is further derived to transform the original data to the 3D coordinates of the object in a user-defined coordinate system. The performance of the new laser scanner is tested through a comprehensive experiment. The result shows that the new laser scanner can scan a scene with a field view of 30° × 30° in 0.2 s and that, with respect to the point clouds obtained on the wall and ground floor surfaces, the root mean square errors for fitting the two planes are 0.21 and 0.01 cm, respectively. The primary advantages of the developed laser scanner include: (i) with a line scanning mode, the new scanner achieves simultaneously the 3D coordinates of 24 points per single laser pulse, which enables it to scan faster than traditional scanners with a point scanning mode and (ii) the new scanner makes use of two galvanometric mirrors to deflect the laser beam in both the horizontal and the vertical directions. This capability makes the instrument smaller and lighter, which is more acceptable for users.
Compressive Sensing-Based Three-Dimensional Laser Imaging with Dual Illumination.

Yulong An,Yanmei Zhang,Haichao Guo,Jing Wang

DOI: https://doi.org/10.1109/access.2019.2900449

IF: 3.9

2019-01-01

IEEE Access

Abstract:Low-cost 3D imaging, particularly by using laser detection and ranging (LIDAR), is important for applications such as object recognition, surface mapping, and machine vision. Conventional time-of-flight LIDAR uses a scanned laser to obtain the intensity and range of targets, which requires a narrow bandwidth of illumination and high-speed synchronizers. This paper presents a nonscanning prototype of a pulse-width-free 3D LIDAR which combines single-pixel imaging and diffractive optical elements, for the first time to our knowledge. Compressive sensing techniques are used to measure echo pulses from the target and reconstruct the intensity map of the target scene. Diffractive optical elements are also applied to generate structured illumination and the depth map of the target scene can be obtained from laser spot extraction. The simulation results are presented to verify the effectiveness of the proposed prototype as well as illustrate its superiority where traditional 3D imaging methods are unavailable or limited. This novel prototype has advantages of low cost and flexible structure at wavelengths beyond the visible spectrum and will be highly interesting for practical applications.
Three-Dimensional Imaging Via Time-Correlated Single-Photon Counting

Chengkun Fu,Huaibin Zheng,Gao Wang,Yu Zhou,Hui Chen,Yuchen He,Jianbin Liu,Jian Sun,Zhuo Xu

DOI: https://doi.org/10.3390/app10061930

2020-01-01

Abstract:Three-dimensional (3D) imaging under the condition of weak light and low signal-to-noise ratio is a challenging task. In this paper, a 3D imaging scheme based on time-correlated single-photon counting technology is proposed and demonstrated. The 3D imaging scheme, which is composed of a pulsed laser, a scanning mirror, single-photon detectors, and a time-correlated single-photon counting module, employs time-correlated single-photon counting technology for 3D LiDAR (Light Detection and Ranging). Aided by the range-gated technology, experiments show that the proposed scheme can image the object when the signal-to-noise ratio is decreased to -13 dB and improve the structural similarity index of imaging results by 10 times. Then we prove the proposed scheme can image the object in three dimensions with a lateral imaging resolution of 512 x 512 and an axial resolution of 4.2 mm in 6.7 s. At last, a high-resolution 3D reconstruction of an object is also achieved by using the photometric stereo algorithm.
Photon-efficient 3D Imaging Up to 21.6 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/cosi.2019.cth2a.4

2019-01-01

Abstract:We demonstrate active single-photon 3D imaging at a range of up to 21.6 km by implementing a high-efficiency and low-noise single-photon LiDAR system and designing a long-range-tailored computational algorithm.
Single photon single pixel imaging into thick scattering medium

Long Pan,Yuecheng Shen,Ji Qi,Junhui Shi,Xiaohua Feng

DOI: https://doi.org/10.1364/oe.484874

IF: 3.8

2023-04-13

Optics Express

Abstract:Long Pan, Yuecheng Shen, Ji Qi, Junhui Shi, Xiaohua Feng Imaging into thick scattering medium is a long-standing challenge. Beyond the quasi-ballistic regime, multiple scattering scrambles the ... [Opt. Express 31, 13943-13958 (2023)]

optics
Airborne Single-Photon LiDAR Towards a Small-Sized and Low-Power Payload

Yu Hong,Shijie Liu,Zheng-ping Li,Xin Huang,Pengyu Jiang,Yang Xu,Cheng Wu,Hao Zhou,Yu-chen Zhang,Hai-lun Ren,Zhao-hui Li,Jianjun Jia,Qiang Zhang,Chunlai Li,Feihu Xu,Jian-yu Wang,Jian-wei Pan

DOI: https://doi.org/10.1364/optica.518999

IF: 10.4

2024-01-01

Optica

Abstract:Single -photon light detection and ranging (LiDAR) has played an important role in areas ranging from target identification and 3D imaging to remote sensing. Its high sensitivity provides the feasibility of lightweight LiDAR systems for the resource -limited airborne and spaceborne platforms. Here, we design and demonstrate an airborne single -photon LiDAR towards the compact, small -sized, and low -power payload. To reduce the system size, we utilize small telescopes with an optical aperture of 47 mm and develop the sub -pixel scanning approach to enhance the imaging resolution. With the fine scanning mirrors, we validate the super -resolution ability in the ground experiment by surpassing the system's resolution by 2.5 times and achieve high -resolution 3D imaging in the airborne experiment. To realize low -power LiDAR, we employ photon -efficient computational algorithms and high -quality single -photon avalanche diode (SPAD) arrays. This enables us to reconstruct images from noisy data even under challenging conditions of two signal photons per pixel. Using the airborne single -photon LiDAR system, we demonstrate 3D imaging during daytime over a large area for remote sensing applications and show the capability to reveal the detailed features of various landforms and objects. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers

Julián Tachella,Yoann Altmann,Nicolas Mellado,Aongus McCarthy,Rachael Tobin,Gerald S. Buller,Jean-Yves Tourneret,Stephen McLaughlin

DOI: https://doi.org/10.1038/s41467-019-12943-7

IF: 16.6

2019-11-01

Nature Communications

Abstract:Abstract Single-photon lidar has emerged as a prime candidate technology for depth imaging through challenging environments. Until now, a major limitation has been the significant amount of time required for the analysis of the recorded data. Here we show a new computational framework for real-time three-dimensional (3D) scene reconstruction from single-photon data. By combining statistical models with highly scalable computational tools from the computer graphics community, we demonstrate 3D reconstruction of complex outdoor scenes with processing times of the order of 20 ms, where the lidar data was acquired in broad daylight from distances up to 320 metres. The proposed method can handle an unknown number of surfaces in each pixel, allowing for target detection and imaging through cluttered scenes. This enables robust, real-time target reconstruction of complex moving scenes, paving the way for single-photon lidar at video rates for practical 3D imaging applications.

multidisciplinary sciences
Super-resolution Single-Photon Imaging at 8.2 Kilometers

Zheng-Ping Li,Xin Huang,Peng-Yu Jiang,Yu Hong,Chao Yu,Yuan Cao,Jun Zhang,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/oe.383456

IF: 3.8

2020-01-01

Optics Express

Abstract:Single-photon light detection and ranging (LiDAR), offering single-photon sensitivity and picosecond time resolution, has been widely adopted for active imaging applications. Long-range active imaging is a great challenge, because the spatial resolution degrades significantly with the imaging range due to the diffraction limit of the optics, and only weak echo signal photons can return but mixed with a strong background noise. Here we propose and demonstrate a photon-efficient LiDAR approach that can achieve sub-Rayleigh resolution imaging over long ranges. This approach exploits fine sub-pixel scanning and a deconvolution algorithm tailored to this long-range application. Using this approach, we experimentally demonstrated active three-dimensional (3D) single-photon imaging by recognizing different postures of a mannequin model at a stand-off distance of 8.2 km in both daylight and night. The observed spatial (transversal) resolution is ∼5.5 cm at 8.2 km, which is about twice of the system's resolution. This also beats the optical system's Rayleigh criterion. The results are valuable for geosciences and target recognition over long ranges.
Single-Photon Lidar for Fast Imaging at Low SBR and Few Photons

Xue Ruikai,Kang Yan,Zhang Tongyi,Meng Fanxing,Wang Xiaofang,Li Weiwei,Li Lifei,Zhao Wei

DOI: https://doi.org/10.3788/LOP223192

2023-01-01

Laser & Optoelectronics Progress

Abstract:In low-light conditions, the single-photon light detection and ranging (Lidar) technique based on time-correlated single-photon counting (TCSPC) is suited for collecting a three-dimensional (3D) profile of the target. We present a rapid 3D reconstruction approach for single-photon Lidar with low signal-to-background ratio (SBR) and few photons based on a combination of short-duration range gate selection, photon accumulation of surrounding pixels, and photon efficiency algorithm in this paper. We achieve the best noise filtering and 3D image reconstruction by choosing the optimal combined order of simple methods. Experiments were carried out to validate the various depth estimation algorithms using simulated data and single-photon avalanche diode ( SPAD) array data under varying SBR. The experimental results demonstrate that our proposed method can achieve high-quality 3D reconstruction with a faster processing speed compared to the existing algorithms. The proposed technology will encourage the use of single-photon Lidar to suit practical needs such as quick and noise-tolerant 3D imaging.
Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Anhu Li,Xingsheng Liu,Jianfeng Sun,Zhiyong Lu

DOI: https://doi.org/10.1016/j.optlaseng.2021.106836

IF: 5.666

2022-03-01

Optics and Lasers in Engineering

Abstract:Light detection and ranging (LiDAR) as a significant approach to three-dimensional perception has increasingly suffered from challenges for compact structure, high resolution and strong adaptability. This paper presents a versatile LiDAR system that incorporates multi-beam scanning using Risley prisms and coherent detection based on triangular frequency modulation. By combining Risley-prism-based multi-beam steering model with simultaneous distance and velocity measurements, the LiDAR architecture for three-dimensional imaging is theoretically demonstrated. A unified LiDAR point cloud processing framework is developed, where the multi-mode integrated filtering method is proposed for outlier removal using point cloud characteristics. The coarse-fine coupled strategy is also formulated to combine statistical modeling with iterative optimization for multi-channel point cloud registration. It is experimentally validated that our LiDAR can achieve high-resolution three-dimensional information acquisition against long range, and the proposed point cloud processing technique can fully reconstruct the spatial form of object while preserving sufficient details.

optics
Non-invasive single-shot 3D imaging through a scattering layer using speckle interferometry

Atul S. Somkuwar,Bhargab Das,Vinu R.V,Yongkeun Park,Rakesh Kumar Singh

DOI: https://doi.org/10.48550/arXiv.1511.04658

2015-11-15

Abstract:Optical imaging through complex scattering media is one of the major technical challenges with important applications in many research fields, ranging from biomedical imaging, astronomical telescopy, and spatially multiplex optical communications. Although various approaches for imaging though turbid layer have been recently proposed, they had been limited to two-dimensional imaging. Here we propose and experimentally demonstrate an approach for three-dimensional single-shot imaging of objects hidden behind an opaque scattering layer. We demonstrate that under suitable conditions, it is possible to perform the 3D imaging to reconstruct the complex amplitude of objects situated at different depths.

Optics

Single-photon 3D imaging of room-scale scenes through scattering media

Long-range photon-efficient 3D imaging without range ambiguity

All-Time Single-Photon 3d Imaging Over 21 Km

Single-shot fast 3D imaging through scattering media using structured illumination

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

High-resolution 3D Imaging Through Dense Camouflage Nets Using Single-Photon LiDAR

Single-photon Computational 3D Imaging at 45 Km

Single photon imaging based on a photon driven sparse sampling

3D Object Imaging through Scattering Media

Linear Terrestrial Laser Scanning Using Array Avalanche Photodiodes As Detectors for Rapid Three-Dimensional Imaging.

Compressive Sensing-Based Three-Dimensional Laser Imaging with Dual Illumination.

Three-Dimensional Imaging Via Time-Correlated Single-Photon Counting

Photon-efficient 3D Imaging Up to 21.6 Km

Single photon single pixel imaging into thick scattering medium

Airborne Single-Photon LiDAR Towards a Small-Sized and Low-Power Payload

Real-time 3D reconstruction from single-photon lidar data using plug-and-play point cloud denoisers

Super-resolution Single-Photon Imaging at 8.2 Kilometers

Single-Photon Lidar for Fast Imaging at Low SBR and Few Photons

Risley-prism-based multi-beam scanning LiDAR for high-resolution three-dimensional imaging

Non-invasive single-shot 3D imaging through a scattering layer using speckle interferometry