Long-range photon-efficient 3D imaging without range ambiguity

Chen Dai,Wen-Long Ye,Chao Yu,Xin Huang,Zheng-Ping Li,Feihu Xu

DOI: https://doi.org/10.1364/ol.485127

IF: 3.6

2023-03-18

Optics Letters

Abstract:Chen Dai, Wen-Long Ye, Chao Yu, Xin Huang, Zheng-Ping Li, Feihu Xu Single-photon light detection and ranging (LiDAR) has broad applications ranging from remote sensing to target recognition. In most cases, ... [Opt. Lett. 48, 1542-1545 (2023)]

optics

What problem does this paper attempt to address?

Photon-efficient 3D Imaging Up to 21.6 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/cosi.2019.cth2a.4

2019-01-01

Abstract:We demonstrate active single-photon 3D imaging at a range of up to 21.6 km by implementing a high-efficiency and low-noise single-photon LiDAR system and designing a long-range-tailored computational algorithm.
Single-photon Computational 3D Imaging at 45 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Weijie Jin,Chao Yu,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/prj.390091

IF: 7.6

2019-01-01

Photonics Research

Abstract:Single-photon light detection and ranging (lidar) offers single-photon sensitivity and picosecond timing resolution, which is desirable for high-precision three-dimensional (3D) imaging over long distances. Despite important progress, further extending the imaging range presents enormous challenges because only a few echo photons return and are mixed with strong noise. Here, we tackled these challenges by constructing a high-efficiency, low-noise coaxial single-photon lidar system and developing a long-range-tailored computational algorithm that provides high photon efficiency and good noise tolerance. Using this technique, we experimentally demonstrated active single-photon 3D imaging at a distance of up to 45 km in an urban environment, with a low return-signal level of ～1 photon per pixel. Our system is feasible for imaging at a few hundreds of kilometers by refining the setup, and thus represents a step towards low-power and high-resolution lidar over extra-long ranges.
All-Time Single-Photon 3d Imaging Over 21 Km

Zheng-Ping Li,Xin Huang,Yuan Cao,Bin Wang,Yu-Huai Li,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/cleo_si.2019.sm1n.1

2019-01-01

Abstract:We experimentally demonstrate active three-dimensional (3D) imaging at a range of up to 21.6 km in daylight by constructing a high-efficiency single-photon LiDAR system and developing a long-range-tailored computational algorithm. (C) 2019 The Author(s)
Single-photon imaging over 200 km

Zheng-Ping Li,Jun-Tian Ye,Xin Huang,Peng-Yu Jiang,Yuan Cao,Yu Hong,Chao Yu,Jun Zhang,Qiang Zhang,Cheng-Zhi Peng,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/OPTICA.408657

2021-03-10

Abstract:Long-range active imaging has widespread applications in remote sensing and target recognition. Single-photon light detection and ranging (lidar) has been shown to have high sensitivity and temporal resolution. On the application front, however, the operating range of practical single-photon lidar systems is limited to about tens of kilometers over the Earth's atmosphere, mainly due to the weak echo signal mixed with high background noise. Here, we present a compact coaxial single-photon lidar system capable of realizing 3D imaging at up to 201.5 km. It is achieved by using high-efficiency optical devices for collection and detection, and what we believe is a new noise-suppression technique that is efficient for long-range applications. We show that photon-efficient computational algorithms enable accurate 3D imaging over hundreds of kilometers with as few as 0.44 signal photons per pixel. The results represent a significant step toward practical, low-power lidar over extra-long ranges.

Image and Video Processing,Optics
Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Peng-Yu Jiang,Zheng-Ping Li,Wen-Long Ye,Yu Hong,Chen Dai,Xin Huang,Shui-Qing Xi,Jie Lu,Da-Jian Cui,Yuan Cao,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/oe.487560

IF: 3.8

2023-01-01

Optics Express

Abstract:Single-photon light detection and ranging (LiDAR) has emerged as a strong candidate technology for active imaging applications. In particular, the single-photon sensitivity and picosecond timing resolution permits high-precision three-dimensional (3D) imaging capability through atmospheric obscurants including fog, haze and smoke. Here we demonstrate an array-based single-photon LiDAR system, which is capable of performing 3D imaging in atmospheric obscurant over long ranges. By adopting the optical optimization of system and the photon-efficient imaging algorithm, we acquire depth and intensity images through dense fog equivalent to 2.74 attenuation lengths at distances of 13.4 km and 20.0 km. Furthermore, we demonstrate real-time 3D imaging for moving targets at 20 frames per second in mist weather conditions over 10.5 km. The results indicate great potential for practical applications of vehicle navigation and target recognition in challenging weather.
Deep Domain Adversarial Adaptation for Photon-efficient Imaging

Yiwei Chen,Gongxin Yao,Yong Liu,Hongye Su,Xiaomin Hu,Yu Pan

DOI: https://doi.org/10.1103/physrevapplied.18.054048

IF: 4.6

2022-01-01

Physical Review Applied

Abstract: Photon-efficient imaging with the single-photon light detection and ranging (LiDAR) captures the three-dimensional (3D) structure of a scene by only a few detected signal photons per pixel. However, the existing computational methods for photon-efficient imaging are pre-tuned on a restricted scenario or trained on simulated datasets. When applied to realistic scenarios whose signal-to-background ratios (SBR) and other hardware-specific properties differ from those of the original task, the model performance often significantly deteriorates. In this paper, we present a domain adversarial adaptation design to alleviate this domain shift problem by exploiting unlabeled real-world data, with significant resource savings. This method demonstrates superior performance on simulated and real-world experiments using our home-built up-conversion single-photon imaging system, which provides an efficient approach to bypass the lack of ground-truth depth information in implementing computational imaging algorithms for realistic applications.
Super-resolution Single-Photon Imaging at 8.2 Kilometers

Zheng-Ping Li,Xin Huang,Peng-Yu Jiang,Yu Hong,Chao Yu,Yuan Cao,Jun Zhang,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/oe.383456

IF: 3.8

2020-01-01

Optics Express

Abstract:Single-photon light detection and ranging (LiDAR), offering single-photon sensitivity and picosecond time resolution, has been widely adopted for active imaging applications. Long-range active imaging is a great challenge, because the spatial resolution degrades significantly with the imaging range due to the diffraction limit of the optics, and only weak echo signal photons can return but mixed with a strong background noise. Here we propose and demonstrate a photon-efficient LiDAR approach that can achieve sub-Rayleigh resolution imaging over long ranges. This approach exploits fine sub-pixel scanning and a deconvolution algorithm tailored to this long-range application. Using this approach, we experimentally demonstrated active three-dimensional (3D) single-photon imaging by recognizing different postures of a mannequin model at a stand-off distance of 8.2 km in both daylight and night. The observed spatial (transversal) resolution is ∼5.5 cm at 8.2 km, which is about twice of the system's resolution. This also beats the optical system's Rayleigh criterion. The results are valuable for geosciences and target recognition over long ranges.
Single-photon 3D imaging of room-scale scenes through scattering media

Jianwei Zeng,Wei Li,Yijun Zhou,Feihu Xu

DOI: https://doi.org/10.1364/oe.538003

IF: 3.8

2024-10-26

Optics Express

Abstract:Jianwei Zeng, Wei Li, Yijun Zhou, Feihu Xu Light detection and ranging (LiDAR) utilizes eye-safe laser beams to perceive the world in three-dimensional (3D) detail, offering machines ... [Opt. Express 32, 40706-40718 (2024)]

optics
Compact long-range single-photon imager with dynamic imaging capability

Peng-Yu Jiang,Zheng-Ping Li,Feihu Xu

DOI: https://doi.org/10.1364/OL.416327

2021-03-01

Abstract:Single-photon light detection and ranging (LiDAR) has emerged as a strong candidate technology for active imaging applications. Benefiting from the single-photon sensitivity in detection, long-range active imaging can be realized with a low-power laser and a small-aperture transceiver. However, existing kilometer-range active imagers are bulky and have a long data acquisition time. Here we present a compact co-axial single-photon LiDAR system for kilometer-range 3D imaging. A fiber-based transceiver with a 2.5 cm effective aperture was employed to realize a robust and compact architecture, while a tailored temporal filtering approach guaranteed the high signal-to-noise level. Moreover, a micro-electro-mechanical system scanning mirror was adopted to achieve fast beam scanning. In experiment, high-resolution 3D images of different targets up to 12.8 km were acquired to demonstrate the long-range imaging capability. Furthermore, it exhibits the ability to achieve dynamic imaging at five frames per second over a distance of ∼1km. The results indicate potential in a variety of applications such as remote sensing and long-range target detection.
High-resolution Single-Photon LiDAR Without Range Ambiguity Using Hybrid-Mode Imaging [Invited]

Wen-Long Ye,Xin-Wei Kong,Wenwen Li,Zheng-Ping Li,Feihu Xu

DOI: https://doi.org/10.3788/col202422.060005

IF: 2.56

2024-01-01

Chinese Optics Letters

Abstract:We proposed a hybrid imaging scheme to estimate a high-resolution absolute depth map from low photon counts. It leverages measurements of photon arrival times from a single-photon LiDAR and an intensity image from a conventional high-resolution camera. Using a tailored fusion algorithm, we jointly processed the raw measurements from both sensors and output a high-resolution absolute depth map. We scaled up the resolution by a factor of 10, achieving 1300 x 2611 pixels and extending similar to 4.7 times the unambiguous range. These results demonstrated the superior capability of long-range high-resolution 3D imaging without range ambiguity.
Single-Photon Imaging Goes Long Range

Z.-P. Li,X. Huang,Y. Cao,F. Xu,J.-W. Pan

DOI: https://doi.org/10.1364/opn.31.12.000049

2020-01-01

Optics and Photonics News

Abstract:Single-photon sensitivity and picosecond time resolution are desirable for long-range imaging in a variety of applications. In recent experiments, we were able to substantially exceed the previous single-photon-imaging range record, demonstrating single-photon 3D imaging at a range of up to 45 km in urban environments.
Large FoV 3D Imaging of Single-Photon LiDAR at Up to 12 Km

Wen-Long Ye,Peng-Yu Jiang,Zheng-Ping Li,Yuxiao Li,Xin-Wei Kong,Feihu Xu

DOI: https://doi.org/10.1364/ol.541758

IF: 3.6

2024-01-01

Optics Letters

Abstract:Single-photon light detection and ranging (LiDAR) has emerged as a valuable technology for active imaging applications. The growing demand for wider applications has driven advancements in measurement range, imaging resolution, and field of view (FoV). Here, we present a high-resolution, large-FoV single-photon LiDAR system capable of panoramic imaging. The system employs continuous raster scanning with a single-photon detector array to achieve rapid measurements, while timing-based pixel segmentation ensures precise data organization. A histogram-folding-based data compression and reconstruction method was developed, resulting in a two-order-of-magnitude increase in processing speed during simulations while maintaining high image reconstruction quality. The experimental results demonstrated the system's capacity for rapid, high-resolution, and large-FoV imaging, achieving a resolution of 7.2'' across a 1.6∘×2.1∘ FoV (1052 × 803 pixels) for buildings up to 12 km, all captured and processed in just 10 min. This approach has great potential for use in environmental mapping and related fields.
Airborne Single-Photon LiDAR Towards a Small-Sized and Low-Power Payload

Yu Hong,Shijie Liu,Zheng-ping Li,Xin Huang,Pengyu Jiang,Yang Xu,Cheng Wu,Hao Zhou,Yu-chen Zhang,Hai-lun Ren,Zhao-hui Li,Jianjun Jia,Qiang Zhang,Chunlai Li,Feihu Xu,Jian-yu Wang,Jian-wei Pan

DOI: https://doi.org/10.1364/optica.518999

IF: 10.4

2024-01-01

Optica

Abstract:Single -photon light detection and ranging (LiDAR) has played an important role in areas ranging from target identification and 3D imaging to remote sensing. Its high sensitivity provides the feasibility of lightweight LiDAR systems for the resource -limited airborne and spaceborne platforms. Here, we design and demonstrate an airborne single -photon LiDAR towards the compact, small -sized, and low -power payload. To reduce the system size, we utilize small telescopes with an optical aperture of 47 mm and develop the sub -pixel scanning approach to enhance the imaging resolution. With the fine scanning mirrors, we validate the super -resolution ability in the ground experiment by surpassing the system's resolution by 2.5 times and achieve high -resolution 3D imaging in the airborne experiment. To realize low -power LiDAR, we employ photon -efficient computational algorithms and high -quality single -photon avalanche diode (SPAD) arrays. This enables us to reconstruct images from noisy data even under challenging conditions of two signal photons per pixel. Using the airborne single -photon LiDAR system, we demonstrate 3D imaging during daytime over a large area for remote sensing applications and show the capability to reveal the detailed features of various landforms and objects. (c) 2024 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement
A photon-efficient method based on curve fitting for photon counting 3D imaging lidar

Ling Ye,Guohua Gu,Weiji He,Wenye Yin,Jie Lin,Jian Fang,Wenye YIN,Jie LIN,Jian FANG

DOI: https://doi.org/10.1117/12.2317805

2018-09-18

Abstract:Time-of-flight (TOF) Lidar is widely used in capturing three-dimensional (3D) structure and reflectivity information. For using Geiger-mode avalanche photodiode (Gm-APD) and the technique time correlated single photon counting (TCSPC), a direct-detection 3D imaging lidar has high sensitivity in low-light-level (LLL) scene. Traditional method needs long fixed dwell time to collect tens of thousands of photons to find accurate range and mitigate Poisson noise at each pixel. We present a method that acquires accurate depth and intensity images using a small amount of detected echo photons and having quantitative analysis to estimate whether results are in the confidence interval. Based on prior knowledge that the echo signal is in the shape of emitted laser, we use one or two orders of magnitude back-reflected photons less than traditional method, fitting a curve of laser-return pulse by nonlinear least-squares fitting in order to obtain the range. The condition of moving to next pixel in our method is acquiring a fixed number of back-reflected photons, instead of sampling for a fixed time. This adaptive jump condition is able to speed up the scanning without more distortion. The results are analyzed with chi-square test to determine if the curve we fit has enough credibility. This quantitative analysis provides an important judgment condition for our method of fitting curve to recover the depth image. Experimental results demonstrate that our method is able to obtain the millimeter accuracy depth image in the confidence interval using hundreds of photons and increases photon-efficiency more than 10-fold over traditional method. Thus our method will be useful in LLL scene, such as military reconnaissance and remote sensing.
Frequency-modulated Continuous-Wave 3D Imaging with High Photon Efficiency.

Xin Huang,Yu Hong,Zheng-Ping Li,Feihu Xu

DOI: https://doi.org/10.1364/ol.463007

IF: 3.6

2022-01-01

Optics Letters

Abstract:Frequency-modulated continuous-wave (FMCW) light detection and ranging (LIDAR), which offers high depth resolution and immunity to environmental disturbances, has emerged as a strong candidate technology for active imaging applications. In general, hundreds of photons per pixel are required for accurate three-dimensional (3D) imaging. When it comes to the low-flux regime, however, depth estimation has limited robustness. To cope with this, we propose and demonstrate a photon-efficient approach for FMCW LIDAR. We first construct a FMCW LIDAR setup based on single-photon detectors where only a weak local oscillator is needed for the coherent detection. Further, to realize photon-efficient imaging, our approach borrows the data from neighboring pixels to enhance depth estimates, and employs a total-variation seminorm to smooth out the noise on the recovered depth map. Both simulation and experiment results show that our approach can produce high-quality 3D images from ∼10 signal photons per pixel, increasing the photon efficiency by 10-fold over the traditional processing method. The high photon efficiency will be valuable for low-power and rapid FMCW applications.
Multi-beam single-photon-counting three-dimensional imaging lidar

Zhaohui Li,E Wu,Chengkai Pang,Bingcheng Du,Yuliang Tao,Huan Peng,Heping Zeng,Guang Wu

DOI: https://doi.org/10.1364/oe.25.010189

IF: 3.8

2017-04-25

Optics Express

Abstract:Photon-counting laser ranging has attracted a lot of research interest for its application in the altimeter. In this letter, we report a large scale multi-beam photon-counting laser imaging system by using 100 laser beams in linear array as the light source. Taking advantage of a 100-channel low-noise high-efficiency single-photon detector, the three-dimensional image of remote targets could be constructed rapidly according to the time-of-flight measurement. This system provides a solution for a high-speed, high-resolution, low energy-consumption pushbroom airborne or spaceborne laser altimeter.

optics
High-resolution 3D Imaging Through Dense Camouflage Nets Using Single-Photon LiDAR

Peng-Yu Jiang,Zheng-Ping Li,Wen-Long Ye,Ziheng Qiu,Da-Jian Cui,Feihu Xu

DOI: https://doi.org/10.3788/ai.2024.10001

2024-01-01

Abstract:The single-photon sensitivity and picosecond time resolution of single-photon light detection and ranging (LiDAR) can provide a full-waveform profile for retrieving the three-dimentional (3D) profile of the target separated from foreground clutter. This capability has made single-photon LiDAR a solution for imaging through obscurant, camouflage nets, and semitransparent materials. However, the obstructive presence of the clutter and limited pixel numbers of single-photon detector arrays still pose challenges in achieving high-quality imaging. Here, we demonstrate a single-photon array LiDAR system combined with tailored computational algorithms for high-resolution 3D imaging through camouflage nets. For static targets, we develop a 3D sub-voxel scanning approach along with a photon-efficient deconvolution algorithm. Using this approach, we demonstrate 3D imaging through camouflage nets with a 3× improvement in spatial resolution and a 7.5× improvement in depth resolution compared with the inherent system resolution. For moving targets, we propose a motion compensation algorithm to mitigate the net's obstructive effects, achieving video-rate imaging of camouflaged scenes at 20 frame/s. More importantly, we demonstrate 3D imaging for complex scenes in various outdoor scenarios and evaluate the advanced features of single-photon LiDAR over a visible-light camera and a mid-wave infrared (MWIR) camera. The results point a way forward for high-resolution real-time 3D imaging of multi-depth scenarios.
Enhancing LiDAR performance using threshold photon-number-resolving detection

Miao Wu,Xiaochen Zhao,Ruen Chen,Labao Zhang,Weiji He,Qian Chen

DOI: https://doi.org/10.1364/oe.509252

IF: 3.8

2024-01-13

Optics Express

Abstract:Miao Wu, Xiaochen Zhao, Ruen Chen, Labao Zhang, Weiji He, Qian Chen Single-photon light detection and ranging (LiDAR) is widely used to reconstruct 3D scenes. Nevertheless, depth and reflectivity maps ... [Opt. Express 32, 2574-2589 (2024)]

optics
Advancement on target ranging and tracking by four-quadrant photon counting lidar

Ahui Hou,Yihua Hu,Nanxiang Zhao,Zhenglei Dou,Xiao Dong,Shilong Xu,Fei Han,Jiajie Fang

DOI: https://doi.org/10.1364/oe.525137

IF: 3.8

2024-06-05

Optics Express

Abstract:Ahui Hou, Yihua Hu, Nanxiang Zhao, Zhenglei Dou, Xiao Dong, Shilong Xu, Fei Han, Jiajie Fang Single-photon lidar stands out as a promising technology for long-distance lidar applications, owing to its attributes of single-photon ... [Opt. Express 32, 22537-22550 (2024)]

optics
Enhancing Angular Resolution in Single-Photon LIDAR for Daytime Long-Range 3D Imaging

Yun Jiang,Bo Liu,Rui Wang,Yang Chen,Zhen Chen,Bin Zhao,Guangmeng Guo,Ling Wang,Lan Luo,Wenkai Li,Fengyun Huang,Yuqiang Yang

DOI: https://doi.org/10.1016/j.optlaseng.2024.108178

IF: 5.666

2024-01-01

Optics and Lasers in Engineering

Abstract:Single photon LIDAR exhibits exceptional detection sensitivity and finds extensive applications in long-distance measurement and three-dimensional imaging domains. However, it is susceptible to background noise interference, leading to a trade-off between scanning imaging efficiency and angular resolution, thereby limiting its overall performance. In this paper, we propose a novel ‘compression-resampling’ high-resolution imaging method for single-photon scanning LIDAR based on the spatial correlation of the target scene. This approach significantly enhances the system's angular resolution without compromising imaging efficiency. By employing this method, we successfully conducted 3D imaging over distances exceeding 26 km even under challenging conditions with high levels of background noise during daylight hours. Within a target field of view measuring 1° × 1°, we reconstructed a high-resolution 3D point cloud image comprising 1000 × 1410 pixels. Notably, this achievement yielded an impressive angular resolution of 17.4 urad while maintaining an acceptable imaging time of approximately 20 minutes. The results unequivocally demonstrate the effectiveness of our proposed method in improving the quality of three-dimensional imaging and enhancing angular resolution while simultaneously reducing imaging time requirements, thus expanding potential application scenarios for single-photon LIDAR technology.

Long-range photon-efficient 3D imaging without range ambiguity

Photon-efficient 3D Imaging Up to 21.6 Km

Single-photon Computational 3D Imaging at 45 Km

All-Time Single-Photon 3d Imaging Over 21 Km

Single-photon imaging over 200 km

Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Deep Domain Adversarial Adaptation for Photon-efficient Imaging

Super-resolution Single-Photon Imaging at 8.2 Kilometers

Single-photon 3D imaging of room-scale scenes through scattering media

Compact long-range single-photon imager with dynamic imaging capability

High-resolution Single-Photon LiDAR Without Range Ambiguity Using Hybrid-Mode Imaging [Invited]

Single-Photon Imaging Goes Long Range

Large FoV 3D Imaging of Single-Photon LiDAR at Up to 12 Km

Airborne Single-Photon LiDAR Towards a Small-Sized and Low-Power Payload

A photon-efficient method based on curve fitting for photon counting 3D imaging lidar

Frequency-modulated Continuous-Wave 3D Imaging with High Photon Efficiency.

Multi-beam single-photon-counting three-dimensional imaging lidar

High-resolution 3D Imaging Through Dense Camouflage Nets Using Single-Photon LiDAR

Enhancing LiDAR performance using threshold photon-number-resolving detection

Advancement on target ranging and tracking by four-quadrant photon counting lidar

Enhancing Angular Resolution in Single-Photon LIDAR for Daytime Long-Range 3D Imaging