Low-cost SPAD sensing for non-line-of-sight tracking, material classification and depth imaging

Clara Callenberg,Zheng Shi,Felix Heide,Matthias B. Hullin

DOI: https://doi.org/10.1145/3476576.3476611

IF: 6.2

2021-08-01

ACM Transactions on Graphics

Abstract:ACM Transactions on Graphics, <a href="https://dl.acm.org/toc/tog/2021/40/4">Volume 40, Issue 4</a>, Page 1-12, August 2021. <br/>

computer science, software engineering

What problem does this paper attempt to address?

Optimization of System Design and Calibration Algorithm for SPAD-Based LiDAR Imager

Dong Li,Rui Ma,Xiayu Wang,Jin Hu,Zhangming Zhu

DOI: https://doi.org/10.1109/tim.2022.3207801

IF: 5.6

2022-01-01

IEEE Transactions on Instrumentation and Measurement

Abstract:This article presents the optimization of system design and calibration algorithm for light detection and ranging (LiDAR) imager based on the single-photon avalanche diode (SPAD) image sensor. The supply voltage and the gating high-voltage driving circuit of the SPAD are optimized based on the theoretical analysis and experimental data to improve the trigger times of the SPAD for the laser echo. The real-time calibration algorithm is realized in a field-programmable gate array (FPGA) to obtain the flight time and improve the measurement reliability. A 10-bit time- and area-efficient shifted interframe multievent histogram and a bubbling-based peak detection algorithm are used to calculate flight time, which requires the memory as low as 16 times smaller than storing complete histogram if the pixel values are coded on up to 10 bits and can detect up to four different targets simultaneously without increasing the measurement time. The performance of different kinds of background noise measurement methods is analyzed based on experimental data, which shows that the measurement results are more accurate with the increase of time-to-digital converter (TDC) event detection ability. The proposed crosstalk suppression algorithm based on the LiDAR transmission function can reduce optical crosstalk between adjacent pixels to improve the measurement reliability of the LiDAR imager. The LiDAR imager is presented as capable of measuring a 10-m range with 70-Klux background noise and a $30^{\circ } \times 45^{\circ }$ field of view.
Object tracking with 3D LIDAR via multi-task sparse learning

Shiyang Song,Zhiyu Xiang,Jilin Liu

DOI: https://doi.org/10.1109/icma.2015.7237897

2015-01-01

Abstract:Moving object tracking is a fundamental task for autonomous vehicles operating in urban areas. In this paper, a novel sparse learning based object tracking algorithm utilizing 3D LIDAR data is proposed. The 3D point clouds acquired from HDL-64E 3D LIDAR are first resampled on a virtual image plane, where the hypothesis of the targets is generated under the particle filtering framework. Four complementary features, i.e., normal orientation, depth, LBP and HOG, are extracted on each particle to describe the appearance of the candidates. Then a multi-task multi-cue sparse learning algorithm is employed to select the best candidate and realize the tracking of the object. To improve the robustness of the algorithm, the sparse learning framework is further enhanced by a specifically designed background filtering and occlusion detection mechanism. The experiments carried out on KITTI benchmark show promising object tracking performance, especially when handling complex tracking situations such as occlusion and posture change.
Simulating single-photon detector array sensors for depth imaging

Stirling Scholes,Germán Mora-Martín,Feng Zhu,Istvan Gyongy,Phil Soan,Jonathan Leach

DOI: https://doi.org/10.48550/arXiv.2210.05644

2022-10-07

Abstract:Single-Photon Avalanche Detector (SPAD) arrays are a rapidly emerging technology. These multi-pixel sensors have single-photon sensitivities and pico-second temporal resolutions thus they can rapidly generate depth images with millimeter precision. Such sensors are a key enabling technology for future autonomous systems as they provide guidance and situational awareness. However, to fully exploit the capabilities of SPAD array sensors, it is crucial to establish the quality of depth images they are able to generate in a wide range of scenarios. Given a particular optical system and a finite image acquisition time, what is the best-case depth resolution and what are realistic images generated by SPAD arrays? In this work, we establish a robust yet simple numerical procedure that rapidly establishes the fundamental limits to depth imaging with SPAD arrays under real world conditions. Our approach accurately generates realistic depth images in a wide range of scenarios, allowing the performance of an optical depth imaging system to be established without the need for costly and laborious field testing. This procedure has applications in object detection and tracking for autonomous systems and could be easily extended to systems for underwater imaging or for imaging around corners.

Image and Video Processing,Computer Vision and Pattern Recognition,Optics
Depth estimation in SPAD-based LIDAR sensors

Mingzhe Chen,Padmakumar Rao,Esteban Venialgo,Padmakumar R. Rao

DOI: https://doi.org/10.1364/oe.507975

IF: 3.8

2024-01-18

Optics Express

Abstract:Mingzhe Chen, Padmakumar R. Rao, Esteban Venialgo In direct time-of-flight (D-TOF) light detection and ranging (LIDAR), accuracy and full-scale range (FSR) are the main performance ... [Opt. Express 32, 3006-3030 (2024)]

optics
A 32×32 Flash LiDAR SPAD Sensor with Up-to-1kfps Motional Target Detection by Threshold-adaptive 2D Dynamic Vision

Jingyi Wang,Zhangcheng Huang,Bu Chen,Hongyang Shang,Jiapei Zheng,Hankun Lv,Chixiao Chen,Qi Liu,Ming Liu

DOI: https://doi.org/10.1109/cicc60959.2024.10529051

2024-01-01

Abstract:The detection and tracking of 3D moving targets have attracted enormous attention in fields like unmanned vehicles and augmented reality. Single-photon avalanche detectors (SPAD) perform excellent ability in 3D imaging due to their ultra-high sensitivity and temporal resolution. However, flash light detection and ranging (LiDAR) systems using SPADs often require thousands of frames to measure distance due to background light interference. This leads to low frame rate and high power consumption, posing challenges in capturing fast-moving targets [1]. [2] introduced a Vision-LiDAR hybrid SPAD sensor that saves power by capturing depth frames only during inter-frame intensity changes. [3] used in-pixel histogramming to track the peak and preclude the detection in the non-peak range. However, both of them output full-format 3D images with redundant static scene pixels. [4] utilized stereo vision to identify the region of interest (ROI) for dynamic objects and facilitate data windowing in depth imaging but is limited by large size and short detection range. Additionally, traditional dynamic vision sensors (DVS) often employ fixed or global adjustable thresholds, failing to match different pixel-level intensity changes [5].
FoveaSPAD: Exploiting Depth Priors for Adaptive and Efficient Single-Photon 3D Imaging

Justin Folden,Atul Ingle,Sanjeev J. Koppal

2024-12-03

Abstract:Fast, efficient, and accurate depth-sensing is important for safety-critical applications such as autonomous vehicles. Direct time-of-flight LiDAR has the potential to fulfill these demands, thanks to its ability to provide high-precision depth measurements at long standoff distances. While conventional LiDAR relies on avalanche photodiodes (APDs), single-photon avalanche diodes (SPADs) are an emerging image-sensing technology that offer many advantages such as extreme sensitivity and time resolution. In this paper, we remove the key challenges to widespread adoption of SPAD-based LiDARs: their susceptibility to ambient light and the large amount of raw photon data that must be processed to obtain in-pixel depth estimates. We propose new algorithms and sensing policies that improve signal-to-noise ratio (SNR) and increase computing and memory efficiency for SPAD-based LiDARs. During capture, we use external signals to \emph{foveate}, i.e., guide how the SPAD system estimates scene depths. This foveated approach allows our method to ``zoom into'' the signal of interest, reducing the amount of raw photon data that needs to be stored and transferred from the SPAD sensor, while also improving resilience to ambient light. We show results both in simulation and also with real hardware emulation, with specific implementations achieving a 1548-fold reduction in memory usage, and our algorithms can be applied to newly available and future SPAD arrays.

Image and Video Processing,Computer Vision and Pattern Recognition
Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD Data

Stirling Scholes,Jonathan Leach

DOI: https://doi.org/10.3390/s24206522

IF: 3.9

2024-10-11

Sensors

Abstract:Non-Line of Sight (NLOS) imaging has gained attention for its ability to detect and reconstruct objects beyond the direct line of sight, using scattered light, with applications in surveillance and autonomous navigation. This paper presents a versatile framework for modeling the temporal distribution of photon detections in direct Time of Flight (dToF) Lidar NLOS systems. Our approach accurately accounts for key factors such as material reflectivity, object distance, and occlusion by utilizing a proof-of-principle simulation realized with the Unreal Engine. By generating likelihood distributions for photon detections over time, we propose a mechanism for the simulation of NLOS imaging data, facilitating the optimization of NLOS systems and the development of novel reconstruction algorithms. The framework allows for the analysis of individual components of photon return distributions, yielding results consistent with prior experimental data and providing insights into the effects of extended surfaces and multi-path scattering. We introduce an optimized secondary scattering approach that captures critical multi-path information with reduced computational cost. This work provides a robust tool for the design and improvement of dToF SPAD Lidar-based NLOS imaging systems.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
A dToF Ranging Sensor with Accurate Photon Detector Measurements for LiDAR Applications

Hengwei Yu,Long Wang,Jiqing Xu,Patrick Yin Chiang

DOI: https://doi.org/10.3390/s23063011

2023-03-10

Abstract:Direct time-of-flight (dToF) ranging sensors based on single-photon avalanche diodes (SPADs) have been used as a prominent depth-sensing devices. Time-to-digital converters (TDCs) and histogram builders have become the standard for dToF sensors. However, one of the main current issues is the bin width of the histogram, which limits the accuracy of depth without TDC architecture modifications. SPAD-based light detection and ranging (LiDAR) systems require new methods to overcome their inherent drawbacks for accurate 3D ranging. In this work, we report an optimal matched filter to process the raw data of the histogram to obtain high-accuracy depth. This method is performed by feeding the raw data of the histogram into the different matched filters and using the Center-of-Mass (CoM) algorithm for depth extraction. Comparing the measurement results of different matched filters, the filter with the highest depth accuracy can be obtained. Finally, we implemented a dToF system-on-chip (SoC) ranging sensor. The sensor is made of a configurable array of 16 × 16 SPADs, a 940 nm vertical-cavity surface-emitting laser (VCSEL), an integrated VCSEL driver, and an embedded microcontroller unit (MCU) core to implement the best matched filter. To achieve suitably high reliability and low cost, the above-mentioned features are all packaged into one module for ranging. The system resulted in a precision of better than 5 mm within 6 m with 80% reflectance of the target, and had a precision better than 8 mm at a distance within 4 m with 18% reflectance of the target.
A Gradient-Gated SPAD Array for Non-Line-of-Sight Imaging

Jiuxuan Zhao,Francesco Gramuglia,Pouyan Keshavarzian,Eng-Huat Toh,Michelle Tng,Louis Lim,Vinit Dhulla,Elgin Quek,Myung-Jae Lee,Edoardo Charbon

DOI: https://doi.org/10.1109/jstqe.2023.3283150

IF: 4.9

2023-01-01

IEEE Journal of Selected Topics in Quantum Electronics

Abstract:Time-resolved non-line-of-sight (NLOS) imaging based on single-photon avalanche diode (SPAD) detectors have demonstrated impressive results in recent years. To acquire adequate number of indirect photons from a hidden scene in the presence of overwhelming amount of early-arrival photons, a single-gated SPAD is widely employed to mitigate pile-up. However, additional prior knowledge of the hidden range and relay surface profile are required to preset the gating position and implement the reconstruction. With this work, we propose a gradient-gated technique to alleviate these shortcomings (pile-up and prior knowledge) in NLOS imaging with the development of a 6 × 6 SPAD array fabricated in a standard 55-nm Bipolar-CMOS-DMOS (BCD) technology. The SPAD sensor includes a delay-locked loop (DLL) block, a gating generator and a pixel array, which can be flexibly configured to free-running, single-gating and gradient-gating modes. The rise time of the gates is less than 450 ps (from 10% to 90%). In gradient-gating mode, the interval time between adjacent gates can be configured from 300 ps to 2 ns. In single-gating mode, the minimum gate window is measured below 5 ns. We demonstrated the sensor in a confocal NLOS imaging system that reconstructs hidden scenes with both retroreflective and diffuse objects. The presented scheme enables the development of calibration-free NLOS imaging modality for practical applications.

engineering, electrical & electronic,optics,physics, applied,quantum science & technology
Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second

Ji Hyun Nam,Eric Brandt,Sebastian Bauer,Xiaochun Liu,Marco Renna,Alberto Tosi,Eftychios Sifakis,Andreas Velten

DOI: https://doi.org/10.1038/s41467-021-26721-x

IF: 16.6

2021-11-11

Nature Communications

Abstract:Abstract Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we introduce a multipixel time-of-flight non-line-of-sight imaging method combining specifically designed Single Photon Avalanche Diode (SPAD) array detectors with a fast reconstruction algorithm that captures and reconstructs live low-latency videos of non-line-of-sight scenes with natural non-retroreflective objects. We develop a model of the signal-to-noise-ratio of non-line-of-sight imaging and use it to devise a method that reconstructs the scene such that signal-to-noise-ratio, motion blur, angular resolution, and depth resolution are all independent of scene depth suggesting that reconstruction of very large scenes may be possible.

multidisciplinary sciences
PCA-based real-time single-photon 3D imaging method

Yao Duan,Chuanchuan Yang,Hongbin Li

DOI: https://doi.org/10.1016/j.optcom.2021.127777

IF: 2.4

2022-01-01

Optics Communications

Abstract:The single photon lidar (SPL) system can collect data within a wide range, which is widely used in multispectral depth imaging and underwater depth imaging. However, SPL systems are subject to solar noise and dark count returns, resulting in poor quality of image construction. Therefore, a high-efficiency 3D imaging technology is needed to improve the performance of the SPL system. To address this problem, this paper develops a new short-range single-photon three-dimensional imaging method with both high quality and low complexity. In this paper, we use a 400 × 100 SPAD detector and an 850 nm laser source composed of VCSEL array to reconstruct the 3D image of a target within 5 m. By applying principal component analysis (PCA), the complexity of the proposed method can be reduced by 20 times compared with existing algorithms without compromising imaging quality, making the proposed method a promising candidate to be applied to a wide range of fields such as consumer electronics.
High-resolution multi-spectral snapshot 3D imaging with a SPAD array camera

Fenghua Qi,Pu Zhang

DOI: https://doi.org/10.1364/OE.492581

2023-09-11

Abstract:Currently, mainstream light detection and ranging (LiDAR) systems usually involve a mechanical scanner component, which enables large-scale, high-resolution and multi-spectral imaging, but is difficult to assemble and has a larger system size. Furthermore, the mechanical wear on the moving parts of the scanner reduces its usage lifetime. Here, we propose a high-resolution scan-less multi-spectral three-dimensional (3D) imaging system, which improves the resolution with a four-times increase in the pixel number and can achieve multi-spectral imaging in a single snapshot. This system utilizes a specially designed multiple field-of-view (multi-FOV) system to separate four-wavelength echoes carrying depth and spectral reflectance information with predetermined temporal intervals, such that one single pixel of the SPAD array can sample four adjacent positions through the four channels' FOVs with subpixel offset. The positions and reflectivity are thus mapped to wavelengths in different time-bins. Our results show that the system can achieve high-resolution multi-spectral 3D imaging in a single exposure without scanning component. This scheme is the first to realize scan-less single-exposure high-resolution and multi-spectral imaging with a SPAD array sensor.
Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection

Maik Beer,Jennifer Ruskowski,Rainer Kokozinski,Jan Haase

DOI: https://doi.org/10.3390/s18124338

IF: 3.9

2018-12-08

Sensors

Abstract:Light detection and ranging (LiDAR) systems based on silicon single-photon avalanche diodes (SPAD) offer several advantages, like the fabrication of system-on-chips with a co-integrated detector and dedicated electronics, as well as low cost and high durability due to well-established CMOS technology. On the other hand, silicon-based detectors suffer from high background light in outdoor applications, like advanced driver assistance systems or autonomous driving, due to the limited wavelength range in the infrared spectrum. In this paper we present a novel method based on the adaptive adjustment of photon coincidence detection to suppress the background light and simultaneously improve the dynamic range. A major disadvantage of fixed parameter coincidence detection is the increased dynamic range of the resulting event rate, allowing good measurement performance only at a specific target reflectance. To overcome this limitation we have implemented adaptive photon coincidence detection. In this technique the parameters of the photon coincidence detection are adjusted to the actual measured background light intensity, giving a reduction of the event rate dynamic range and allowing the perception of high dynamic scenes. We present a 192 × 2 pixel CMOS SPAD-based LiDAR sensor utilizing this technique and accompanying outdoor measurements showing the capability of it. In this sensor adaptive photon coincidence detection improves the dynamic range of the measureable target reflectance by over 40 dB.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
SPADs and SiPMs Arrays for Long-Range High-Speed Light Detection and Ranging (LiDAR)

Federica Villa,Fabio Severini,Francesca Madonini,Franco Zappa

DOI: https://doi.org/10.3390/s21113839

2021-06-01

Abstract:Light Detection and Ranging (LiDAR) is a 3D imaging technique, widely used in many applications such as augmented reality, automotive, machine vision, spacecraft navigation and landing. Achieving long-ranges and high-speed, most of all in outdoor applications with strong solar background illumination, are challenging requirements. In the introduction we review different 3D-ranging techniques (stereo-vision, projection with structured light, pulsed-LiDAR, amplitude-modulated continuous-wave LiDAR, frequency-modulated continuous-wave interferometry), illumination schemes (single point and blade scanning, flash-LiDAR) and time-resolved detectors for LiDAR (EM-CCD, I-CCD, APD, SPAD, SiPM). Then, we provide an extensive review of silicon- single photon avalanche diode (SPAD)-based LiDAR detectors (both commercial products and research prototypes) analyzing how each architecture faces the main challenges of LiDAR (i.e., long ranges, centimeter resolution, large field-of-view and high angular resolution, high operation speed, background immunity, eye-safety and multi-camera operation). Recent progresses in 3D stacking technologies provided an important step forward in SPAD array development, allowing to reach smaller pitch, higher pixel count and more complex processing electronics. In the conclusions, we provide some guidelines for the design of next generation SPAD-LiDAR detectors.
Custom-Technology Single-Photon Avalanche Diode Linear Detector Array for Underwater Depth Imaging

Aurora Maccarone,Giulia Acconcia,Ulrich Steinlehner,Ivan Labanca,Darryl Newborough,Ivan Rech,Gerald S Buller

DOI: https://doi.org/10.3390/s21144850

2021-07-16

Abstract:We present an optical depth imaging system suitable for highly scattering underwater environments. The system used the time-correlated single-photon counting (TCSPC) technique and the time-of-flight approach to obtain depth profiles. The single-photon detection was provided by a linear array of single-photon avalanche diode (SPAD) detectors fabricated in a customized silicon fabrication technology for optimized efficiency, dark count rate, and jitter performance. The bi-static transceiver comprised a pulsed laser diode source with central wavelength 670 nm, a linear array of 16 × 1 Si-SPAD detectors, with a dedicated TCSPC acquisition module. Cylindrical lenses were used to collect the light scattered by the target and image it onto the sensor. These laboratory-based experiments demonstrated single-photon depth imaging at a range of 1.65 m in highly scattering conditions, equivalent up to 8.3 attenuation lengths between the system and the target, using average optical powers of up to 15 mW. The depth and spatial resolution of this sensor were investigated in different scattering conditions.
Human activity recognition using a single-photon direct time-of-flight sensor

Germán Mora-Martín,Stirling Scholes,Robert K Henderson,Jonathan Leach,Istvan Gyongy

DOI: https://doi.org/10.1364/OE.516681

2024-05-06

Abstract:Single-Photon Avalanche Diode (SPAD) direct Time-of-Flight (dToF) sensors provide depth imaging over long distances, enabling the detection of objects even in the absence of contrast in colour or texture. However, distant objects are represented by just a few pixels and are subject to noise from solar interference, limiting the applicability of existing computer vision techniques for high-level scene interpretation. We present a new SPAD-based vision system for human activity recognition, based on convolutional and recurrent neural networks, which is trained entirely on synthetic data. In tests using real data from a 64×32 pixel SPAD, captured over a distance of 40 m, the scheme successfully overcomes the limited transverse resolution (in which human limbs are approximately one pixel across), achieving an average accuracy of 89% in distinguishing between seven different activities. The approach analyses continuous streams of video-rate depth data at a maximal rate of 66 FPS when executed on a GPU, making it well-suited for real-time applications such as surveillance or situational awareness in autonomous systems.
End-to-end Learned, Optically Coded Super-resolution SPAD Camera

Qilin Sun,Jian Zhang,Xiong Dun,Bernard Ghanem,Yifan Peng,Wolfgang Heidrich

DOI: https://doi.org/10.1145/3372261

IF: 6.2

2020-01-01

ACM Transactions on Graphics

Abstract:Single Photon Avalanche Photodiodes (SPADs) have recently received a lot of attention in imaging and vision applications due to their excellent performance in low-light conditions, as well as their ultra-high temporal resolution. Unfortunately, like many evolving sensor technologies, image sensors built around SPAD technology currently suffer from a low pixel count. In this work, we investigate a simple, low-cost, and compact optical coding camera design that supports high-resolution image reconstructions from raw measurements with low pixel counts. We demonstrate this approach for regular intensity imaging, depth imaging, as well transient imaging. Our method uses an end-to-end framework to simultaneously optimize the optical design and a reconstruction network for obtaining super-resolved images from raw measurements. The optical design space is that of an engineered point spread function (implemented with diffractive optics), which can be considered an optimized anti-aliasing filter to preserve as much high-resolution information as possible despite imaging with a low pixel count, low fill-factor SPAD array. We further investigate a deep network for reconstruction. The effectiveness of this joint design and reconstruction approach is demonstrated for a range of different applications, including high-speed imaging, and time of flight depth imaging, as well as transient imaging. While our work specifically focuses on low-resolution SPAD sensors, similar approaches should prove effective for other emerging image sensor technologies with low pixel counts and low fill-factors.
TDC-less Direct Time-of-Flight Imaging Using Spiking Neural Networks

Jack MacLean,Brian Stewart,Istvan Gyongy

2024-02-12

Abstract:3D depth sensors using single-photon avalanche diodes (SPADs) are becoming increasingly common in applications such as autonomous navigation and object detection. Recent designs implement on-chip histogramming time-to-digital converters (TDCs) to compress the photon timestamps and reduce the bottleneck in the read-out and processing of large volumes of photon data. However, the use of full histogramming with large SPAD arrays poses significant challenges due to the associated demands in silicon area and power consumption. We propose a TDC-less dToF sensor which uses Spiking Neural Networks (SNN) to process the SPAD events directly. The proposed SNN is trained and tested on synthetic SPAD events, and while it offers five times lower precision in depth prediction than a classic centre-of-mass (CoM) algorithm (applied to histograms of the events), it achieves similar Mean Absolute Error (MAE) with faster processing speeds and significantly lower power consumption is anticipated.

Image and Video Processing,Signal Processing
Low-Timing-Jitter GHz-Gated InGaAs/InP Single-Photon Avalanche Photodiode for LIDAR

Yan Liang,Bo Xu,Qilai Fei,Wen Wu,Xiao Shan,Kun Huang,Heping Zeng,Shan Xiao

DOI: https://doi.org/10.1109/jstqe.2021.3109584

IF: 4.9

2022-03-01

IEEE Journal of Selected Topics in Quantum Electronics

Abstract:InGaAsInP single-photon avalanche diodes (SPADs) attract increasing attention for the infrared light detection and ranging (LIDAR) due to the low-cost and compact-size construction. Although constant endeavor has been dedicated to improve the dead time and timing jitter, it remains challenging to implement high-speed and high-resolution LIDAR. Here, we develop a high-performance GHz-gated InGaAsInP APD operated in the quasi-free-running mode, while its gating signal is unlocked from the light source. The used low-pass filtering technique enables us to continuously adjust the repetition frequency of the gate for carefully optimizing photon detection efficiency (PDE) and timing jitter. Increasing the gates repetition frequency from 1 GHz to 2.75 GHz, the PDE improves dramatically from 2.02 to 3.30, while the timing jitter drops from 156 ps to 114 ps. Furthermore, we verify that changes in the PDE have little effect on the timing characteristics, making the SPAD more suitable for LIDAR with large dynamic range. Meanwhile, the dead time is about 4 ns, which is much shorter than that of the SPAD working in the free-running mode, guaranteeing rapid mapping of targets. Finally, as a proof-of-principle demonstration, the InGaAsInP SPAD is used in a time-of-flight LIDAR system, which demonstrates a sub-centimeter depth resolution directly.

engineering, electrical & electronic,optics,physics, applied,quantum science & technology
A 64 × 128 3D-Stacked SPAD Image Sensor for Low-Light Imaging

Zhe Wang,Xu Yang,Na Tian,Min Liu,Ziteng Cai,Peng Feng,Runjiang Dou,Shuangming Yu,Nanjian Wu,Jian Liu,Liyuan Liu

DOI: https://doi.org/10.3390/s24134358

2024-07-05

Abstract:Low-light imaging capabilities are in urgent demand in many fields, such as security surveillance, night-time autonomous driving, wilderness rescue, and environmental monitoring. The excellent performance of SPAD devices gives them significant potential for applications in low-light imaging. This article presents a 64 (rows) × 128 (columns) SPAD image sensor designed for low-light imaging. The chip utilizes a three-dimensional stacking architecture and microlens technology, combined with compact gated pixel circuits designed with thick-gate MOS transistors, which further enhance the SPAD's photosensitivity. The configurable digital control circuit allows for the adjustment of exposure time, enabling the sensor to adapt to different lighting conditions. The chip exhibits very low dark noise levels, with an average DCR of 41.5 cps at 2.4 V excess bias voltage. Additionally, it employs a denoising algorithm specifically developed for the SPAD image sensor, achieving two-dimensional grayscale imaging under 6 × 10-4 lux illumination conditions, demonstrating excellent low-light imaging capabilities. The chip designed in this paper fully leverages the performance advantages of SPAD image sensors and holds promise for applications in various fields requiring low-light imaging capabilities.

Low-cost SPAD sensing for non-line-of-sight tracking, material classification and depth imaging

Optimization of System Design and Calibration Algorithm for SPAD-Based LiDAR Imager

Object tracking with 3D LIDAR via multi-task sparse learning

Simulating single-photon detector array sensors for depth imaging

Depth estimation in SPAD-based LIDAR sensors

A 32×32 Flash LiDAR SPAD Sensor with Up-to-1kfps Motional Target Detection by Threshold-adaptive 2D Dynamic Vision

FoveaSPAD: Exploiting Depth Priors for Adaptive and Efficient Single-Photon 3D Imaging

Path Tracing-Inspired Modeling of Non-Line-of-Sight SPAD Data

A dToF Ranging Sensor with Accurate Photon Detector Measurements for LiDAR Applications

A Gradient-Gated SPAD Array for Non-Line-of-Sight Imaging

Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second

PCA-based real-time single-photon 3D imaging method

High-resolution multi-spectral snapshot 3D imaging with a SPAD array camera

Background Light Rejection in SPAD-Based LiDAR Sensors by Adaptive Photon Coincidence Detection

SPADs and SiPMs Arrays for Long-Range High-Speed Light Detection and Ranging (LiDAR)

Custom-Technology Single-Photon Avalanche Diode Linear Detector Array for Underwater Depth Imaging

Human activity recognition using a single-photon direct time-of-flight sensor

End-to-end Learned, Optically Coded Super-resolution SPAD Camera

TDC-less Direct Time-of-Flight Imaging Using Spiking Neural Networks

Low-Timing-Jitter GHz-Gated InGaAs/InP Single-Photon Avalanche Photodiode for LIDAR

A 64 × 128 3D-Stacked SPAD Image Sensor for Low-Light Imaging