Abstract:Active single-photon light detection and ranging (LiDAR) imaging technology adopting emerging single-photon avalanche diode (SPAD) has been used extensively for 3D imaging of complex scenes. However, the different signal-to-noise data acquired by SPAD under complex scenes and the larger pixel size of the SPAD pose a great challenge for robustly estimating the scene depth with rich detailed information. In this paper, we have designed a two-stage network including a multi-scale encoder-decoder sub-network and an intensity-guided edge refinement sub-network using a sensor fusion strategy to improve the robustness of the depth estimation network. In the first stage of the sub-network, we use the UNet3+ network to integrate fine-grained detail information and coarse-grained semantic information from full-scale through skip connections across scales on the decoder. In the meantime, the deep boosting network is added to the encoder to extract rich contextual information from the spatial-temporal domain to alleviate semantic gaps between the encoder and decoder. Moreover, in the second stage of the sub-network, we adopt an inverted y-shaped backbone network with the same structure between the encoder and decoder coupled with the same weight at both encoders. The purpose of this design is to extract structural similarity features with spatial consistency from intensity and depth to compensate for the missing detail of reconstructed depth by the first stage sub-network. The experimental results conducted on both simulated and real-world datasets demonstrate that our network outperforms previous networks. In addition, networks are trained on single or multiple signal-to-background ratio datasets to estimate the real-world data respectively, and the results show that our proposed network is more robust.

Single-pixel Depth Imaging

Depth Acquisition in Single-Pixel Imaging with Multiplexed Illumination

Computational Depth Imaging Using the Fast Deconvolution Method

Deep Learning Based Single-Photon 3D Imaging with Multiple Returns

Multispectral single pixel imaging based on spatial and spectral dimension decoupling

High fidelity single-pixel imaging

Single-pixel 3D imaging with time-based depth resolution

Deep-learning Enables Single-Pixel Spectral Imaging

3D Single-pixel imaging with active sampling patterns and learning based reconstruction

Single pixel imaging via unsupervised deep compressive sensing with collaborative sparsity in discretized feature space

Depth Measurement Based on a Convolutional Neural Network and Structured Light

Adaptive Depth Imaging with Single-Photon Detectors

Robust single-photon 3D imaging based on full-scale feature integration and intensity edge guidance

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition

Approach for Pseudo-random Bit-Stream Multi-Depth Imaging

Computational Spectral-Depth Imaging with a Compact System.

On the use of deep learning for single-pixel imaging

Single photon imaging based on a photon driven sparse sampling

Simulating single-photon detector array sensors for depth imaging

Single-photon 3D imaging with deep sensor fusion

Single-Photon Depth Imaging Using a Union-of-Subspaces Model