Abstract:Non-line-of-sight (NLOS) imaging enables an imaging system to look around corners, which has drawn much attention in recent years. With the confocal setup employing the raster scanning of overlapped illumination and detection points on the relay wall, NLOS imaging has well-established image reconstruction algorithms. In order to elevate the detection efficiency, the single-photon-avalanche-diode (SPAD) array is actively developed and has become a well acknowledged way to improve the practicability of NLOS imaging. However, applying SPAD array naturally leads to the non-confocal configuration (illumination and detection points not overlapped) and lacks efficient image retrieving algorithms, which remains a serious problem in NLOS imaging. In this work, non-confocal measurements obtained by point illumination and SPAD-array detection are successfully transformed to semi-confocal measurements using the proposed approach based on sectionalized ellipsoid interpolation (SEI), in which the NLOS object is represented as multiple ellipsoid sections corresponding to the non-confocal histogram. By investigating the fact that the ellipsoid section can be refinedly sliced and each slice directly maps to each time-bin in the new confocal histogram, the timing resolution for the emulated confocal measurements can be improved even beyond that for the detector itself. Simulations and experiments have been conducted and testified the advantage of the proposed SEI-based approach over the existing filtered backprojection (FBP) and normal-moveout-correction-based (NMO-based) approaches. Bar-shaped objects (used for resolution estimation) with the interval of 65.6 mm in simulation and 100 mm in experiments, which are not resolved by FBP and NMO-based approaches, can be distinguished by the SEI-based approach with the image contrast of 0.094 and 0.228, respectively. For a large E-shape object with the horizontal size of 1.18 m in simulation, the reconstruction nonuniformity is reduced to 0.169 by the SEI-based approach with respect to 0.271 with the NMO-based approach. Confocal measurements emulation using SEI successfully connects the challenging non-confocal NLOS problem to the well-established confocal NLOS reconstruction algorithms with high performances, which is especially meaningful to NLOS imaging using SPAD array with bad timing resolution and contributes to the practical applications of NLOS imaging.

Non-line-of-sight imaging based on Archimedean spiral scanning

Real-time Scan-Free Non-Line-of-sight Imaging

Deep Non-line-of-sight Imaging from Under-scanning Measurements.

High-resolution non-line-of-sight imaging based on liquid crystal planar optical elements

Compressed Sensing for Active Non-Line-of-sight Imaging.

Single-shot Non-Line-of-sight Imaging Based on Chromato-Axial Differential Correlography

Non-Line-of-Sight Imaging with Signal Superresolution Network

Non-line-of-sight Imaging with Arbitrary Illumination and Detection Pattern

Dynamic Non-Line-of-sight Imaging System Based on the Optimization of Point Spread Functions.

Fast Non-Line-of-Sight Imaging With Hybrid Super-Resolution Network Over 18 m

High-resolution non-confocal non-line-of-sight imaging based on spherical-slice transform from spatial and temporal frequency to space and time

Converting non-confocal measurements into semi-confocal ones with timing-accuracy improving for non-line-of-sight imaging

Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Few-shot Non-line-of-sight Imaging with Signal-surface Collaborative Regularization

Non–line-of-sight imaging over 1.43 km

Recent Progress of Non-Line-of-sight Imaging Reconstruction Algorithms in Typical Imaging Modalities

High-resolution non-line-of-sight imaging employing active focusing

Long-Range Non-Line-of-Sight Imaging Based on Projected Images from Multiple Light Fields

Non-line-of-sight snapshots and background mapping with an active corner camera

Research Advances on Non-Line-of-Sight Imaging Technology