Abstract:Non-line-of-sight (NLOS) imaging enables an imaging system to look around corners, which has drawn much attention in recent years. With the confocal setup employing the raster scanning of overlapped illumination and detection points on the relay wall, NLOS imaging has well-established image reconstruction algorithms. In order to elevate the detection efficiency, the single-photon-avalanche-diode (SPAD) array is actively developed and has become a well acknowledged way to improve the practicability of NLOS imaging. However, applying SPAD array naturally leads to the non-confocal configuration (illumination and detection points not overlapped) and lacks efficient image retrieving algorithms, which remains a serious problem in NLOS imaging. In this work, non-confocal measurements obtained by point illumination and SPAD-array detection are successfully transformed to semi-confocal measurements using the proposed approach based on sectionalized ellipsoid interpolation (SEI), in which the NLOS object is represented as multiple ellipsoid sections corresponding to the non-confocal histogram. By investigating the fact that the ellipsoid section can be refinedly sliced and each slice directly maps to each time-bin in the new confocal histogram, the timing resolution for the emulated confocal measurements can be improved even beyond that for the detector itself. Simulations and experiments have been conducted and testified the advantage of the proposed SEI-based approach over the existing filtered backprojection (FBP) and normal-moveout-correction-based (NMO-based) approaches. Bar-shaped objects (used for resolution estimation) with the interval of 65.6 mm in simulation and 100 mm in experiments, which are not resolved by FBP and NMO-based approaches, can be distinguished by the SEI-based approach with the image contrast of 0.094 and 0.228, respectively. For a large E-shape object with the horizontal size of 1.18 m in simulation, the reconstruction nonuniformity is reduced to 0.169 by the SEI-based approach with respect to 0.271 with the NMO-based approach. Confocal measurements emulation using SEI successfully connects the challenging non-confocal NLOS problem to the well-established confocal NLOS reconstruction algorithms with high performances, which is especially meaningful to NLOS imaging using SPAD array with bad timing resolution and contributes to the practical applications of NLOS imaging.

Active mode single-pixel non-line-of-sight imaging system based on second-order correlation and diffraction

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Dynamic Non-Line-of-sight Imaging System Based on the Optimization of Point Spread Functions.

Non-line-of-sight Imaging with Arbitrary Illumination and Detection Pattern

Multi-Modal Non-Line-of-Sight Passive Imaging

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Non-Line-of-Sight Imaging with Signal Superresolution Network

Non-line-of-sight reconstruction via structure sparsity regularization

None-line-of-sight imaging enhanced with spatial multiplexing

High-resolution non-confocal non-line-of-sight imaging based on spherical-slice transform from spatial and temporal frequency to space and time

Real-time Non-Line-of-sight Computational Imaging Using Spectrum Filtering and Motion Compensation

High-resolution non-line-of-sight imaging based on liquid crystal planar optical elements

Long-Range Non-Line-of-Sight Imaging Based on Projected Images from Multiple Light Fields

An Efficient Way for Active None-Line-of-Sight: End-to-End Learned Compressed NLOS Imaging.

Fast Non-Line-of-Sight Imaging With Hybrid Super-Resolution Network Over 18 m

Passive Non-line-of-sight Imaging for Moving Targets with an Event Camera

Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second

Converting non-confocal measurements into semi-confocal ones with timing-accuracy improving for non-line-of-sight imaging

Real-time Scan-Free Non-Line-of-sight Imaging

Photon-Efficient Non-Line-of-Sight Imaging

Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imaging