Abstract:Non-line-of-sight (NLOS) imaging enables an imaging system to look around corners, which has drawn much attention in recent years. With the confocal setup employing the raster scanning of overlapped illumination and detection points on the relay wall, NLOS imaging has well-established image reconstruction algorithms. In order to elevate the detection efficiency, the single-photon-avalanche-diode (SPAD) array is actively developed and has become a well acknowledged way to improve the practicability of NLOS imaging. However, applying SPAD array naturally leads to the non-confocal configuration (illumination and detection points not overlapped) and lacks efficient image retrieving algorithms, which remains a serious problem in NLOS imaging. In this work, non-confocal measurements obtained by point illumination and SPAD-array detection are successfully transformed to semi-confocal measurements using the proposed approach based on sectionalized ellipsoid interpolation (SEI), in which the NLOS object is represented as multiple ellipsoid sections corresponding to the non-confocal histogram. By investigating the fact that the ellipsoid section can be refinedly sliced and each slice directly maps to each time-bin in the new confocal histogram, the timing resolution for the emulated confocal measurements can be improved even beyond that for the detector itself. Simulations and experiments have been conducted and testified the advantage of the proposed SEI-based approach over the existing filtered backprojection (FBP) and normal-moveout-correction-based (NMO-based) approaches. Bar-shaped objects (used for resolution estimation) with the interval of 65.6 mm in simulation and 100 mm in experiments, which are not resolved by FBP and NMO-based approaches, can be distinguished by the SEI-based approach with the image contrast of 0.094 and 0.228, respectively. For a large E-shape object with the horizontal size of 1.18 m in simulation, the reconstruction nonuniformity is reduced to 0.169 by the SEI-based approach with respect to 0.271 with the NMO-based approach. Confocal measurements emulation using SEI successfully connects the challenging non-confocal NLOS problem to the well-established confocal NLOS reconstruction algorithms with high performances, which is especially meaningful to NLOS imaging using SPAD array with bad timing resolution and contributes to the practical applications of NLOS imaging.

Enhancing the spatial resolution of time-of-flight based non-line-of-sight imaging via instrument response function deconvolution

Enhancing Ultrasonic Time-of-flight Diffraction Measurement Through an Adaptive Deconvolution Method

High-resolution non-line-of-sight imaging employing active focusing

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

High-resolution non-confocal non-line-of-sight imaging based on spherical-slice transform from spatial and temporal frequency to space and time

Fast Non-Line-of-Sight Imaging With Hybrid Super-Resolution Network Over 18 m

Non-Line-of-Sight Imaging with Signal Superresolution Network

High-resolution non-line-of-sight imaging based on liquid crystal planar optical elements

Non-line-of-sight transient imaging via using time-of-flight camera

Real-time Scan-Free Non-Line-of-sight Imaging

Dynamic Non-Line-of-sight Imaging System Based on the Optimization of Point Spread Functions.

Non–line-of-sight imaging over 1.43 km

Fast non-line-of-sight imaging based on first photon event stamping

Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Converting non-confocal measurements into semi-confocal ones with timing-accuracy improving for non-line-of-sight imaging

Non-line-of-sight Imaging with Arbitrary Illumination and Detection Pattern

Non-Line-of-Sight Imaging and Vibrometry Using a Comb-Calibrated Coherent Sensor

Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes

Non-Line-of-Sight Imaging with Picosecond Temporal Resolution

Research Advances on Non-Line-of-Sight Imaging Technology