Abstract:Passive Non-Line-of-Sight (NLOS) imaging requires to reconstruct objects which cannot be seen in line without using external controllable light sources. It can be widely applied in areas like counter-terrorism, urban-Warfare, autonomous-driving and robot-vision. Existing methods for passive NLOS typically required extensive prior information and significant computational resources to establish light transport matrices or train neural networks. These constraints pose significant challenges for transitioning models to different NLOS scenarios. Thus, the pressing issue in passive NLOS imaging currently lies in whether it is possible to estimate the light transport matrices which corresponding to relay surfaces and scenes, as well as the specific distribution of targets, with a small amount of prior knowledge. In this work, we hypothesized a high-dimensional manifold and mathematically proved its existence. Within this high-dimensional manifold, the structural information of obscured targets is minimally disrupted. Therefore, we proposed a universal framework named High-Dimensional Projection Selection (HDPS) which can establish this high-dimensional manifold and output its projection onto corresponding surfaces on low-dimensional. HDPS can be applied to most mature network architectures and estimate the distribution of target and light spot obtained by camera with only minimal prior data. Certainly, with the help of the estimated information, it can establish a high-dimensional manifold consisting of target and input. As demonstrated in experiment, our framework, even when applied to the most basic network structures, can achieve higher accuracy results with significantly smaller amounts of prior data. Thereby, our approach enables passive NLOS scenarios to reconstruct target by limited prior data and computational resources.

Long-Range Non-Line-of-Sight Imaging Based on Projected Images from Multiple Light Fields

Non–line-of-sight imaging over 1.43 km

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Non-line-of-sight Imaging with Radio Signals.

Physics to the Rescue: Deep Non-line-of-sight Reconstruction for High-speed Imaging

Deep Non-line-of-sight Imaging from Under-scanning Measurements.

Towards Non-Line-of-Sight Photography

Recent Advances on Non-Line-of-Sight Imaging: Conventional Physical Models, Deep Learning, and New Scenes

45.2: High‐performance Non‐Line‐of‐Sight imaging based on deep learning

Non-Line-of-Sight Imaging with Signal Superresolution Network

Fast Non-Line-of-Sight Imaging With Hybrid Super-Resolution Network Over 18 m

Passive None-line-of-sight imaging with arbitrary scene condition and detection pattern in small amount of prior data

Non-line-of-sight Imaging with Arbitrary Illumination and Detection Pattern

Non-line-of-sight SAR imaging by multi-scattering of millimeter-wave

Computational framework for steady-state NLOS localization under changing ambient illumination conditions

High-resolution non-line-of-sight imaging based on liquid crystal planar optical elements

High-resolution non-line-of-sight imaging employing active focusing

Real-time Non-Line-of-sight Computational Imaging Using Spectrum Filtering and Motion Compensation

Speckle-correlation-based Non-Line-of-sight Imaging under White-Light Illumination

Deep-Learning-Based Real-Time Passive Non-Line-of-Sight Imaging for Room-Scale Scenes

Generalizable Non-Line-of-Sight Imaging with Learnable Physical Priors