Abstract:Scattering of light in complex media scrambles optical wavefronts and breaks the principles of conventional imaging methods. For decades, researchers have endeavored to conquer the problem by inventing approaches such as adaptive optics, iterative wavefront shaping, and transmission matrix measurement. That said, imaging through/into thick scattering media remains challenging to date. With the rapid development of computing power, deep learning has been introduced and shown potentials to reconstruct target information through complex media or from rough surfaces. But it also fails once coming to optically thick media where ballistic photons become negligible. Here, instead of treating deep learning only as an image extraction method, whose best-selling advantage is to avoid complicate physical models, we exploit it as a tool to explore the underlying physical principles. By adjusting the weights of ballistic and scattered photons through a random phasemask, it is found that although deep learning can extract images from both scattered and ballistic light, the mechanisms are different: scattering may function as an encryption key and decryption from scattered light is key sensitive, while extraction from ballistic light is stable. Based on this finding, it is hypothesized and experimentally confirmed that the foundation of the generalization capability of trained neural networks for different diffusers can trace back to the contribution of ballistic photons, even though their weights of photon counting in detection are not that significant. Moreover, the study may pave an avenue for using deep learning as a probe in exploring the unknown physical principles in various fields.

Photon Limited Imaging Through Disordered Media: Information Extraction by Exploiting the Photon’s Quantum Nature Via Deep Learning

Photon-limited imaging through scattering medium based on deep learning

Fast Correlated-Photon Imaging Enhanced By Deep Learning

Photon-limited face image super-resolution based on deep learning.

Scanning-based Photon-Limited Imaging Through Scattering Media

Photon-Efficient 3D Imaging with A Non-local Neural Network

Roles of scattered and ballistic photons in imaging through scattering media: a deep learning-based study

Surpassing the Standard Quantum Limit of Optical Imaging Via Deep Learning

Photon-limited Single-Pixel Imaging

Photon-limited Imaging Through Scattering Medium Based on Speckle Coding

Photon-Limited Image Recovery with Fourier Convolution Network

Scalable Non-Invasive Imaging Through Dynamic Scattering Media at Low Photon Flux

Boosting Photon-Efficient Image Reconstruction With A Unified Deep Neural Network

Photon discerner: Adaptive quantum optical sensing near the shot noise limit

Imaging through unknown scattering media based on physics-informed learning

First Photon Machine Learning

Dynamic single-photon 3D imaging with a sparsity-based neural network

Deep Learning Enhanced Quantum Holography with Undetected Photons

Photon-Efficient Computational 3D and Reflectivity Imaging with Single-Photon Detectors

Robust photon-efficient imaging using a pixel-wise residual shrinkage network

Single-pixel imaging based on deep learning