Abstract:In recent years, optical imaging techniques have entered into the era of computational optical imaging from the traditional intensity and color imaging. Computational optical imaging, which is based on geometric optics, wave optics, and other theoretical foundations, establishes an accurate forward mathematical model for the whole image formation process of the scene imaged through the optical system and then sampled by the digital detector. Then, the high-quality reconstruction of the image and other high dimensional information, such as phase, spectrum, polarization, light field, coherence, refractive index, and three-dimension profile, which cannot be directly accessed using traditional methods, can be obtained through computational reconstruction method. However, the actual imaging performance of the computational imaging system is also limited by the "accuracy of the forward mathematical model" and "the reliability of inverse reconstruction algorithm ". Besides, the unpredictability of real physical imaging process and the complexity of solving high dimensional ill-posed inverse problems have become the bottleneck of further development of this field. In recent years, the rapid development of artificial intelligence and deep learning for the technology opens a new door for computational optical imaging technology. Unlike " physical driven" model that traditional computational imaging method is based on, computational imaging based on deep learning is a kind of "data-driven" method, which not only solves many problems considered quite challenge to be solved in this field, but also achieves remarkable improvement in information acquisition ability, imaging functions, and key performance indexes of imaging system, such as spatial resolution, temporal resolution, and detection sensitivity. This review first briefly introduces the current status and the latest progress of deep learning technology in the field of computational optical imaging. Then, the main problems and challenges faced by the current deep learning method in computational optical imaging field arc discussed. Finally, the future developments and possible research directions of this field arc prospected.

Single-pixel imaging based on deep learning

Spectral Imaging with Deep Learning.

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition

Deep-learning-based Single-Photon-counting Compressive Imaging Via Jointly Trained Subpixel Convolution Sampling.

Super-coding resolution single-pixel imaging based on unpaired data-driven deep learning

Deep learning for real-time single-pixel video

Deep Learning Optimized Terahertz Single-Pixel Imaging

Feature Single-Pixel Imaging: What You See is What You Want

Deep Learning Based Computational Imaging: Status, Challenges, and Future

Photon-limited face image super-resolution based on deep learning.

Generative adversarial network based single pixel imaging

High-resolution single-photon imaging with physics-informed deep learning

Deep-learning Enables Single-Pixel Spectral Imaging

Improved Single Pixel Camera via Fiber Collecting Strategy

Single Image Super Resolution Reconstruction Algorithm Based on Deep Learning

Deep Learning Based Single-Photon 3D Imaging with Multiple Returns

A Survey on Applications of Deep Learning in Microscopy Image Analysis

Single-pixel imaging 12 years on: a review.

Advances in Deep Learning for Super-Resolution Microscopy(Invited)

Anti-noise computational imaging using unsupervised deep learning

Deep Learning‐Based Single‐Cell Optical Image Studies