Abstract:In recent years, optical imaging techniques have entered into the era of computational optical imaging from the traditional intensity and color imaging. Computational optical imaging, which is based on geometric optics, wave optics, and other theoretical foundations, establishes an accurate forward mathematical model for the whole image formation process of the scene imaged through the optical system and then sampled by the digital detector. Then, the high-quality reconstruction of the image and other high dimensional information, such as phase, spectrum, polarization, light field, coherence, refractive index, and three-dimension profile, which cannot be directly accessed using traditional methods, can be obtained through computational reconstruction method. However, the actual imaging performance of the computational imaging system is also limited by the "accuracy of the forward mathematical model" and "the reliability of inverse reconstruction algorithm ". Besides, the unpredictability of real physical imaging process and the complexity of solving high dimensional ill-posed inverse problems have become the bottleneck of further development of this field. In recent years, the rapid development of artificial intelligence and deep learning for the technology opens a new door for computational optical imaging technology. Unlike " physical driven" model that traditional computational imaging method is based on, computational imaging based on deep learning is a kind of "data-driven" method, which not only solves many problems considered quite challenge to be solved in this field, but also achieves remarkable improvement in information acquisition ability, imaging functions, and key performance indexes of imaging system, such as spatial resolution, temporal resolution, and detection sensitivity. This review first briefly introduces the current status and the latest progress of deep learning technology in the field of computational optical imaging. Then, the main problems and challenges faced by the current deep learning method in computational optical imaging field arc discussed. Finally, the future developments and possible research directions of this field arc prospected.

Research Progress in the Applications of Convolutional Neural Networks in Optical Information Processing

Advances in Convolutional Neural Networks

Optical Convolution Based Computational Method for Low-Power Image Processing

Research progress in optical neural networks: theory, applications and developments

Deep Learning Algorithm and Its Application in Optics

Optical-electronic Hybrid Fourier Convolutional Neural Network Based on Super-Pixel Complex-Valued Modulation

Optical Convolutional Neural Network Based on an Amplitude Modulation Spatial Light Modulator and a 4-Level Phase Plate

Deep Learning Based Computational Imaging: Status, Challenges, and Future

Research on the Visual Image Processing Based on Neural Network

Recent Advances in Convolutional Neural Networks

11 Tera-OPs/s Photonic Convolutional Accelerator and Deep Optical Neural Network Based on an Integrated Kerr Soliton Crystal Microcomb

Convolutional Neural Networks in Image Understanding

11 TeraFLOPs per second photonic convolutional accelerator for deep learning optical neural networks

Application of Deep Learning in Digital Holographic Microscopy

Photonic Neural Networks and Its Applications

The eye of artificial intelligence - Convolutional Neural Networks

OP-FCNN: an Optronic Fully Convolutional Neural Network for Imaging Through Scattering Media.

Optical Convolutional Neural Networks -- Combining Silicon Photonics and Fourier Optics for Computer Vision

11 TOPS photonic convolutional accelerator for optical neural networks

CNN advancements and its applications in image recognition: A comprehensive analysis and future prospects

Advances and Progress of Diffractive Deep Neural Networks