Abstract:Computational imaging enables optical imaging systems to acquire more information with miniaturized setups. Computational imaging can avoid the object-image conjugate limitation of the imaging system, and introduce encoding and decoding processes based on physical optics to achieve more efficient information transmission. It can simultaneously increase the amount of information and reduce the complexity of the system, thereby paving the way for miniaturizing imaging systems. Based on computational imaging, the simple and compact optical imaging techniques are developed, which is also called simple optics. To develop miniaturized optical imaging elements and integrated systems, simple optics utilizes the joint design of optical system and image processing algorithms, thereby realizing high-quality imaging that is comparable to complex optical systems. The imaging systems are of small-size, low-weight, and low-power consumption. With the development of micro-nano manufacturing, the optical elements have evolved from a single lens or a few lenses, to flat/planar optical elements, such as diffractive optical elements and metasurface optical elements. As a result, various lensless and metalens imaging systems have emerged. Owing to the introduction of encoding process and decoding process, an optical imaging model is developed to represent the relationship between the target object and the acquired signal, from which the computational reconstruction is used to restore the image. In the image restoration part, the algorithms are discussed in three categories, i.e. the classic algorithm, the model-based optimization iterative algorithm, and the deep learning (neural network) algorithm. Besides, the end-to-end optimization is highlighted because it introduces a new frame to minimize the complexity of optical system. In this review, the imaging techniques realized by simple optics are also discussed, such as depth imaging, high-resolution and super-resolution imaging, large field of view imaging, and extended depth of field imaging, as well as their important roles in developing consumer electronics, unmanned driving, machine vision, security monitoring, biomedical devices and metaverse. Last but not least, the challenges and future developments are prospected.

Simplified design method for optical imaging systems based on deep learning

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Investigating deep optics model representation in affecting resolved all-in-focus image quality and depth estimation fidelity

Simplified design method for optical imaging systems based on aberration characteristics of optical-digital joint optimization

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

Automated design of freeform imaging systems

Curriculum Learning for ab initio Deep Learned Refractive Optics

Automated Design of Machine Vision Lens Based on the Combination of Particle Swarm Optimization and Damped Least Squares

Aberration Analysis for the Computing Optical Design Method

Deep learning for the design of photonic structures

Deep Learning for Polarization Optical System Automated Design

A simulation imaging method for actual optical system and results analysis

Deep learning in optics and photonics for statistical inference, computing, and inverse design

Towards Automatic Freeform Optics Design: Coarse and Fine Search of the Three-Mirror Solution Space

End-to-end learned single lens design using fast differentiable ray tracing

Research Advances in Simple and Compact Optical Imaging Techniques

Large depth-of-field ultra-compact microscope by progressive optimization and deep learning

Deep Learning for Photonic Design and Analysis: Principles and Applications

Design of compact off-axis freeform imaging systems based on optical-digital joint optimization

Deep Learning Based Computational Imaging: Status, Challenges, and Future