Abstract:Large DOF (depth-of-field) with high SNR (signal-noise-ratio) imaging is a crucial technique for applications from security monitoring to medical diagnostics. However, traditional optical design for large DOF requires a reduction in aperture size, and hence with a decrease in light throughput and SNR. In this paper, we report a computational imaging system integrating dual-aperture optics with a physics-informed dual-encoder neural network to realize prominent DOF extension. Boosted by human vision mechanism and optical imaging law, the dual-aperture imaging system is consisted of a small-aperture NIR camera to provide sharp edge and a large-aperture VIS camera to provide faithful color. To solve the imaging inverse problem in NIR-VIS fusion with different apertures, a specific network with parallel double encoders and the multi-scale fusion module is proposed to adaptively extract and learn the useful features, which contributes to preventing color deviation while preserving delicate scene textures. The proposed imaging framework is flexible and can be designed in different protos with varied optical elements for different applications. We provide theory for system design, demonstrate a prototype device, establish a real-scene dataset containing 3000 images, perform elaborate ablation studies and conduct peer comparative experiments. The experimental results demonstrate that our method effectively produces high-fidelity with larger DOF range than input raw images about 3 times. Without complex optical design and strict practical limitations, this novel, intelligent and integratable system is promising for variable vision applications such as smartphone photography, computational measurement, and medical imaging.

Enhancement of Depth-of-field in a Direct Projection-Type Integral Imaging System by a Negative Lens Array.

Multi-image-distance Imaging System for Extending Depth-of-field

A Method for Extending Depth of Focus in STED Nanolithography

Formation of Sub-Half-Wavelength Focal Spot with Ultra Long Depth of Focus

Enhancement of Field Depth for Projection-Type Integral Imaging Three-Dimensional Display Based on Small Diverging Angle

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Extended Depth of Field Reconstruction with Complex Field Estimation

Integral Imaging Display with Enhanced Depth of Field Based on Bifocal Lens Array

An Extended Depth-Of-Field Imaging System With A Non-Rotationally Symmetric Phase Mask

Design and Implementation of a Large Depth-of-field and Large Aperture Optical System

Enhanced Depth of Field of Integral Imaging Display Using Bifocal Microlens Array Fabricated by Two‐step Lithography

Extended Depth-of-field in Integral-Imaging Pickup Process Based on Amplitude-Modulated Sensor Arrays

Analysis of the Depth of Field of Integral Imaging Displays Based on Wave Optics

Integral Imaging 3D Display System with Improved Depth of Field Using a Colloidal Scattering Layer

Depth-Enhanced Integral Imaging System Based on Spatial Filtering

Large Depth-of-field Computational Imaging with Multi-Spectral and Dual-Aperture Optics.

Depth-enhanced Integral Imaging System with Convex and Composite Concave Micro-Lens Arrays

Fabrication of a Micro-Lens Array for Improving Depth-of-field of Integral Imaging 3D Display.

Depth of Field Expansion Method for Integral Imaging Based on Diffractive Optical Element and CNN.

Dual-mode optical see-through integral imaging 3D display with large depth of field

Depth of Field and Resolution-Enhanced Integral Imaging Display System.