Abstract:Controllable Depth-of-Field (DoF) imaging commonly produces amazing visual effects based on heavy and expensive high-end lenses. However, confronted with the increasing demand for mobile scenarios, it is desirable to achieve a lightweight solution with Minimalist Optical Systems (MOS). This work centers around two major limitations of MOS, i.e., the severe optical aberrations and uncontrollable DoF, for achieving single-lens controllable DoF imaging via computational methods. A Depth-aware Controllable DoF Imaging (DCDI) framework is proposed equipped with All-in-Focus (AiF) aberration correction and monocular depth estimation, where the recovered image and corresponding depth map are utilized to produce imaging results under diverse DoFs of any high-end lens via patch-wise convolution. To address the depth-varying optical degradation, we introduce a Depth-aware Degradation-adaptive Training (DA2T) scheme. At the dataset level, a Depth-aware Aberration MOS (DAMOS) dataset is established based on the simulation of Point Spread Functions (PSFs) under different object distances. Additionally, we design two plug-and-play depth-aware mechanisms to embed depth information into the aberration image recovery for better tackling depth-aware degradation. Furthermore, we propose a storage-efficient Omni-Lens-Field model to represent the 4D PSF library of various lenses. With the predicted depth map, recovered image, and depth-aware PSF map inferred by Omni-Lens-Field, single-lens controllable DoF imaging is achieved. Comprehensive experimental results demonstrate that the proposed framework enhances the recovery performance, and attains impressive single-lens controllable DoF imaging results, providing a seminal baseline for this field. The source code and the established dataset will be publicly available at <a class="link-external link-https" href="https://github.com/XiaolongQian/DCDI" rel="external noopener nofollow">this https URL</a>.

Multi-image-distance Imaging System for Extending Depth-of-field

Joint Focusing Method Based on Optimal Image-Distance Interval for Multi-Image-distance Imaging System

Extended Depth of Field Reconstruction with Complex Field Estimation

Large Depth-of-field Computational Imaging with Multi-Spectral and Dual-Aperture Optics.

Research progress of depth detection in vision measurement: A novel project of bifocal imaging system for 3D measurement

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

An Extended Depth-Of-Field Imaging System With A Non-Rotationally Symmetric Phase Mask

Depth of Field Extension for Microscopic Structured Light Vision System Based on Image Fusion

DLP-Fusion: Depth of Field, Light Source, and Polarization Fusion Towards Intelligent Optical Imaging for Complex Scenes

Depth of Field Extension and Objective Space Depth Measurement Based on Wavefront Imaging.

Extended Depth of Field Method with a Designed Diffraction Optical Element Based on Multi-Depth Fusion and End-to-end Optimization

Extending Depth of Field for Varifocal Multiview Images

Extended Depth of Field Integral Imaging Using Multi-Focus Fusion

Extended Depth-of-field in Integral-Imaging Pickup Process Based on Amplitude-Modulated Sensor Arrays

Depth-of-field Extension in Integral Imaging Using Multi-Focus Elemental Images.

Extending the depth of field of imaging systems using depth sensing camera

Extended Depth-Resolved Imaging Through a Thin Scattering Medium with PSF Manipulation

Large-depth-range 3D Measurement Based on Optimized Multi-Focal Projection System

Towards Single-Lens Controllable Depth-of-Field Imaging via All-in-Focus Aberration Correction and Monocular Depth Estimation

Depth-of-Field-Extended Plenoptic Camera Based on Tunable Multi-Focus Liquid-Crystal Microlens Array

Depth Of Field Extension In Laser Speckle Contrast Imaging