Abstract:As the popularity of mobile photography continues to grow, considerable effort is being invested in the reconstruction of degraded images. Due to the spatial variation in optical aberrations, which cannot be avoided during the lens design process, recent commercial cameras have shifted some of these correction tasks from optical design to postprocessing systems. However, without engaging with the optical parameters, these systems only achieve limited correction for <a class="link-external link-http" href="http://aberrations.In" rel="external noopener nofollow">this http URL</a> this work, we propose a practical method for recovering the degradation caused by optical aberrations. Specifically, we establish an imaging simulation system based on our proposed optical point spread function model. Given the optical parameters of the camera, it generates the imaging results of these specific devices. To perform the restoration, we design a spatial-adaptive network model on synthetic data pairs generated by the imaging simulation system, eliminating the overhead of capturing training data by a large amount of shooting and registration. Moreover, we comprehensively evaluate the proposed method in simulations and experimentally with a customized digital-single-lens-reflex (DSLR) camera lens and HUAWEI HONOR 20, respectively. The experiments demonstrate that our solution successfully removes spatially variant blur and color dispersion. When compared with the state-of-the-art deblur methods, the proposed approach achieves better results with a lower computational overhead. Moreover, the reconstruction technique does not introduce artificial texture and is convenient to transfer to current commercial cameras. Project Page: \url{<a class="link-external link-https" href="https://github.com/TanGeeGo/ImagingSimulation" rel="external noopener nofollow">this https URL</a>}.

Backward-link Computational Imaging Using Batch Learning Networks

The Realization Of Parallel Subtraction Using Lclv In Optical Neural Network

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Machine learning guided rapid focusing with sensor-less aberration corrections.

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Forward Imaging Neural Network with Correction of Positional Misalignment for Fourier Ptychographic Microscopy.

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Adaptive Optics For Structured Illumination Microscopy Based On Deep Learning

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

A Physics-informed Low-rank Deep Neural Network for Blind and Universal Lens Aberration Correction

Computational Diffraction-Limited Imaging with a Non-Imaging Spatial Information Transfer Lens

Neural Invertible Variable-degree Optical Aberrations Correction

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

Dynamic-excitation-based Steady-State Non-Line-of-sight Imaging Via Multi-Branch Convolutional Neural Network

Optical Aberration Correction in Postprocessing using Imaging Simulation

Inverting the Imaging Process by Learning an Implicit Camera Model

Learning-based lens wavefront aberration recovery

Lensless cameras using a mask based on almost perfect sequence through deep learning

Optical Aberrations Correction in Postprocessing Using Imaging Simulation

Optical Aberration Correction via Phase Diversity and Deep Learning

Dnn-Fza Camera: A Deep Learning Approach Toward Broadband Fza Lensless Imaging