Abstract:Emerging universal Computational Aberration Correction (CAC) paradigms provide an inspiring solution to light-weight and high-quality imaging without repeated data preparation and model training to accommodate new lens designs. However, the training databases in these approaches, i.e., the lens libraries (LensLibs), suffer from their limited coverage of real-world aberration behaviors. In this work, we set up an OmniLens framework for universal CAC, considering both the generalization ability and flexibility. OmniLens extends the idea of universal CAC to a broader concept, where a base model is trained for three cases, including zero-shot CAC with the pre-trained model, few-shot CAC with a little lens-specific data for fine-tuning, and domain adaptive CAC using domain adaptation for lens-descriptions-unknown lens. In terms of OmniLens's data foundation, we first propose an Evolution-based Automatic Optical Design (EAOD) pipeline to construct LensLib automatically, coined AODLib, whose diversity is enriched by an evolution framework, with comprehensive constraints and a hybrid optimization strategy for achieving realistic aberration behaviors. For network design, we introduce the guidance of high-quality codebook priors to facilitate zero-shot CAC and few-shot CAC, which enhances the model's generalization ability, while also boosting its convergence in a few-shot case. Furthermore, based on the statistical observation of dark channel priors in optical degradation, we design an unsupervised regularization term to adapt the base model to the target descriptions-unknown lens using its aberration images without ground truth. We validate OmniLens on 4 manually designed low-end lenses with various structures and aberration behaviors. Remarkably, the base model trained on AODLib exhibits strong generalization capabilities, achieving 97 performance in a zero-shot setting.

Universal and Flexible Optical Aberration Correction Using Deep-Prior Based Deconvolution

Extreme-Quality Computational Imaging via Degradation Framework

A Flexible Framework for Universal Computational Aberration Correction Via Automatic Lens Library Generation and Domain Adaptation

Elimination of Varying Chromatic Aberrations Based on Diffractive Optics

Image Enhancement For Fluorescence Microscopy Based On Deep Learning With Prior Knowledge Of Aberration

A Physics-informed Low-rank Deep Neural Network for Blind and Universal Lens Aberration Correction

Correcting Optical Aberration via Depth-Aware Point Spread Functions

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Non-blind optical degradation correction via frequency self-adaptive and finetune tactics

Joint Chromatic Aberration Correction and Color Fringe Removal for Variable Aperture Optical System

Machine learning guided rapid focusing with sensor-less aberration corrections.

Deep-learning-based CASSI Reconstruction with Optical Aberration Correction

Aberration Correction Method For Fourier Ptychographic Microscopy Based On Neural Network

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Calibration-free Deep Optics for Depth Estimation with Precise Simulation

Chromatic Aberration Correction Based on Cross-Channel Information Alignment in Microscopy

Blind Optical Aberration Correction By Exploring Geometric And Visual Priors

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

Neural Invertible Variable-degree Optical Aberrations Correction

Optical Aberration Correction in Postprocessing using Imaging Simulation

Optical Aberrations Correction in Postprocessing Using Imaging Simulation