Abstract:Emerging universal Computational Aberration Correction (CAC) paradigms provide an inspiring solution to light-weight and high-quality imaging without repeated data preparation and model training to accommodate new lens designs. However, the training databases in these approaches, i.e., the lens libraries (LensLibs), suffer from their limited coverage of real-world aberration behaviors. In this work, we set up an OmniLens framework for universal CAC, considering both the generalization ability and flexibility. OmniLens extends the idea of universal CAC to a broader concept, where a base model is trained for three cases, including zero-shot CAC with the pre-trained model, few-shot CAC with a little lens-specific data for fine-tuning, and domain adaptive CAC using domain adaptation for lens-descriptions-unknown lens. In terms of OmniLens's data foundation, we first propose an Evolution-based Automatic Optical Design (EAOD) pipeline to construct LensLib automatically, coined AODLib, whose diversity is enriched by an evolution framework, with comprehensive constraints and a hybrid optimization strategy for achieving realistic aberration behaviors. For network design, we introduce the guidance of high-quality codebook priors to facilitate zero-shot CAC and few-shot CAC, which enhances the model's generalization ability, while also boosting its convergence in a few-shot case. Furthermore, based on the statistical observation of dark channel priors in optical degradation, we design an unsupervised regularization term to adapt the base model to the target descriptions-unknown lens using its aberration images without ground truth. We validate OmniLens on 4 manually designed low-end lenses with various structures and aberration behaviors. Remarkably, the base model trained on AODLib exhibits strong generalization capabilities, achieving 97 performance in a zero-shot setting.

Achromatic imaging systems with flat lenses enabled by deep learning

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Deep Learning Enhanced Achromatic Imaging with a Singlet Flat Lens.

A Flexible Framework for Universal Computational Aberration Correction Via Automatic Lens Library Generation and Domain Adaptation

All-day Thin-Lens Computational Imaging with Scene-Specific Learning Recovery

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Learned Digital Lens Enabled Single Optics Achromatic Imaging

Imaging from the Visible to the Longwave Infrared wavelengths via an inverse-designed flat lens

High-fidelity achromatic metalens imaging via deep neural network

Hybrid Achromatic Microlenses with High Numerical Apertures and Focusing Efficiencies Across the Visible

Inverse-designed flat lens for imaging in the visible & near-infrared with diameter > 3mm and NA=0.3

Configurable Multiple Virtual Lenses Conjugated with Singlet Physical Lens for Achromatic Extended Depth-of-Field Imaging

Computational imaging through chromatic aberration corrected simple lenses

Thin On-Sensor Nanophotonic Array Cameras

Broadband achromatic metalenses for imaging (Conference Presentation)

Chromatically Multi-Focal Optics Based on Micro-Lens Array Design.

Large-scale achromatic flat lens by light frequency-domain coherence optimization

Large-scale achromatic flat lens by light coherence optimization

Beating bandwidth limits for large aperture broadband nano-optics

Full‐Color Metaoptical Imaging in Visible Light

Deep-learning-driven end-to-end metalens imaging