Abstract:Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical degradation. In this work, we systematically construct the perturbed lens system model to illustrate the relationship between the deviated system parameters and the spatial frequency response (SFR) measured from photographs. To further address this issue, an optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs. Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the learning-based algorithms. In correcting aberration, although promising results have been shown recently with convolutional neural networks, they are hard to generalize to stochastic machining biases. Therefore, we propose a dilated Omni-dimensional dynamic convolution (DOConv) and implement it in post-processing to account for the manufacturing degradation. Extensive experiments which evaluate multiple samples of two representative devices demonstrate that the proposed optimization framework accurately constructs the proxy camera. And the dynamic processing model is well-adapted to manufacturing deviations of different cameras, realizing perfect computational photography. The evaluation shows that the proposed method bridges the gap between optical design, system machining, and post-processing pipeline, shedding light on the joint of image signal reception (lens and sensor) and image signal processing (ISP).

Optimization Algorithm for Model-Based Optical Proximity Correction

Optimization of Wavefront Coding Systems Based on the Use of Multitarget Optimization

Investigating deep optics model representation in affecting resolved all-in-focus image quality and depth estimation fidelity

Non-blind optical degradation correction via frequency self-adaptive and finetune tactics

Vignetting Correction Using an Optical Model and Constant Chromaticity Prior

Modeling and Simulating of Optimization-Design for Structure Parameters of Ccd Intersection Measurement System

Fast Autofocusing Strategy for Phase Retrieval Based on Statistical Gradient Optimization

An Efficient Approach to Rules-Based Optical Proximity Correction

Elimination of Varying Chromatic Aberrations Based on Diffractive Optics

Method for optical proximity correction based on a vector imaging model

Unified Optical Distortion Correction Method for Imaging Systems Using A Concise Geometrical Transformation Model

Fast Auto-Focus Scheme Based on Optical Defocus Fitting Model

Segmentation Optimization Method for Optical Proximity Correction Based on Lithography Model

Bayesian Optimization for Wavefront Sensing and Error Correction

Optimization Algorithm of Static Tolerance in Focusing System Based on Linear Model

Cross-iteration Multi-Step Optimization Strategy for Three-Dimensional Intensity Position Correction in Phase Diverse Phase Retrieval.

A splitting primal-dual proximity algorithm for solving composite optimization problems

Investigation on MBOPC convergence improvement with location-dependent correction factors aided by machine learning

Focal length control of injection-molded plastic lenses via model free optimization

Computational Optics for Mobile Terminals in Mass Production

Edge-based near-field photolithography optical proximity effect correction technique