Abstract:Correcting the optical aberrations and the manufacturing deviations of cameras is a challenging task. Due to the limitation on volume and the demand for mass production, existing mobile terminals cannot rectify optical degradation. In this work, we systematically construct the perturbed lens system model to illustrate the relationship between the deviated system parameters and the spatial frequency response (SFR) measured from photographs. To further address this issue, an optimization framework is proposed based on this model to build proxy cameras from the machining samples' SFRs. Engaging with the proxy cameras, we synthetic data pairs, which encode the optical aberrations and the random manufacturing biases, for training the learning-based algorithms. In correcting aberration, although promising results have been shown recently with convolutional neural networks, they are hard to generalize to stochastic machining biases. Therefore, we propose a dilated Omni-dimensional dynamic convolution (DOConv) and implement it in post-processing to account for the manufacturing degradation. Extensive experiments which evaluate multiple samples of two representative devices demonstrate that the proposed optimization framework accurately constructs the proxy camera. And the dynamic processing model is well-adapted to manufacturing deviations of different cameras, realizing perfect computational photography. The evaluation shows that the proposed method bridges the gap between optical design, system machining, and post-processing pipeline, shedding light on the joint of image signal reception (lens and sensor) and image signal processing (ISP).

Evolved Design for Telecentric Optical Systems Based on Particle Swarm Optimization and Semi-Supervised Learning

Automated Design of Machine Vision Lens Based on the Combination of Particle Swarm Optimization and Damped Least Squares

Elimination of Varying Chromatic Aberrations Based on Diffractive Optics

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

Automated first-order design of double-sided telecentric zoom systems based on PSO algorithms

Automatic Design of Machine Vision Lens Based on Improved Genetic Algorithm and Damped Least Squares

Automated design of freeform imaging systems

Towards Automatic Freeform Optics Design: Coarse and Fine Search of the Three-Mirror Solution Space

Project-Based Optical Design Practice Course And Teamwork: From A Programmer To A Lens Designer

Design and theoretical analysis of the image-side telecentric zoom system using focus tunable lenses based on Gaussian brackets and lens modules

Optimization Design Of Zoom Lens Systems

Design of image-side telecentric freeform imaging systems based on a point-by-point construction-iteration process

A simulation imaging method for actual optical system and results analysis

Optical design of a variable view imaging system with the combination of a telecentric scanner and double wedge prisms

Deep Learning for Polarization Optical System Automated Design

Global Search Optics: Automatically Exploring Optimal Solutions to Compact Computational Imaging Systems

Automated Design of a Slim Catadioptric System Combining Freeform Surface and Zoom Lens.

Computational Optics for Mobile Terminals in Mass Production

A Hybrid Diffractive Optical Element Design Algorithm Combining Particle Swarm Optimization and a Simulated Annealing Algorithm

Aberration correction of double-sided telecentric zoom lenses using lens modules

Design method for a telecentric multiscale imaging system to avoid mechanical interference