Abstract:Today's commodity camera systems rely on compound optics to map light originating from the scene to positions on the sensor where it gets recorded as an image. To record images without optical aberrations, i.e., deviations from Gauss' linear model of optics, typical lens systems introduce increasingly complex stacks of optical elements which are responsible for the height of existing commodity cameras. In this work, we investigate flat nanophotonic computational cameras as an alternative that employs an array of skewed lenslets and a learned reconstruction approach. The optical array is embedded on a metasurface that, at 700~nm height, is flat and sits on the sensor cover glass at 2.5~mm focal distance from the sensor. To tackle the highly chromatic response of a metasurface and design the array over the entire sensor, we propose a differentiable optimization method that continuously samples over the visible spectrum and factorizes the optical modulation for different incident fields into individual lenses. We reconstruct a megapixel image from our flat imager with a learned probabilistic reconstruction method that employs a generative diffusion model to sample an implicit prior. To tackle scene-dependent aberrations in broadband, we propose a method for acquiring paired captured training data in varying illumination conditions. We assess the proposed flat camera design in simulation and with an experimental prototype, validating that the method is capable of recovering images from diverse scenes in broadband with a single nanophotonic layer.

Freeform metasurface color router for deep submicron pixel image sensors

Design parameters of free-form color routers for subwavelength pixelated CMOS image sensors

Machine-learning Reprogrammable Metasurface Imager.

Metalens-integrated Compact Imaging Devices for Wide-Field Microscopy

A metasurface color router facilitating RGB-NIR sensing for an image sensor application

Pixel-level Bayer-type Colour Router Based on Metasurfaces.

Pixelated Bayer Spectral Router Based on Sparse Meta-atom Array

Single-Layer Bayer Metasurface via Inverse Design

Topologically-optimized On-Chip Metamaterials for Ultra-Short-range Light Focusing and Mode-Size Conversion

Miniaturizing Color-Sensitive Photodetectors via Hybrid Nanoantennas towards Sub-micron Dimensions

Bayer-type Vis-NIR Routing via Inverse Design for Submicron-pixel Image Sensing Chip

Ultraspectral Imaging Based on Metasurfaces with Freeform Shaped Meta‐Atoms

Subwavelength Color Router

Metasurface-based Polarization Color Routers

Subwavelength Bayer RGB Color Routers with Perfect Optical Efficiency

Pixelated NIR-VIS Spectral Routers Based on 2D Mie-Type Metagratings

Thin On-Sensor Nanophotonic Array Cameras

Full-color nanorouter for high-resolution imaging

Dispersion-engineered metasurfaces for high-sensitivity color image sensors

Nanostructured Metal-Insulator-metal Resonators for High-Resolution Color Filtering and Spectral Imaging

A Computational Microspectrometer Based on Binary-Image-Generated Freeform Metasurfaces for Spectral Sensing