Abstract:While conventional cameras offer versatility for applications ranging from amateur photography to autonomous driving, computational cameras allow for domain-specific adaption. Cameras with co-designed optics and image processing algorithms enable high-dynamic-range image recovery, depth estimation, and hyperspectral imaging through optically encoding scene information that is otherwise undetected by conventional cameras. However, this optical encoding creates a challenging inverse reconstruction problem for conventional image recovery, and often lowers the overall photographic quality. Thus computational cameras with domain-specific optics have only been adopted in a few specialized applications where the captured information cannot be acquired in other ways. In this work, we investigate a method that combines two optical systems into one to tackle this challenge. We split the aperture of a conventional camera into two halves: one which applies an application-specific modulation to the incident light via a diffractive optical element to produce a coded image capture, and one which applies no modulation to produce a conventional image capture. Co-designing the phase modulation of the split aperture with a dual-pixel sensor allows us to simultaneously capture these coded and uncoded images without increasing physical or computational footprint. With an uncoded conventional image alongside the optically coded image in hand, we investigate image reconstruction methods that are conditioned on the conventional image, making it possible to eliminate artifacts and compute costs that existing methods struggle with. We assess the proposed method with 2-in-1 cameras for optical high-dynamic-range reconstruction, monocular depth estimation, and hyperspectral imaging, comparing favorably to all tested methods in all applications.

Imaging Characteristics Of An Optical Butting Camera

Optical butting system

Compositing Images For An Optical Butting Camera

Template-based Image Registration in an Optical Butting System

Imaging Degradation Evaluation on Beam-Splitting Devices

Research on the Analysis and Measurement of Mtf of Staring Imaging System

Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

Multi-image-distance Imaging System for Extending Depth-of-field

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

Optimization for Imaging Through Scattering Media for Confocal Microscopes with Divided Elliptical Apertures.

Optical Butting of Plane Array Sensors for PA-LiDAR

Analysis of Multiplex Laser Scanning Imagery Optical System

A simulation imaging method for actual optical system and results analysis

Design of an Airborne Low-Light Imaging System Based on Multichannel Optical Butting

Computational Diffraction-Limited Imaging with a Non-Imaging Spatial Information Transfer Lens

Split-Aperture 2-in-1 Computational Cameras

Research on Low-Cost Imaging Optical System Based on Stitching of Detectors

Mtf Online Compensation in Space Optical Remote Sensing Camera

Optical Design and Characterization of an Advanced Computational Imaging System

Windowed XOR Photography for Optical Readout Cantilever FPA Imaging

Point Spread Function for the Wide-Field-of-view Plenoptic Cameras