Abstract:While conventional cameras offer versatility for applications ranging from amateur photography to autonomous driving, computational cameras allow for domain-specific adaption. Cameras with co-designed optics and image processing algorithms enable high-dynamic-range image recovery, depth estimation, and hyperspectral imaging through optically encoding scene information that is otherwise undetected by conventional cameras. However, this optical encoding creates a challenging inverse reconstruction problem for conventional image recovery, and often lowers the overall photographic quality. Thus computational cameras with domain-specific optics have only been adopted in a few specialized applications where the captured information cannot be acquired in other ways. In this work, we investigate a method that combines two optical systems into one to tackle this challenge. We split the aperture of a conventional camera into two halves: one which applies an application-specific modulation to the incident light via a diffractive optical element to produce a coded image capture, and one which applies no modulation to produce a conventional image capture. Co-designing the phase modulation of the split aperture with a dual-pixel sensor allows us to simultaneously capture these coded and uncoded images without increasing physical or computational footprint. With an uncoded conventional image alongside the optically coded image in hand, we investigate image reconstruction methods that are conditioned on the conventional image, making it possible to eliminate artifacts and compute costs that existing methods struggle with. We assess the proposed method with 2-in-1 cameras for optical high-dynamic-range reconstruction, monocular depth estimation, and hyperspectral imaging, comparing favorably to all tested methods in all applications.

Design and Analysis of Optical Splitting System for Digital High-Speed Multi-Frame Gated Camera

High-performance Imaging with an Advanced Non-Imaging Lens Based on Full-Path Optical Diffraction Calculation in Two-Dimensional Space

A Design of Algorithm for Excimer Laser Coaxial Observation Automatic Tracking Processing System

Ccd High Speed Videography System With New Concepts And Techniques

Multi-image-distance Imaging System for Extending Depth-of-field

Imaging Degradation Evaluation on Beam-Splitting Devices

4-K-resolution Minimalist Optical System Design Based on Deep Learning.

A Binary Beam-Splitter For Lidar Beam-Shaping In Laser Imaging Application - Art. No. 66241j

Imaging Characteristics Of An Optical Butting Camera

Mathematical Modeling and Implementation of a Panoramic Zoom System Without Central Blind Area

Design and testing of optical inspection lens with large-field and high resolution

Design of Optical Imaging Lens for Intelligent Transportation Monitoring System

The design of wavefront coded imaging system

Analysis of Multiplex Laser Scanning Imagery Optical System

A simulation imaging method for actual optical system and results analysis

Optical design and fabrication of a three-channel common-aperture multispectral polarization camera

Design and analysis of miniature high-resolution omnidirectional gaze optical imaging system

Design and Study of a Two-Dimensional (2D) All-Optical Spatial Mapping Module

Design and theoretical analysis of the image-side telecentric zoom system using focus tunable lenses based on Gaussian brackets and lens modules

Split-Aperture 2-in-1 Computational Cameras

Design of off-axis reflective dual-channel zoom freeform optical systems