Abstract:Both light-field and polarization information contain lots of clues about scenes, and they can be widely used in variety of computer vision tasks. However, existing imaging systems cannot simultaneously capture the light-field and polarization information. In this paper, we present a low-cost and high-performance miniaturized polarimetric light-field camera, which is based on the six heterogeneous sensors array. The main challenge for the proposed strategy is to align the multi-view images with different polarization characteristics, especially for regions with high degree of polarization -- in which the intensity correlations are commonly weak. To solve this problem, we propose to use Convolutional Neural Network (CNN) based stereo matching method for aligning the heterogeneously polarized images accurately. After stereo matching, both the light field and the Stokes vectors of scene are estimated, and the polarimetry conventions, e.g., the polarization angle, the linear polarization degree and the circular polarization degree, are given. We implement the prototype of the multi-sensor polarization light-field camera and perform extensive experiments on it. The polarimetric light-field camera achieves six live streaming on time and the heterogeneous processor of NVIDIA Jetson TX2 is exploited for image processing. Benefiting from the multi-sensor parallel polarization imaging and efficient parallel processing, the proposed system achieves promising performance on time resolution, signal-to-noise ratio. Besides, we develop the object recognition applications to show the superiorities of proposed system.

Heterogeneous Camera Array for Multispectral Light Field Imaging

Dual-Focal Camera Hdr Imaging Based On Convolutional Neural Network

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Color Router-based Long-wave Infrared Multispectral Imaging

A Learning-Based Method Using Epipolar Geometry for Light Field Depth Estimation

Multi-spectral Imaging System Based on Light Field Rendering

Multi-sensor Array for Polarimetric Light-Field Imaging

A Dual Camera System for High Spatiotemporal Resolution Video Acquisition

Design of multispectral array imaging system based on depth-guided network

Low-Light Color Imaging via Dual Camera Acquisition.

Multidimensional Compressed Sensing for Spectral Light Field Imaging

Low-Light Color Imaging Via Cross-Camera Synthesis.

Multispectral Focal Stack Acquisition Using A Chromatic Aberration Enlarged Camera

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Design of a Dual-Mode Multispectral Filter Array

Camera Array Based Light Field Microscopy

A Single Sensor Based Multispectral Imaging Camera using a Narrow Spectral Band Colour Mosaic Integrated on the Monochrome CMOS Image Sensor

Lensless Multispectral Camera Based on a Coded Aperture Array

A single sensor based multispectral imaging camera using a narrow spectral band color mosaic integrated on the monochrome CMOS image sensor

High resolution multispectral video capture with a hybrid camera system

Multispectral imaging via nanostructured random broadband filtering