Abstract:Lensless cameras offer significant advantages in size, weight, and cost compared to traditional lens-based systems. Without a focusing lens, lensless cameras rely on computational algorithms to recover the scenes from multiplexed measurements. However, current algorithms struggle with inaccurate forward imaging models and insufficient priors to reconstruct high-quality images. To overcome these limitations, we introduce a novel two-stage approach for consistent and photorealistic lensless image reconstruction. The first stage of our approach ensures data consistency by focusing on accurately reconstructing the low-frequency content with a spatially varying deconvolution method that adjusts to changes in the Point Spread Function (PSF) across the camera's field of view. The second stage enhances photorealism by incorporating a generative prior from pre-trained diffusion models. By conditioning on the low-frequency content retrieved in the first stage, the diffusion model effectively reconstructs the high-frequency details that are typically lost in the lensless imaging process, while also maintaining image fidelity. Our method achieves a superior balance between data fidelity and visual quality compared to existing methods, as demonstrated with two popular lensless systems, PhlatCam and DiffuserCam. Project website: <a class="link-external link-https" href="https://phocolens.github.io/" rel="external noopener nofollow">this https URL</a>.

Coded Illumination for 3D Lensless Imaging

Coded Illumination for Improved Lensless Imaging

Three Dimensional Reconstruction Using a Lenslet Light Field Camera

Lensless Imaging Through Multiple Phase Patterns Illumination

A Simple Framework for 3D Lensless Imaging with Programmable Masks

Target Enhanced 3D Reconstruction Based on Polarization-Coded Structured Light.

Joint Image and Depth Estimation With Mask-Based Lensless Cameras

Extended Depth-of-Field Lensless Imaging using an Optimized Radial Mask

High Angular Resolution Light Field Reconstruction With Coded-Aperture Mask

Lensless cameras using a mask based on almost perfect sequence through deep learning

Depth-Of-Field And Coded Aperture Imaging On Xslit Lens

Single-shot Lensless Imaging with Fresnel Zone Aperture and Incoherent Illumination.

Explicit-restriction Convolutional Framework for Lensless Imaging

Experimental Analysis and Designing Strategies of Lens-Less Microscopy with Partially Coherent Illumination

PhoCoLens: Photorealistic and Consistent Reconstruction in Lensless Imaging

Single-shot Lensless Imaging Via Simultaneous Multi-Angle LED Illumination

Noise-robust Coded-Illumination Imaging with Low Computational Complexity

Effective 3D Object Reconstruction from Densely Sampled Circular Light Fields

Lensless Multispectral Camera Based on a Coded Aperture Array

White light three-dimensional imaging using a quasi-random lens

Compressive photography based on lens array with coded mask