Abstract:This work explores a high‐quality self‐supervised learning approach for holographic reconstruction and lensless imaging. By using a dual‐input physics‐driven network and two diffractions recorded at different distances, highly accurate object information without requiring extensive training data can be achieved. This unsupervised approach holds promise for accurate phase retrieval and holographic reconstruction, and is applicable to biomedical imaging and other applications. Lensless imaging, as a novel computational imaging technique, has attracted great attention due to its simplicity, compactness, and flexibility. This technique analyzes and processes the diffraction of an object to obtain complex amplitude information. However, traditional algorithms such as Gerchberg‐Saxton (G–S) algorithm tend to exhibit significant errors in complex amplitude retrieval, particularly for edge information. Additional constraints have to be incorporated on top of amplitude constraints to enhance the accuracy. Recently, deep learning has shown promising results in optical imaging. However, it requires a large amount of training data. To address these issues, a novel approach called dual‐input physics‐driven network (DPNN) is proposed for lensless imaging. DPNN utilizes two diffractions recorded at different distances as inputs and uses an unsupervised approach that combines physical imaging model to reconstruct object information. DPNN adopts a U‐Net 3+ architecture with a loss function of mean absolute error (MAE) to better capture diffraction features. DPNN achieves highly accurate reconstruction without requiring extensive data and being immune to background noise. Based on different diffraction intervals, noise levels, and imaging models, DPNN exhibits superior capabilities in peak signal‐to‐noise ratio and structural similarity compared with conventional methods, effectively achieving accurate phase or amplitude information reconstruction.

Optical-electronic neural network for multi-modality and high-accurate lensless optics design and image reconstruction

Optical Analog Computing Devices Designed by Deep Neural Network

Optical Neural Network with Complementary Decomposition to Overcome the Phase Insensitive Constrains

Super-resolution imaging using super-oscillatory diffractive neural networks

1-bit Quantized On-chip Hybrid Diffraction Neural Network Enabled by Authentic All-optical Fully-connected Architecture

OP-FCNN: an Optronic Fully Convolutional Neural Network for Imaging Through Scattering Media.

On-chip 4F-System Based on Concave Mirrors for Optical Neural Networks

Terahertz Deep-Optics Imaging Enabled by Perfect Lens-Initialized Optical and Electronic Neural Networks

All-optical autoencoder machine learning framework using diffractive processors

Optical Neural Ordinary Differential Equations

Ensemble learning of diffractive optical networks

Space-efficient optical computing with an integrated chip diffractive neural network

Scale-, shift- and rotation-invariant diffractive optical networks

Design of task-specific optical systems using broadband diffractive neural networks

A multichannel optical neural network for advanced machine vision

Image sensing with multilayer nonlinear optical neural networks

Efficient On-Chip Learning for Optical Neural Networks Through Power-Aware Sparse Zeroth-Order Optimization

Lensless Imaging Based on Dual‐Input Physics‐Driven Neural Network

L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization

Optical Convolutional Neural Network with WDM-Based Optical Patching and Microring Weighting Banks

Spatially Varying Nanophotonic Neural Networks