Abstract:Lensless imaging represents a significant advancement in imaging technology, offering unique benefits over traditional optical systems due to its compact form factor, ideal for applications within the Internet of Things (IoT) ecosystem. Despite its potential, the intensive computational requirements of current lensless imaging reconstruction algorithms pose a challenge, often exceeding the resource constraints typical of IoT devices. To meet this challenge, a novel approach is introduced, merging multi-level image restoration with the pix2pix generative adversarial network architecture within the lensless imaging sphere. Building on the foundation provided by U-Net, a Multi-level Attention-based Lensless Image Restoration Network (MARN) is introduced to further augment the generator’s capabilities. In this methodology, images reconstructed through Tikhonov regularization are perceived as degraded images, forming the foundation for further refinement via the Pix2pix network. This process is enhanced by incorporating an attention-focused mechanism in the encoder--decoder structure and by implementing stage-wise supervised training within the deep convolutional network, contributing markedly to the improvement of the final image quality. Through detailed comparative evaluations, the superiority of the introduced method is affirmed, outperforming existing techniques and underscoring its suitability for addressing the computational challenges in lensless imaging within IoT environments. This method can produce excellent lensless image reconstructions when sufficient computational resources are available, and it consistently delivers optimal results across varying computational resource constraints. This algorithm enhances the applicability of lensless imaging in applications such as the Internet of Things, providing higher-quality image acquisition and processing capabilities for these domains.

A Multi-Task Deep Learning Framework Integrating Segmentation and Reconstruction for Lensless Imaging

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

LiSD: An Efficient Multi-Task Learning Framework for LiDAR Segmentation and Detection

Dual-branch Fusion Model for Lensless Imaging

Lensless Image Restoration Based on Multi-Stage Deep Neural Networks and Pix2pix Architecture

ISDNet: Integrating Shallow and Deep Networks for Efficient Ultra-high Resolution Segmentation

Text detection and recognition based on a lensless imaging system

Collaborative Network for Super-Resolution and Semantic Segmentation of Remote Sensing Images

A Multi-Task Framework for Infrared Small Target Detection and Segmentation

A Multi-Task Deep Learning Framework for Building Footprint Segmentation

Light Field Reconstruction via Deep Adaptive Fusion of Hybrid Lenses

Image Segmentation for Night-Vision Surveillance Camera Based on Deep Learning

Learned reconstructions for practical mask-based lensless imaging

SegR-Net: A deep learning framework with multi-scale feature fusion for robust retinal vessel segmentation

A new real-time image semantic segmentation framework based on a lightweight deep convolutional encoder-decoder architecture for robotic environment sensing

Self-Learned Feature Reconstruction and Offset-Dilated Feature Fusion for Real-Time Semantic Segmentation

FSegNet: A Semantic Segmentation Network for High-Resolution Remote Sensing Images That Balances Efficiency and Performance

DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope

Lensless cameras using a mask based on almost perfect sequence through deep learning

A Hybrid Framework for Referring Image Segmentation: Dual-Decoder Model with SAM Complementation