Abstract:Single-pixel imaging uses a single-pixel detector to capture all photons emitted from the two-dimensional scene, and then calculates and reconstructs the two-dimensional target scene image from the one-dimensional measurement data through single-pixel reconstruction methods (such as linear superposition, compressed sensing or deep learning) based on the one-dimensional acquisition data and the corresponding illumination coding. Compared with traditional cameras, single-pixel imaging has the advantages of high signal-to-noise ratio and wide spectrum. Due to these advantages, single-pixel imaging has been widely used in multispectral imaging. However, the traditional single-pixel image reconstruction methods have some disadvantages, such as low resolution, huge time consuming and poor reconstruction quality. In this paper, we propose a single-pixel image reconstruction method based on neural network. Compared with the traditional single-pixel image reconstruction method, this method has better reconstruction quality at lower sampling rate. Specifically, in this model, we first use a small optimized-patterns to simulate a single-pixel camera to sample the image to obtain the measured values, and then extract multi-channel high-dimensional semantic features from the sampled values through a high-dimensional semantic feature extraction network. Then, the multi-scale residual network module is used to construct the feature pyramid up-sampling module to up sample the high-dimensional semantic features. In the training process, the network parameters and pattern are jointly optimized to obtain the optimal network model and pattern. With the help of large-scale and pre-training, our reconstructed image has higher resolution, shorter reconstruction time and better reconstruction quality.

On the use of deep learning for single-pixel imaging

Single-Pixel Imaging Based on Deep Learning Enhanced Singular Value Decomposition

Towards High-Resolution Undersampled Single-Pixel Imaging: a Neural Network Perspective

Deep learning based projector defocus compensation in single-pixel imaging.

Single-pixel imaging based on deep learning

Improving Imaging Quality of Real-time Fourier Single-pixel Imaging via Deep Learning

Joint Supervised and Unsupervised Deep Learning Method for Single-Pixel Imaging

Deep-learning-driven Reliable Single-pixel Imaging with Uncertainty Approximation

Large-scale single-pixel imaging via deep learning

Deringing and Denoising in Extremely Under-Sampled Fourier Single Pixel Imaging

Research Progress of Single-Pixel Imaging Based on Deep Learning

Single-pixel Imaging with Untrained Convolutional Autoencoder Network

Depth Acquisition in Single-Pixel Imaging with Multiplexed Illumination

Deep Learning Based Single-Photon 3D Imaging with Multiple Returns

High-speed Image-Free Target Detection and Classification in Single-Pixel Imaging

Single-pixel Depth Imaging

Deep learning for real-time single-pixel video

Anti-noise computational imaging using unsupervised deep learning

Self-supervised Learning for Single-Pixel Imaging Via Dual-Domain Constraints

DQN Based Single-Pixel Imaging

Single-Pixel Image Reconstruction Based on Block Compressive Sensing and Deep Learning