Deep-Learning-Based Ghost Imaging (Vol 7, 17865, 2017)

Meng Lyu,Wei Wang,Hao Wang,Haichao Wang,Guowei Li,Ni Chen,Guohai Situ

DOI: https://doi.org/10.1038/s41598-018-24803-3

IF: 4.6

2018-01-01

Scientific Reports

Abstract:A correction to this article has been published and is linked from the HTML and PDF versions of this paper. The error has been fixed in the paper.

What problem does this paper attempt to address?

Author Correction: Deep-learning-based Ghost Imaging

Meng Lyu,Wei Wang,Hao Wang,Haichao Wang,Guowei Li,Ni Chen,Guohai Situ

DOI: https://doi.org/10.1038/s41598-018-24803-3

IF: 4.6

2018-01-01

Scientific Reports

Abstract:A correction to this article has been published and is linked from the HTML and PDF versions of this paper. The error has been fixed in the paper.
Deep-learning-based Ghost Imaging.

Meng Lyu,Wei Wang,Hao Wang,Haichao Wang,Guowei Li,Ni Chen,Guohai Situ

DOI: https://doi.org/10.1038/s41598-017-18171-7

IF: 4.6

2017-01-01

Scientific Reports

Abstract:In this manuscript, we propose a novel framework of computational ghost imaging, i.e., ghost imaging using deep learning (GIDL). With a set of images reconstructed using traditional GI and the corresponding ground-truth counterparts, a deep neural network was trained so that it can learn the sensing model and increase the quality image reconstruction. Moreover, detailed comparisons between the image reconstructed using deep learning and compressive sensing shows that the proposed GIDL has a much better performance in extremely low sampling rate. Numerical simulations and optical experiments were carried out for the demonstration of the proposed GIDL.
Computational Ghost Imaging Via Adaptive Deep Dictionary Learning.

Xiang Zhai,Zhengdong Cheng,Zhenyu Liang,Yi Chen,Yangdi Hu,Yuan Wei

DOI: https://doi.org/10.1364/ao.58.008471

IF: 1.9

2019-01-01

Applied Optics

Abstract:Ghost imaging has gone through from quantum to classical pseudothermal to computational field over the last two decades. As a kernel part in computational ghost imaging (CGI), the reconstruction algorithm plays a decisive role in imaging quality and system practicality. In order to introduce more prior knowledge into the reconstruction algorithm, existing research adds image patch prior into CGI and improves the imaging efficiency. In this paper, the total variation minimization algorithm via adaptive deep dictionary learning (TVADDL) is proposed to update an adaptive deep dictionary through the CGI reconstruction process. The proposed algorithm framework is able to capture more precise texture features with a multi-layer architecture dictionary and adapt the learned dictionary by gradient descent on CGI reconstruction loss value. The results of simulation and experiment show that TVADDL can achieve higher peak signal-to-noise ratio than the algorithms without patch prior and the algorithms using the shallow dictionary or non-adaptive deep dictionary.
Foveated Ghost Imaging Based on Deep Learning

Xiang Zhai,Zheng-dong Cheng,Yang-di Hu,Yi Chen,Zhen-yu Liang,Yuan Wei

DOI: https://doi.org/10.1016/j.optcom.2019.05.019

IF: 2.4

2019-01-01

Optics Communications

Abstract:Ghost imaging is an unconventional imaging mechanism that utilizes the high-order correlation to reconstruct object's image. Limited by the maximum refresh rate of DMD or SLM, the sampling efficiency of ghost imaging has been a major obstacle for practical application. In this paper, foveated ghost imaging based on deep learning (DPFGI) is proposed to generate non-uniform resolution speckle patterns according to the object detection results as the fovea point. We combine foveated speckle pattern inspired by the human visual system with GAN-based ghost imaging object detection system to realize selecting the region of interest for foveated imaging intelligently. The simulation and experimental results show that DPFGI can detect objects in undersampled images with higher accuracy and achieve higher PSNR in the fovea region compared with uniform-resolution ghost imaging, which opens new perspectives for more intelligent ghost imaging.
Computational Ghost Imaging Using a Dynamic Scattering Medium by the Point-by-Point Compensation Method

Hu Yangdi,Cheng Zhengdong,Liang Zhenyu,Zhai Xiang

DOI: https://doi.org/10.3788/lop57.201106

2020-01-01

Abstract:Computational ghost imaging (CGI) can easily penetrate a static scattering medium. However, when the scattering medium changes dynamically, the measured light intensity is subject to nonlinear changes caused by the medium; as a result, the light intensity of each measurement exhibits a drift, and the reconstructed image contains lot of noise due to the interference. To improve imaging results penetrating a dynamic scattering medium, this study proposes a method to correct the measured value of each point. In this method, patterns with the reflectivity of 1 arc added to a measurement matrix. The attenuation factor is obtained at each time by recording the change of light intensity after projecting the pattern, and the compensation coefficient at the middle time is calculated. According to the compensation coefficient, the light intensity distortion caused by the change of the medium's attenuation factor is corrected for each point, and finally, the transformed values arc restored and calculated. The reconstruction results show that the proposed method can effectively deal with the aforementioned noise problem of the CGI technology encountered while penetrating a dynamic scattering medium.
Deep learning-enhanced ghost imaging through dynamic and complex scattering media with supervised corrections of dynamic scaling factors

Yang Peng,Wen Chen

DOI: https://doi.org/10.1063/5.0213138

IF: 4

2024-04-29

Applied Physics Letters

Abstract:Ghost imaging (GI) through dynamic and complex scattering media remains challenging. The existence of dynamic scattering gives rise to a failure of GI schemes. Here, we report a deep learning-enhanced GI scheme with supervised corrections (SCGI) of dynamic scaling factors to realize high-resolution ghost reconstruction through dynamic and complex scattering media. The SCGI scheme is developed to approximate the variation of dynamic scaling factors in an optical channel and correct the recorded light intensities with a Gaussian prior. An untrained neural network powered by regularization by denoising for the SCGI scheme (SCGI-URED) is developed to further recover high-visibility ghost images. Experimental results demonstrate that high-resolution and high-visibility GI can be realized in dynamic and complex scattering media. The proposed method provides a reliable tool for implementing high-resolution and high-visibility GI through dynamic and complex scattering media and could give an impetus to developing dynamic scattering imaging in real-world scenarios.

physics, applied
A residual-based deep learning approach for ghost imaging.

Tong Bian,Yuxuan Yi,Jiale Hu,Yin Zhang,Yide Wang,Lu Gao

DOI: https://doi.org/10.1038/s41598-020-69187-5

IF: 4.6

2020-01-01

Scientific Reports

Abstract:Ghost imaging using deep learning (GIDL) is a kind of computational quantum imaging method devised to improve the imaging efficiency. However, among most proposals of GIDL so far, the same set of random patterns were used in both the training and test set, leading to a decrease of the generalization ability of networks. Thus, the GIDL technique can only reconstruct the profile of the image of the object, losing most of the details. Here we optimize the simulation algorithm of ghost imaging (GI) by introducing the concept of "batch" into the pre-processing stage. It can significantly reduce the data acquisition time and create reliable simulation data. The generalization ability of GIDL has been appreciably enhanced. Furthermore, we develop a residual-based framework for the GI system, namely the double residual U-Net (DRU-Net). The imaging quality of GI has been tripled in the evaluation of the structural similarity index by our proposed DRU-Net.
Computational Ghost Imaging in Scattering Media Using Simulation-Based Deep Learning

Ziqi Gao,Xuemin Cheng,Ke Chen,Anqi Wang,Yao Hu,Shaohui Zhang,Qun Hao

DOI: https://doi.org/10.1109/jphot.2020.3024968

IF: 2.4

2020-01-01

IEEE Photonics Journal

Abstract:Deep learning has been proven to provide solutions for computational ghost imaging (CGI). However, in current CGI techniques, the quality of the reconstructed image is adversely affected by the position and intensity of the scattering medium. In this study, the feasibility of using a deep neural network (DNN) by using the hybrid simulated data to facilitate CGI through a scattering medium is demonstrated, particularly when the scattering medium is in front of an object. Under a specific order of the measurement matrix, the CGI measurement equation is introduced along with a disturbance factor of the scattering effect to generate simulation data, thereby representing imaging situations with the scattering medium at different positions. The selection of disturbance parameters is determined by the correlation between the simulation signal and the experimental signal. Then an end-to-end DNN is trained using experimentally obtained light intensity signals, and it shows that the quality of the reconstruction results is improved when there is a scattering medium in the emission path. The reported technique effectively solves the problem of CGI reconstruction under different scattering paths with a common DNN, and may have broad applications in fast adaptive CGI for new and uncertain scenarios.
Computational ghost imaging with deep compressed sensing

D. Duan 段,Y. Xia 夏,Hao 浩 Zhang 张

DOI: https://doi.org/10.1088/1674-1056/ac0042

2021-05-12

Abstract:Computational ghost imaging (CGI) provides an elegant framework for indirect imaging, but its application has been restricted by low imaging performance. Herein, we propose a novel approach that significantly improves the imaging performance of CGI. In this scheme, we optimize the conventional CGI data processing algorithm by using a novel compressed sensing (CS) algorithm based on a deep convolution generative adversarial network (DCGAN). CS is used to process the data output by a conventional CGI device. The processed data are trained by a DCGAN to reconstruct the image. Qualitative and quantitative results show that this method significantly improves the quality of reconstructed images by jointly training a generator and the optimization process for reconstruction via meta-learning. Moreover, the background noise can be eliminated well by this method.

Computer Science,Physics
Computational ghost imaging using deep learning

Tomoyoshi Shimobaba,Yutaka Endo,Takashi Nishitsuji,Takayuki Takahashi,Yuki Nagahama,Satoki Hasegawa,Marie Sano,Ryuji Hirayama,Takashi Kakue,Atsushi Shiraki,Tomoyoshi Ito

DOI: https://doi.org/10.1016/j.optcom.2017.12.041

IF: 2.4

2018-04-01

Optics Communications

Abstract:Computational ghost imaging (CGI) is a single-pixel imaging technique that exploits the correlation between known random patterns and the measured intensity of light transmitted (or reflected) by an object. Although CGI can obtain two- or three-dimensional images with a single or a few bucket detectors, the quality of the reconstructed images is reduced by noise due to the reconstruction of images from random patterns. In this study, we improve the quality of CGI images using deep learning. A deep neural network is used to automatically learn the features of noise-contaminated CGI images. After training, the network is able to predict low-noise images from new noise-contaminated CGI images.

optics
Ghost Imaging Based on Y-net: a Dynamic Coding and Decoding Approach.

Ruiguo Zhu,Hong Yu,Zhijie Tan,Ronghua Lu,ShenSheng Han,Zengfeng Huang,Jian Wang

DOI: https://doi.org/10.1364/oe.395000

IF: 3.8

2020-01-01

Optics Express

Abstract:Ghost imaging incorporating deep learning technology has recently attracted much attention in the optical imaging field. However, deterministic illumination and multiple exposure are still essential in most scenarios. Here we propose a ghost imaging scheme based on a novel dynamic decoding deep learning framework (Y-net), which works well under both deterministic and indeterministic illumination. Benefited from the end-to-end characteristic of our network, the image of a sample can be achieved directly from the data collected by the detector. The sample is illuminated only once in the experiment, and the spatial distribution of the speckle encoding the sample in the experiment can be completely different from that of the simulation speckle in training, as long as the statistical characteristics of the speckle remain unchanged. This approach is particularly important to high-resolution x-ray ghost imaging applications due to its potential for improving image quality and reducing radiation damage.
High Speed Ghost Imaging Based on a Heuristic Algorithm and Deep Learning*

Yi-Yi Huang,Chen Ou-Yang,Ke Fang,Yu-Feng Dong,Jie Zhang,Li-Ming Chen,Ling-An Wu

DOI: https://doi.org/10.1088/1674-1056/abea8c

2021-01-01

Chinese Physics B

Abstract:We report an overlapping sampling scheme to accelerate computational ghost imaging for imaging moving targets, based on reordering a set of Hadamard modulation matrices by means of a heuristic algorithm. The new condensed overlapped matrices are then designed to shorten and optimize encoding of the overlapped patterns, which are shown to be much superior to the random matrices. In addition, we apply deep learning to image the target, and use the signal acquired by the bucket detector and corresponding real image to train the neural network. Detailed comparisons show that our new method can improve the imaging speed by as much as an order of magnitude, and improve the image quality as well.
A Deghosting Method Based on Deep Learning

Yuetong Zhao,Yaxing Li,Xiaofeng Jia,Xinming Wu

DOI: https://doi.org/10.1088/1742-6596/2651/1/012126

2023-01-01

Journal of Physics Conference Series

Abstract:Abstract Interference of ghost has a bad effect to marine seismic exploration, which reduces the resolution seismic data and accuracy of seismic interpretation. To solve these problems, we propose a deghosting method based on deep learning. The trial calculation of synthetic models shows that this method is more streamlined and efficient in deghosting, which has good adaptability to data with with different geological models, acquisition systems and signal-to-noise ratio, recovers the energy of the frequency band affected by the ghost notch.
Far-field super-resolution ghost imaging with a deep neural network constraint

Fei Wang,Chenglong Wang,Mingliang Chen,Wenlin Gong,Yu Zhang,Shensheng Han,Guohai Situ

DOI: https://doi.org/10.1038/s41377-021-00680-w

2022-01-01

Light: Science and Applications

Abstract:Abstract Ghost imaging (GI) facilitates image acquisition under low-light conditions by single-pixel measurements and thus has great potential in applications in various fields ranging from biomedical imaging to remote sensing. However, GI usually requires a large amount of single-pixel samplings in order to reconstruct a high-resolution image, imposing a practical limit for its applications. Here we propose a far-field super-resolution GI technique that incorporates the physical model for GI image formation into a deep neural network. The resulting hybrid neural network does not need to pre-train on any dataset, and allows the reconstruction of a far-field image with the resolution beyond the diffraction limit. Furthermore, the physical model imposes a constraint to the network output, making it effectively interpretable. We experimentally demonstrate the proposed GI technique by imaging a flying drone, and show that it outperforms some other widespread GI techniques in terms of both spatial resolution and sampling ratio. We believe that this study provides a new framework for GI, and paves a way for its practical applications.
High-resolution Non-Direct-viewing Computational Ghost Imaging

Yuchen He,Shitao Zhu,Anxue Zhang,Zhuo Xu

DOI: https://doi.org/10.1364/iodc.2017.ith4a.3

2017-01-01

Abstract:Based on anti-scattering of ghost imaging and high resolution image reconstruction algorithm, a scheme for accurate reconstruction of target when the detector can not directly observe the target is proposed.
Reference-free Correction for the Nyquist Ghost in Echo-planar Imaging Using Deep Learning

Xudong Chen,Yufei Zhang,Huajun She,Yiping P. Du

DOI: https://doi.org/10.1145/3375923.3375927

2019-01-01

Abstract:Echo-planar imaging suffers from Nyquist ghost (i.e., N/2 ghost) because of the imperfection of the gradient system and gradient delays. The phase mismatch between even and odd echoes can be eliminated by an extra reference scan without the phase encoding. However, due to the non-linear and time-varying local magnetic field changes or movement of the patients, the reference-based methods may have incorrect correction results. Other correction methods like parallel imaging reconstruction may suffer from the image noise amplification and signal-to-noise ratio penalty. In this study, a deep learning method is proposed to eliminate the phase error in k-space and correct the mismatch between even and odd echoes without reference scan and SNR penalty. The Fourier transform layer is introduced into the conventional U-Net structure, and the distortion-free images are directly reconstructed from the k-space EPI data. Turbo spin echo data and single-shot EPI data are tested using this network. The results show that this method has a good performance in ghost correction, and the ghost-to-signal ratio is effectively reduced compared to other state-of-the-art correction methods. The proposed deep learning method is reference-free and effective to correct Nyquist ghost in EPI, and can also combine with parallel imaging to achieve additional acceleration.
Deep learning based high-resolution incoherent x-ray imaging with a single-pixel detector

Yu-Hang He,Ai-Xin Zhang,Ming-Fei Li,Yi-Yi Huang,Bao-Gang Quan,Da-Zhang Li,Ling-An Wu,Li-Ming Chen

DOI: https://doi.org/10.48550/arXiv.1905.10364

2019-05-24

Abstract:X-ray "ghost" imaging has drawn great attention for its potential to lower radiation dose in medical diagnosis. For practical implementation, however, the efficiency and image quality have to be greatly improved. Here we demonstrate a computational ghost imaging scheme where a bucket detector and specially designed modulation masks are used, together with a new robust deep learning algorithm in which a compressed set of Hadamard matrices is incorporated into a multi-level wavelet convolutional neural network. By this means we have obtained an image of a real object from only 18.75% of the Nyquist sampling rate, using a portable tabletop incoherent x-ray source of ~37 {\mu}m diameter. A high imaging resolution of ~10 {\mu}m is achieved, which represents a concrete step towards the realization of a practical low cost x-ray ghost imaging camera for applications in biomedicine, archeology, material science, and so forth.

Image and Video Processing
Deep Learning Enhanced Ghost Holography: Optimizing CNNs for Robust Image Recognition in Noisy Environments

Mohammad R. Sayeh,Dina Famouri,Mohammad Mohammadzadeh,Shima Tabakhi

DOI: https://doi.org/10.1364/cleo_at.2024.jtu2a.194

2024-05-05

Abstract:In this study, we present a deep learning-based ghost holography approach to recover occlusion-obscured image details, using a neural network trained on varied datasets, markedly enhancing image reconstruction in complex imaging scenarios.

Engineering,Computer Science,Physics
Color computational ghost imaging by deep learning based on simulation data training

Zhan Yu,Yang Liu,Jinxi Li,Xing Bai,Zhongzhuo Yang,Yang Ni,Xin Zhou

DOI: https://doi.org/10.1364/AO.447761

2022-02-01

Abstract:We present a new color computational ghost imaging strategy using a sole single-pixel detector and training by simulated dataset, which can eliminate the actual workload of acquiring experimental training datasets and reduce the sampling times for imaging experiments. First, the relative responsibility of the color computational ghost imaging device to different color channels is experimentally detected, and then enough data sets are simulated for training the neural network based on the response value. Because the simulation process is much simpler than the actual experiment, and the training set can be almost unlimited, the trained network model has good generalization. In the experiment with a sampling rate of only 4.1%, the trained neural network model can still recover the image information from the blurry ghost image, correct the color distortion of the image, and get a better reconstruction result. In addition, with the increase in the sampling rate, the details and color characteristics of the reconstruction result become better and better. Feasibility and stability of the proposed method have been verified by the reconstruction results of the trained network model on the color objects of different complexities.
Corrigendum: Deep Learning-Enabled Clinically Applicable CT Planbox for Stroke With High Accuracy and Repeatability

Yang Wang,Junkai Zhu,Jinli Zhao,Wenyi Li,Xin Zhang,Xiaolin Meng,Taige Chen,Ming Li,Meiping Ye,Renfang Hu,Shidan Dou,Huayin Hao,Xiaofen Zhao,Xiaoming Wu,Wei Hu,Cheng Li,Xiaole Fan,Liyun Jiang,Xiaofan Lu,Fangrong Yan

DOI: https://doi.org/10.3389/fneur.2022.921992

IF: 3.4

2022-05-09

Frontiers in Neurology

Abstract:[This corrects the article DOI: 10.3389/fneur.2022.755492.].

neurosciences,clinical neurology

Deep-Learning-Based Ghost Imaging (Vol 7, 17865, 2017)

Author Correction: Deep-learning-based Ghost Imaging

Deep-learning-based Ghost Imaging.

Computational Ghost Imaging Via Adaptive Deep Dictionary Learning.

Foveated Ghost Imaging Based on Deep Learning

Computational Ghost Imaging Using a Dynamic Scattering Medium by the Point-by-Point Compensation Method

Deep learning-enhanced ghost imaging through dynamic and complex scattering media with supervised corrections of dynamic scaling factors

A residual-based deep learning approach for ghost imaging.

Computational Ghost Imaging in Scattering Media Using Simulation-Based Deep Learning

Computational ghost imaging with deep compressed sensing

Computational ghost imaging using deep learning

Ghost Imaging Based on Y-net: a Dynamic Coding and Decoding Approach.

High Speed Ghost Imaging Based on a Heuristic Algorithm and Deep Learning*

A Deghosting Method Based on Deep Learning

Far-field super-resolution ghost imaging with a deep neural network constraint

High-resolution Non-Direct-viewing Computational Ghost Imaging

Reference-free Correction for the Nyquist Ghost in Echo-planar Imaging Using Deep Learning

Deep learning based high-resolution incoherent x-ray imaging with a single-pixel detector

Deep Learning Enhanced Ghost Holography: Optimizing CNNs for Robust Image Recognition in Noisy Environments

Color computational ghost imaging by deep learning based on simulation data training

Corrigendum: Deep Learning-Enabled Clinically Applicable CT Planbox for Stroke With High Accuracy and Repeatability