Foveated panoramic ghost imaging

Huan Cui,Qun Hao,Dong Zhou,Haoyu Zhang,Yingqiang Zhang,jie CAO

DOI: https://doi.org/10.1364/oe.482168

IF: 3.8

2023-04-06

Optics Express

Abstract:Huan Cui, Jie Cao, Qun Hao, Dong Zhou, Haoyu Zhang, Yingqiang Zhang Panoramic ghost imaging (PGI) is a novel method by only using a curved mirror to enlarge the field of view (FOV) of ghost imaging (GI) to ... [Opt. Express 31, 12986-13002 (2023)]

optics

What problem does this paper attempt to address?

Foveated Ghost Imaging Based on Deep Learning

Xiang Zhai,Zheng-dong Cheng,Yang-di Hu,Yi Chen,Zhen-yu Liang,Yuan Wei

DOI: https://doi.org/10.1016/j.optcom.2019.05.019

IF: 2.4

2019-01-01

Optics Communications

Abstract:Ghost imaging is an unconventional imaging mechanism that utilizes the high-order correlation to reconstruct object's image. Limited by the maximum refresh rate of DMD or SLM, the sampling efficiency of ghost imaging has been a major obstacle for practical application. In this paper, foveated ghost imaging based on deep learning (DPFGI) is proposed to generate non-uniform resolution speckle patterns according to the object detection results as the fovea point. We combine foveated speckle pattern inspired by the human visual system with GAN-based ghost imaging object detection system to realize selecting the region of interest for foveated imaging intelligently. The simulation and experimental results show that DPFGI can detect objects in undersampled images with higher accuracy and achieve higher PSNR in the fovea region compared with uniform-resolution ghost imaging, which opens new perspectives for more intelligent ghost imaging.
Omnidirectional ghost imaging system and unwrapping-free panoramic ghost imaging

Huan Cui,Jie Cao,Qun Hao,Dong Zhou,Mingyuan Tang,Kaiyu Zhang,Yingqiang Zhang

DOI: https://doi.org/10.1364/ol.440660

IF: 3.6

2021-11-08

Optics Letters

Abstract:Ghost imaging (GI) is an unconventional imaging method that reconstructs the object information via light-intensity correlation measurements. However, at present, the field of view (FOV) of this method is limited to the illumination range of light patterns. To enlarge the FOV of GI efficiently, we propose an omnidirectional GI system (OGIS) that can achieve a 360° omnidirectional FOV only via the addition of a curved mirror. The OGIS features retina-like annular patterns designed as a log-polar structure and can obtain the undistorted unwrapping-free panoramic images with uniform resolution. This research presents a new, to the best of our knowledge, perspective for the applications of GI, such as pipeline detection, a panoramic situation awareness for autonomous vehicles.

optics
Effect of spatial spectrum overlap on fourier ptychographic microscopy

Qiulan Liu,Cuifang Kuang,Yue Fang,Peng Xiu,Yicheng Li,Ruixin Wen,Xu Liu

DOI: https://doi.org/10.1142/S1793545816410042

IF: 2.396

2017-01-01

Journal of Innovative Optical Health Sciences

Abstract:Fourier ptychographic microscopy (FPM) is a newly developed imaging technique which stands out by virtue of its high-resolution and wide FOV. It improves a microscope's imaging performance beyond the diffraction limit of the employed optical components by illuminating the sample with oblique waves of different incident angles, similar to the concept of synthetic aperture. We propose to use an objective lens with high-NA to generate oblique illuminating waves in FPM. We demonstrate utilizing an objective lens with higher NA to illuminate the sample leads to better resolution by simulations, in which a resolution of 0.28 mu m is achieved by using a high-NA illuminating objective lens (NA = 1.49) and a low-NA collecting objective lens (NA = 0.2) in coherent imaging (lambda = 488 nm). We then deeply study FPM's exact relevance of convergence speed to spatial spectrum overlap in frequency domain. The simulation results show that an overlap of about 60% is the optimal choice to acquire a high-quality recovery (520*520 pixels) with about 2 min ' s computing time. In addition, we testify the robustness of the algorithm of FPM to additive noises and its suitability for phase objects, which further proves FPM's potential application in biomedical imaging.
Adaptive locating foveated ghost imaging based on affine transformation

Chang Zhou,jie CAO,Qun Hao,Huan Cui,Haifeng Yao,Yaqian Ning,Haoyu Zhang,Moudan Shi

DOI: https://doi.org/10.1364/oe.511452

IF: 3.8

2024-02-15

Optics Express

Abstract:Chang Zhou, Jie Cao, Qun Hao, Huan Cui, Haifeng Yao, Yaqian Ning, Haoyu Zhang, Moudan Shi Ghost imaging (GI) has been widely used in the applications including spectral imaging, 3D imaging, and other fields due to its advantages ... [Opt. Express 32, 7119-7135 (2024)]

optics
Adaptive Polarization Compressive Ghost Imaging Based on Principal Component Analysis

Zhai Xiang,Fan Xiang,Cheng Zhengdong,Chen Yi,Liang Zhenyu

DOI: https://doi.org/10.1117/12.2500888

2018-01-01

Abstract:Ghost imaging is an imaging mechanism that can non-locally obtain an unknown object's information with a single-pixel detector by the correlation of intensity fluctuations. To overcome the drawback of polarization compressive ghost imaging (PCGI), here we develop a novel adaptive polarization compressive ghost imaging (APCGI) method. By performing principal component analysis of the polarization statistics, we can compute the optimum unequal weighting coefficients forming as linear combinations of the light into bucket detectors. The specific steps of APCGI include calculating complete polarization parameters on the background, performing principal components analysis for optimal parameters, obtaining the information on the target-with-background scene. Experimental results demonstrate that adaptive polarization compressive ghost imaging performs better in restraining the background and pop out the details of targets as well as obtains better image quality.
Multi-resolution Foveated Laparoscope

Yi Qin,Zhenrong Zheng,Hong Hua

DOI: https://doi.org/10.1364/fio.2012.fth1f.4

2012-01-01

Abstract:A multi-resolution foveated laparoscope is proposed, which could simultaneously provide a wide-angle “stadium view” and a high-resolution sub-field. The FOV-resolution tradeoff in traditional optical systems was addressed by this “foveal” imaging system.
Multidirectional Edge Detection Based on Gradient Ghost Imaging

Yi Chen,Xiaoxia Li,Zhengdong Cheng,Yubao Cheng,Xiang Zhai

DOI: https://doi.org/10.1016/j.ijleo.2019.163768

IF: 3.1

2020-01-01

Optik

Abstract:Gradient ghost imaging (GGI) is a new imaging method that can directly obtain the edge information of an unknown object from the correlation of light intensity fluctuations. However, this technique faces the problems of poor directionality and continuity. In this paper, we propose a multidirectional gradient ghost imaging scheme (MGGI), where Kirsch operator with 8-directional masks is first used to generate structured illuminations, and then a fast algorithm based on the connection of the 8 masks is applied in the sampling process. Compared with GGI based on Sobel operator, both simulation and experimental results demonstrate that the proposed method has the advantages of imaging quality and edge continuity even in a noisy environment. Furthermore, the MGGI does not increase the imaging time and thus promotes the practical development of ghost imaging.
Design of Panoramic Stereo Imaging with Single Optical System

Zhi Huang,Jian Bai,Xi Yun Hou

DOI: https://doi.org/10.1364/oe.20.006085

IF: 3.8

2012-01-01

Optics Express

Abstract:A novel panoramic stereo imaging system with double panoramic annular lenses (PAL) is introduced in this paper. The proposed system consists of two coaxial PAL units and images on one sensor. The imaging rings are concentric. The object position can be calculated by triangulation. The novelty of this system is that the central blind zone of one PAL unit is partly used by the other as an image zone. The stereo field of view is 60°~105° × 360°. The depth extracting resolution is about 500 mm at 1line/cm. The F# of the system is about 3, facilitating the system to be applied in low illumination environment. A design is presented and the depth extracting precision is analyzed.
Research on Image Processing of Two-Dimensional Plan of the Hemispheric Panoramic Imaging System

Hou Huijie,Bai Jian,Yang Guoguang

IF: 0.6

2006-01-01

ACTA PHOTONICA SINICA

Abstract:PAL(Panoramic Annular Lens)was a hemispheric panoramic imaging system based on the principle of FCP(Plat Cylinder Perspective),field range of 360° around the optical axis could be imaged into a annular plane without any kinds of rotatable parts.The image was distorted,thus it was necessary to correct the deviation.An algorithm of correcting the image of a two-dimensional plane was provided based on the principle of FCP,after being treated by radical and tangential linear processes,image of the plane could be corrected into its former shape.
Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

Siqi Liu,Shengqian Chang,Siman Zhang,Ting Xie,Peng Sun,Huaye Li,Zhenrong Zheng

DOI: https://doi.org/10.1016/j.ijleo.2017.09.106

IF: 3.1

2018-01-01

Optik

Abstract:An imaging system with wide field of view (FOV) and high resolution is proposed in this paper. The optical design employed monocentric objective lens design combined with the unique arrangement of multi-aperture array, which empowers the system of good tradeoff between imaging performances and structural complexity. A prototype is built based on the design, achieving the field angle of 55° as well as the angular resolution of 40μrad. Experiments show excellent performances in distant view observation and images with 0.1 gigapixels can be finally obtained after image mosaicing, in addition, the proposed system has potential applications in airborne ground observation and crops survey in the future.
Optimization of retina-like illumination patterns in ghost imaging

Jie Cao,Dong Zhou,Yingqiang Zhang,Huan Cui,Fanghua Zhang,Kaiyu Zhang,Qun Hao

DOI: https://doi.org/10.1364/OE.439704

IF: 3.8

2021-10-23

Optics Express

Abstract:Jie Cao, Dong Zhou, Yingqiang Zhang, Huan Cui, Fanghua Zhang, Kaiyu Zhang, Qun Hao Ghost imaging (GI) reconstructs images using a single-pixel or bucket detector, which has the advantages of scattering robustness, wide ... [Opt. Express 29, 36813-36827 (2021)]

optics
Panoramic single-pixel imaging with megapixel resolution based on rotational subdivision

Huan Cui,Jie Cao,Haoyu Zhang,Chang Zhou,Haifeng Yao,Yingbo Wang,Qun Hao

2024-07-27

Abstract:Single-pixel imaging (SPI) using a single-pixel detector is an unconventional imaging method, which has great application prospects in many fields to realize high-performance imaging. In especial, the recent proposed catadioptric panoramic ghost imaging (CPGI) extends the application potential of SPI to high-performance imaging at a wide field of view (FOV) with recent growing demands. However, the resolution of CPGI is limited by hardware parameters of the digital micromirror device (DMD), which may not meet ultrahigh-resolution panoramic imaging needs that require detailed information. Therefore, to overcome the resolution limitation of CPGI, we propose a panoramic SPI based on rotational subdivision (RSPSI). The key of the proposed RSPSI is to obtain the entire panoramic scene by the rotation-scanning with a rotating mirror tilted 45°, so that one single pattern that only covers one sub-Fov with a small FOV can complete a uninterrupted modulation on the entire panoramic FOV during a once-through pattern projection. Then, based on temporal resolution subdivision, images sequence of sub-Fovs subdivided from the entire panoramic FOV can be reconstructed with pixels-level or even subpixels-level horizontal shifting adjacently. Experimental results using a proof-of-concept setup show that the panoramic image can be obtained with 10428*543 of 5,662,404 pixels, which is more than 9.6 times higher than the resolution limit of the CPGI using the same DMD. To our best knowledge, the RSPSI is the first to achieve a megapixel resolution via SPI, which can provide potential applications in fields requiring the imaging with ultrahigh-resolution and wide FOV.

Optics,Image and Video Processing
Three-dimensional ghost imaging via the Scheimpflug detection

Shihao Chang,Jianzhong Liu,Wenlin Gong

DOI: https://doi.org/10.1364/oe.533446

IF: 3.8

2024-08-31

Optics Express

Abstract:Shihao Chang, Jianzhong Liu, Wenlin Gong For previous three-dimensional ghost imaging, the acquisition of absolute distance information is mainly based on the principle of ... [Opt. Express 32, 32655-32666 (2024)]

optics
Variable Aperture Panoramic Imaging

Jing Lv,Qiang Zhao,Feng Dai,Yike Ma,Yongdong Zhang

DOI: https://doi.org/10.1007/s11042-018-5884-x

IF: 2.577

2018-01-01

Multimedia Tools and Applications

Abstract:Panoramic imaging has important applications in virtual reality. Current panoramic imaging only can create a 360 ∘ panorama but cannot change the focal surface or support depth cues. In this paper, we present a variable aperture panoramic imaging method based on a two-sphere panorama model (TSPM). Based on this model, we propose a definition of Aperture for TSPM, which can precisely control the depth of field (DOF) of panoramas. With same aperture size and focus distance, two similar panoramas could be synthesized from a range of capture camera configurations. Extensive experiments have been carried out to validate our panoramic imaging method.
Extending the depth-of-field of computational ghost imaging: Computational refocus via in situ point spread function estimation

Mengchao Ma,Wenbo Liang,Fushun Qin,Qingtian Guan,Xiang Zhong,Huaxia Deng,Ziwei Wang

DOI: https://doi.org/10.1063/5.0177211

IF: 4

2024-01-08

Applied Physics Letters

Abstract:Capturing details of objects beyond the focal plane is challenging due to the limited depth-of-field (DoF) of optical systems. Here, we report a computational refocusing ghost Imaging (CRGI) method to extend the DoF of computational ghost imaging (CGI) systems. An ultra-fast and in situ point spread function (PSF) estimation method is put forward utilizing the optical characterization of the system and compressive sensing modulation. The PSF distribution is measured with in situ compressive sensing algorithm according to reciprocity property using the same CGI system. The convolution of PSFs of various depths with modulation patterns is reshaped into measurement matrices to computationally refocus objects at different depths. From one measurement, CRGI can rebuild distinct and well-focused images of multiple objects at different depths. According to experiments, CRGI can nearly quadruple the DoF of typical CGI methods. CRGI represents a significant advancement in CGI domain by computationally surpassing the optical DoF limitations. This discovery enables recording object features beyond the focus plane using extended depth-of-field.

physics, applied
High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

Yi Xiao,Shiyuan Wei,Shaolong Xue,Cuifang Kuang,Anli Yang,Maoliang Wei,Hongtao Lin,Renjie Zhou

DOI: https://doi.org/10.1364/ol.428731

IF: 3.6

2021-01-01

Optics Letters

Abstract:Fourier ptychographic microscopy (FPM), as an emerging computational imaging method, has been applied to quantitative phase imaging with resolution bypassing the physical limit of the detection objective. Due to the weak illumination intensity and long image acquisition time, the achieved imaging speed in current FPM methods is still low, making them unsuitable for real-time imaging applications. We propose and demonstrate a high-speed FPM method based on using laser illumination and digital micro-mirror devices for illumination angle scanning. In this new, to the best of our knowledge, FPM method, we realized quantitative phase imaging and intensity imaging at over 42 frames per second (fps) with around 1 µm lateral resolution. The quantitative phase images have revealed membrane height fluctuations of red blood cells with nanometer-scale sensitivity, while the intensity images have resolved subcellular features in stained cancer tissue slices.
A Novel Approach of Parallel Retina-Like Computational Ghost Imaging

Jie Cao,Dong Zhou,Fanghua Zhang,Huan Cui,Yingqiang Zhang,Qun Hao

DOI: https://doi.org/10.3390/s20247093

IF: 3.9

2020-12-11

Sensors

Abstract:Computational ghost imaging (CGI), with the advantages of wide spectrum, low cost, and robustness to light scattering, has been widely used in many applications. The key issue is long time correlations for acceptable imaging quality. To overcome the issue, we propose parallel retina-like computational ghost imaging (PRGI) method to improve the performance of CGI. In the PRGI scheme, sampling and reconstruction are carried out by using the patterns which are divided into blocks from designed retina-like patterns. Then, the reconstructed image of each block is stitched into the entire image corresponding to the object. The simulations demonstrate that the proposed PRGI method can obtain a sharper image while greatly reducing the time cost than CGI based on compressive sensing (CSGI), parallel architecture (PGI), and retina-like structure (RGI), thereby improving the performance of CGI. The proposed method with reasonable structure design and variable selection may lead to improve performance for similar imaging methods and provide a novel technique for real-time imaging applications.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
High Speed Computational Ghost Imaging via Spatial Sweeping

Yuwang Wang,Yang Liu,Jinli Suo,Guohai Situ,Chang Qiao,Qionghai Dai

DOI: https://doi.org/10.1038/srep45325

IF: 4.6

2017-01-01

Scientific Reports

Abstract:Computational ghost imaging (CGI) achieves single-pixel imaging by using a Spatial Light Modulator (SLM) to generate structured illuminations for spatially resolved information encoding. The imaging speed of CGI is limited by the modulation frequency of available SLMs, and sets back its practical applications. This paper proposes to bypass this limitation by trading off SLM’s redundant spatial resolution for multiplication of the modulation frequency. Specifically, a pair of galvanic mirrors sweeping across the high resolution SLM multiply the modulation frequency within the spatial resolution gap between SLM and the final reconstruction. A proof-of-principle setup with two middle end galvanic mirrors achieves ghost imaging as fast as 42 Hz at 80 × 80-pixel resolution, 5 times faster than state-of-the-arts, and holds potential for one magnitude further multiplication by hardware upgrading. Our approach brings a significant improvement in the imaging speed of ghost imaging and pushes ghost imaging towards practical applications.
Real-time ghost image characterization for panoramic annular lenses

Yiqi Liao,Fang Ke,Yiru Pan,Shaohua Gao,Jian Bai,Kaiwei Wang

DOI: https://doi.org/10.1364/oe.525648

IF: 3.8

2024-06-08

Optics Express

Abstract:Yiqi Liao, Fang Ke, Yiru Pan, Shaohua Gao, Jian Bai, Kaiwei Wang As a common but troublesome branch of stray light, ghost images in catadioptric optical systems greatly limit the performances of such ... [Opt. Express 32, 22998-23014 (2024)]

optics
Parallel computational ghost imaging with modulation patterns multiplexing and permutation inspired by compound eyes

Mengchao Ma,Yinran Shen,Peiyuan Zha,Qingtian Guan,Xiang Zhong,Huaxia Deng,Xuming Zhang,Ziwei Wang

DOI: https://doi.org/10.1063/5.0187882

IF: 4

2024-02-12

Applied Physics Letters

Abstract:Real-time computational ghost imaging (CGI) has received significant attention in recent years to overcome the trade-off between long acquisition time and high reconstructed image quality of CGI. Inspired by compound eyes, we propose a parallel computational ghost imaging with modulation patterns multiplexing and permutation to achieve a faster and high-resolution CGI. With modulation patterns multiplexing and permutation, several small overlapping fields-of-view can be obtained; meanwhile, the difficulty in alignment of illumination light field and multiple detectors can be well resolved. The method combining compound eyes with multi-detectors to capture light intensity can resolve the issue of a gap between detector units in the array detector. Parallel computation facilitates significantly reduced acquisition time, while maintaining reconstructed quality without compromising the sampling ratio. Experiments indicate that using m × m detectors reduce modulation pattern count, projector storage, and projection time to around 1/m2 of typical CGI methods, while increasing image resolution to m2 times. This work greatly promotes the practicability of parallel computational ghost imaging and provides optional solution for real-time computational ghost imaging.

physics, applied

Foveated panoramic ghost imaging

Foveated Ghost Imaging Based on Deep Learning

Omnidirectional ghost imaging system and unwrapping-free panoramic ghost imaging

Effect of spatial spectrum overlap on fourier ptychographic microscopy

Adaptive locating foveated ghost imaging based on affine transformation

Adaptive Polarization Compressive Ghost Imaging Based on Principal Component Analysis

Multi-resolution Foveated Laparoscope

Multidirectional Edge Detection Based on Gradient Ghost Imaging

Design of Panoramic Stereo Imaging with Single Optical System

Research on Image Processing of Two-Dimensional Plan of the Hemispheric Panoramic Imaging System

Monocentric Imaging System with Wide Field of View and High Resolution for Distant View Observation

Optimization of retina-like illumination patterns in ghost imaging

Panoramic single-pixel imaging with megapixel resolution based on rotational subdivision

Three-dimensional ghost imaging via the Scheimpflug detection

Variable Aperture Panoramic Imaging

Extending the depth-of-field of computational ghost imaging: Computational refocus via in situ point spread function estimation

High-speed Fourier Ptychographic Microscopy for Quantitative Phase Imaging.

A Novel Approach of Parallel Retina-Like Computational Ghost Imaging

High Speed Computational Ghost Imaging via Spatial Sweeping

Real-time ghost image characterization for panoramic annular lenses

Parallel computational ghost imaging with modulation patterns multiplexing and permutation inspired by compound eyes