Reducing Motion Blur in Ghost Imaging with Hessian Enhancement Filter

Chen Chang,Dongyue Yang,Junhui Li,Guohua Wu,Bin Luo,Longfei Yin,Hong Guo

DOI: https://doi.org/10.1364/cosi.2019.jw2a.15

2019-01-01

Abstract:In ghost imaging with pseudo-thermal light, Hessian enhancement filter is applied in reference measurements to improve the image quality by reducing the motion blur caused by improper exposure settings at short coherence time.

What problem does this paper attempt to address?

Motion Blur Suppression Method Based on Dual Mode Imaging for Remote Sensing Image

LI Qi,DONG Wende,XU Zhihai,FENG Huajun,CHEN Yueting

DOI: https://doi.org/10.3969/j.issn.1009-8518.2013.04.012

2013-01-01

Abstract:Most space optical imaging systems work in vibration environment,so optical axis motion and image plane jitter caused by the vibration result in motion blur of image,which is a serious impediment to high resolution imaging and high precision detection.Image deblur of space camera has two schemes to achieve motion blur suppression: the first is combination of real-time hardware detection and real-time hardware compensation,and the second is combination of real-time hardware detection and software restoration compensation.The paper proposes a dual mode imaging of space camera to obtain two images: the first image is an inadequate exposure motion blur-free image and the second image is a precise exposure blurred image.Using image processing tools,we can obtain motion path during exposure(blur kernel) from the two images,and restore the sharp image with the blur kernel as a priori knowledge.This method does not require compensation devices,detection devices and auxiliary detection optical path,and can automatically revise blur kernel during iterative processing.The method can be easily applied in the current space camera for remote sensing and has potential application value to improve remote sensing image quality.
Image Deblurring Method Based on Fourier Transform.

Ming Chen,Xiuyang Zhang,Mingkun Feng,Wei Xing

DOI: https://doi.org/10.1109/icsai48974.2019.9010430

2019-01-01

Abstract:Image blurring caused by motion and camera jitter is a common phenomenon nowadays, and blurring directly leads to the decline of image quality. The paper provides an image deblurring method based on Fourier transform. The method includes treating the blurring problem as an inverse problem. Firstly, the blurred image is preliminarily de-noised to remove part of the noise and improve the image quality. Then, the original clear image and the blur calculator are estimated respectively by double iteration method. The experimental results show that our method has good deblurring effect.
Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Chenwei Yang,Huajun Feng,Zhihai Xu,Yueting Chen,Qi Li

DOI: https://doi.org/10.1109/tip.2020.2973499

IF: 10.6

2020-01-01

IEEE Transactions on Image Processing

Abstract:Image blur caused by camera movement is common in long-exposure photography. A recent approach to address image blur is to record camera motion via inertial sensors in imaging equipment such as smartphones and single-lens reflex (SLR) cameras. However, because of device performance limitations, directly estimating a blur kernel from sensor data is infeasible. Previous works that have attempted to correct blurry image content via sensor data have also been susceptible to theoretical defects. Here, we propose a novel method of deblurring images that uses inertial sensors and a short-long-short (SLS) exposure strategy. Assisted short-exposure images captured before and after the formal long-exposure image are employed to correct the sensor data. A half-blind deconvolution algorithm is proposed to refine the estimated kernel. An extra smoothing filter is integrated into the framework to address the coarse initial kernel. Hence, we propose a fast solution for optimization that uses the iteratively reweighted least squares (IRLS) method in the frequency domain. We evaluate these methods via several blind deconvolutions. Quantitative indicators and the visual performance of the image deblurring results show that our method performs better than previous methods in terms of image quality restoration and computational time cost. This method will increase the feasibility of applying deblurring to imaging devices.
Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Jiang Shenyu,Xu Zhihai,Li Qi,Chen Yueting,Feng Huajun

DOI: https://doi.org/10.1117/12.2070620

2014-01-01

Abstract:A novel multi-exposure images fusion method for dynamic scenes is proposed. The commonly used techniques for high dynamic range (HDR) imaging are based on the combination of multiple differently exposed images of the same scene. The drawback of these methods is that ghosting artifacts will be introduced into the final HDR image if the scene is not static. In this paper, a super-pixel grouping based method is proposed to detect the ghost in the image sequences. We introduce the zero mean normalized cross correlation (ZNCC) as a measure of similarity between a given exposure image and the reference. The calculation of ZNCC is implemented in super-pixel level, and the super-pixels which have low correlation with the reference are excluded by adjusting the weight maps for fusion. Without any prior information on camera response function or exposure settings, the proposed method generates low dynamic range (LDR) images which can be shown on conventional display devices directly with details preserving and ghost effects reduced. Experimental results show that the proposed method generates high quality images which have less ghost artifacts and provide a better visual quality than previous approaches.
Restoration of the Image Blurred by Motion Based on High-speed CCD Motion Detection

Zhong-liang FU,Hua-jun FENG,Zhi-hai XU,Qi LI,Cheng-jun MAO

DOI: https://doi.org/10.3969/j.issn.1003-501X.2009.03.012

2009-01-01

Abstract:This paper provides a new method to restore the image blurred by any motion and a corresponding system for experiments is established. Previous restoration methods can only be useable when the motion is special, for example, uniform rectilinear motion, which is solved in the paper. During the integral time of prime CCD, a series of images used to compute the displacement, are captured by the low resolution white-black CCD. And then, the instantaneous speed can be computed. From the theoretic analysis, we know that the Point Spread Function (PSF) has corresponding relationship with the instantaneous speed. Then the PSF for restoring the blurred image can be worked out. Finally, the Richard-Lucy (RL) method is used to restore the blurred image. The experiment shows that, for any motion blurred images, this method for image restoration can get preferable results.
Method To Detect And Calculate Motion Blur Kernel

Jiagu G. Wu,Huajun Feng,Zhihai Xu,Qi Li,Zhongliang Fu

DOI: https://doi.org/10.1117/12.866645

2010-01-01

Abstract:Motion during camera's exposure time causes image blur, we call it motion blur. According to the linear system theory, if we can find the blur kernel which has the same meaning of point spread function, the blurred image can be restored by the blur kernel using iterative algorithms, such as R-L (Richardson-Lucy). Performance of the restoration is deeply depended on accuracy of the estimated blur kernel. In this paper we provide a novel method to detect and calculate the blur kernel. The process of kernel estimation can divide into two steps: The first step is detection of the motion path during the exposure time. A high-speed camera rigidly connected with the primary camera is used to capture a sequence of low resolution images, which contain information of camera position. While displacements of those images are detected, motion path can be drawn up. In the second step, blur kernel is calculated from the motion path by a novel model provided by this paper. Finally the blurred image captured by the primary camera can be restored by the kernel. We implement a hybrid imaging system for demonstration, and the experimental results prove the effectiveness of our method.
Research of diffraction effect in compressive sensing ghost imaging

Yi CHEN,Xiang FAN,Yu-bao CHENG,Zheng-dong CHENG,Zhen-yu LIANG

DOI: https://doi.org/10.3969/j.issn.1001-5078.2016.11.018

2016-01-01

Abstract:Compressive sensing ghost imaging has made great progress in recent years because it has the characteristics of less number of samples. Aiming at optical field distribution change in ghost imaging,the propagation process of light field was analyzed. The size of the lens makes the diffraction effect more obvious. The facula superposition makes actu-al light field become fuzzy and deviate from the preset value. The light intensity spread function of the diffraction limit-ed system was calculated and the preset light field was revised. However,the revised light field acting as observation matrix can still be reconstructed under the condition of mutual coherence. Experimental results indicate that the re-vised light field is similar to actual light field and observation matrix can reconstruct high-grade picture. So it is sig-nificant to revise preset light field by using light intensity spread function.
Robust ghost-free multiexposure fusion for dynamic scenes.

Meng Chang,Huajun Feng,Zhi-hai Xu,Qi Li

DOI: https://doi.org/10.1117/1.JEI.27.3.033023

IF: 0.829

2018-01-01

Journal of Electronic Imaging

Abstract:Ghosts always appear in the multiexposure fusion for dynamic scenes. Most of the existing deghosting methods require complicated and subjective parameter settings, easily resulting in many artifacts. A robust exposure fusion method that removes ghosts while preserving the details of the image is presented. The proposed method first detects the motion area by bidirectional intensity mapping and calculates the motion weight. Then, the latent images are generated by weighted optimization in gradient domain, and ghosts are removed automatically. After removing the ghosts, fusion weights are calculated using a patch-based fusion method, and exposure fusion is performed with details retained and outlier values suppressed. Experiments show that the proposed method can remove ghosts effectively, which demonstrates strong robustness to ghosts in a variety of circumstances. It also avoids influence from complicated and subjective parameter settings. (C) 2018 SPIE and IS&T
Image Deblurring by Motion Estimation for Remote Sensing

Yueting Chen,Jiagu Wu,Zhihai Xu,Qi Li,Huajun Feng

DOI: https://doi.org/10.1117/12.859988

2010-01-01

Abstract:The imagery resolution of imaging systems for remote sensing is often limited by image degradation resulting from unwanted motion disturbances of the platform during image exposures. Since the form of the platform vibration can be arbitrary, the lack of priori knowledge about the motion function (the PSF) suggests blind restoration approaches. A deblurring method which combines motion estimation and image deconvolution both for area-array and TDI remote sensing has been proposed in this paper. The image motion estimation is accomplished by an auxiliary high-speed detector and a sub-pixel correlation algorithm. The PSF is then reconstructed from estimated image motion vectors. Eventually, the clear image can be recovered by the Richardson-Lucy (RL) iterative deconvolution algorithm from the blurred image of the prime camera with the constructed PSF. The image deconvolution for the area-array detector is direct. While for the TDICCD detector, an integral distortion compensation step and a row-by-row deconvolution scheme are applied. Theoretical analyses and experimental results show that, the performance of the proposed concept is convincing. Blurred and distorted images can be properly recovered not only for visual observation, but also with significant objective evaluation increment.
High-Order Thermo-Optic Ghost Imaging for a Tangential Moving Target

Liang Zhenyu,Fan Xiang,Cheng Zhengdong,Zhu Bin,Shi Zhan

DOI: https://doi.org/10.3788/lop53.081102

2016-01-01

Laser & Optoelectronics Progress

Abstract:In order to investigate the impact of light field high-order correlation on the tangential moving target ghost imaging,high order background-subtracted ghost imaging theory can be applied.Some numerical simulations and experiments are carried out,and the relevant simulated images are obtained.In this study of tangential moving targets ghost imaging based on the high-order background-subtracted ghost imaging theory,the results show that the high-order correlation of the light field increases the background fluctuation noise when the reference beam order increases,and the quality of image reconstruction deteriorates.Moreover,the increase of the signal beam order has little effect on the image quality.So the best quality can be obtained by the lowest-order ghost imaging.
Motion Blurred Image Restoration Based on Hartmann-Shack Wavefront Sensor

Yuhua Yu,Wende Dong,Huajun Feng,Zhihai Xu,Qi Li

DOI: https://doi.org/10.1117/12.965307

2012-01-01

Abstract:When relative motion between the target and the camera occurs, the captured images would be blurred. Due to the arbitrariness of the motion, it is of great difficulty to restore the degraded images. In this paper, a new method based on Hartmann-Shack Wavefront Sensor is proposed to deblur the degraded image of the extended target caused by arbitrary motion. Relevant theoretical analysis is given and a corresponding experimental system is built. During the exposure time, image sequences are obtained by the Hartmann-Shack Wavefront Sensor to calculate the displacement vectors, from which the Point Spread Function (PSF) is estimated to restore the blurred image. Experimental results show that the proposed method can efficiently restore the degraded image of the target. So the application of Hartmann-Shack Wavefront Sensor can be extended to detect the motion of target, which means we can deal with wavefront distortion and motion blur using Hartmann-Shack Wavefront Sensor simultaneously.
The Influence of Intensity Correlation Order on Lensless Ghost Imaging

Zhenyu Liang,Xiang Fan,Zhengdong Cheng,Bin Zhu,Yi Chen

DOI: https://doi.org/10.1117/12.2266640

2017-01-01

Abstract:As a new imaging mechanism, ghost imaging has become a hot area of research in optical imaging field. In this paper, the effect of intensity correlation order on lensless ghost imaging system is investigated. We demonstrate that the image quality of Nth-order ghost imaging and Nth-order ghost imaging with background subtraction can be affected by the different intensity correlation order of test light and reference both theoretically and experimentally. The result indicates that the image quality will not be certainly increased with the increasing of the intensity correlation order, and here will be very useful for choosing an appropriate intensity correlation order in practice.
Beyond Camera Motion Removing: How to Handle Outliers in Deblurring

Chang Meng,Chenwei Yang,Huamin Feng,Zijian Xu,Qi Li

2020-01-01

Abstract:Performing camera motion deblurring is an important low-level vision task for achieving better imaging quality. When a scene has outliers such as saturated pixels and salt-and pepper noise, the image becomes more difficult to restore. In this paper, we propose an edge-aware scalerecurrent network (EASRN) to conduct camera motion deblurring. EASRN has a separate deblurring module that removes blur at multiple scales and an upsampling module that fuses different input scales. We propose a salient edge detection network to supervise the training process and solve the outlier problem by proposing a novel method of dataset generation. Light streaks are printed on the sharp image to simulate the cutoff effect from saturation. We evaluate our method on the GoPro dataset, Kohler's dataset and Lai's dataset. Both objective evaluation indexes and subjective visualization show that our method results in better deblurring quality than do other state-of-the-art approaches.
Computational Ghost Imaging Using a Dynamic Scattering Medium by the Point-by-Point Compensation Method

Hu Yangdi,Cheng Zhengdong,Liang Zhenyu,Zhai Xiang

DOI: https://doi.org/10.3788/lop57.201106

2020-01-01

Abstract:Computational ghost imaging (CGI) can easily penetrate a static scattering medium. However, when the scattering medium changes dynamically, the measured light intensity is subject to nonlinear changes caused by the medium; as a result, the light intensity of each measurement exhibits a drift, and the reconstructed image contains lot of noise due to the interference. To improve imaging results penetrating a dynamic scattering medium, this study proposes a method to correct the measured value of each point. In this method, patterns with the reflectivity of 1 arc added to a measurement matrix. The attenuation factor is obtained at each time by recording the change of light intensity after projecting the pattern, and the compensation coefficient at the middle time is calculated. According to the compensation coefficient, the light intensity distortion caused by the change of the medium's attenuation factor is corrected for each point, and finally, the transformed values arc restored and calculated. The reconstruction results show that the proposed method can effectively deal with the aforementioned noise problem of the CGI technology encountered while penetrating a dynamic scattering medium.
Ghost Imaging with N-order Speckle Light

Yi Chen,Zhengdong Cheng,Yubao Cheng,Bin Zhu,Xiang Zhai

DOI: https://doi.org/10.1117/1.oe.57.7.073111

IF: 1.3

2018-01-01

Optical Engineering

Abstract:Ghost imaging is an indirect system that allows the imaging of an object without directly seeing the object. The speckle pattern that contains the information about light and objects has increasingly become a popular topic in pseudothermal light ghost imaging. However, existing research still has encountered problems of poor imaging quality and slow sampling speeds. We propose a ghost imaging method based on N-order speckle patterns to recover the object (NSGI). The N-order speckle patterns combine N independent laser speckles individually produced by passing an expanded and collimated He-Ne laser through a digital micro-mirror device (DMD). The sampling frequency can be improved by controlling the trigger signals of different DMDs. The results of the simulation and experiment have verified that our method can increase sampling speed and reconstruction accuracy. In addition, NSGI can be applied to more applications by designing multiple independent speckles with different properties. (C) 2018 Society of Photo-Optical Instrumentation Engineers (SPIE).
Improving the Image Quality of Ghost Imaging Based on Wiener Filtering

Dongyue Yang,Junhui Li,Chen Chang,Guohua Wu,Bin Luo,Longfei Yin,Hong Guo

DOI: https://doi.org/10.1364/fio.2018.jw3a.127

2018-01-01

Abstract:In ghost imaging with pseudo-thermal light, Wiener filter improves reconstructed image quality with the estimation of point spread function and a noise factor, which is well-fitted as proportional relation to noise amplitude in image.
Optimizations of Canny Edge Detection in Ghost Imaging

Guohua Wu,Dongyue Yang,Chen Chang,Longfei Yin,Bin Luo,Hong Guo

DOI: https://doi.org/10.3938/jkps.75.223

2019-01-01

Journal of the Korean Physical Society

Abstract:An optimization of the Canny edge detector’s application in ghost imaging is presented. Based on the pseudo-thermal light ghost imaging scheme with a binary object, a thin and accurate edge map can be extracted by using a Gaussian-filtering-optimized Canny edge detector. The scale of the Gaussian filter in Canny edge detection algorithm is the dominate factor in the performance of the edge detector, and can be evaluated by the bit error rate of reconstructed binary image based on the edge map. Simulation results indicate the optimal window size of Gaussian filter for ghost imaging is proportional to the full width at half maximum of the self-correlation function in the idler arm samples without any priori knowledge of the object. Experimental results show that, with an appropriate Gaussian filter, the reconstructed binary image can approach the original binary object with the minimum bit error rate, which means the edge detection result is optimal.
Visual Salience And Stack Extension Based Ghost Removal For High-Dynamic-Range Imaging

Zijie Wang,Qin Liu,Takeshi Ikenaga

DOI: https://doi.org/10.1109/ICIP.2017.8296681

2017-01-01

Abstract:High-dynamic-range imaging (HDRI) techniques are proposed to extend the dynamic range of captured images against sensor limitation. The key issue of multi-exposure fusion in HDRI is removing ghost artifacts caused by motion of moving objects and handheld cameras. This paper proposes a ghost-free HDRI algorithm based on visual salience and stack extension. To improve the accuracy of ghost areas detection, visual salience based bilateral motion detection is introduced to measure image differences. For exposure fusion, the proposed algorithm reduces brightness discontinuity and enhances details by stack extension, and rejects the information of ghost areas to avoid artifacts via fusion masks. Experiment results show that the proposed algorithm can remove ghost artifacts accurately for both static and handheld cameras, remain robust to scenes with complex motion and keep low complexity over recent advances including patch based method and rank minimization based method by 20.4% and 63.6% time savings on average.
Hanbury Brown–Twiss Effect and Thermal Light Ghost Imaging: A Unified Approach

Li-Gang Wang,Sajid Qamar,Shi-Yao Zhu,M. Suhail Zubairy

DOI: https://doi.org/10.1103/physreva.79.033835

IF: 2.971

2009-01-01

Physical Review A

Abstract:We compare the Hanbury Brown-Twiss (HBT) and the thermal light ghost imaging schemes in both near and far fields. Both effects arise as a result of the intensity fluctuations of the thermal light and we find that the essential physics behind the two effects is the same. The difference however is that, in the ghost imaging, large number of bits information of an object needs to be treated together, whereas, in the HBT, there is only one bit information required to be obtained. In the HBT experiment far field is used for the purpose of easy detection, while in the ghost image experiment near (or not far) field is used for good quality image.
Enhancing image quality of ghost imaging by fuzzy c-means clustering method

Yang Zhou,Tian Zhang,Fei Zhong,Shuxu Guo

DOI: https://doi.org/10.1063/1.5079681

IF: 1.697

2019-07-01

AIP Advances

Abstract:We presented a novel ghost imaging scheme based on fuzzy c-means clustering (FCM) to reduce measurements and improve the visibility of the reconstruction image. Different from the GI methods, the FCM model is first employed to partition the intensity values of the reference light path and probe light path. Then, the relative speckle patterns and bucket intensity values are selected with respect to the clustering results. Finally, the object can be obtained by conventional GI methods. From the considerable simulations and experimental results, we conclude that the proposed scheme can enhance the visibility of the reconstruction image by using much fewer data from measurements compared with the existing GI methods.

materials science, multidisciplinary,physics, applied,nanoscience & nanotechnology

Reducing Motion Blur in Ghost Imaging with Hessian Enhancement Filter

Motion Blur Suppression Method Based on Dual Mode Imaging for Remote Sensing Image

Image Deblurring Method Based on Fourier Transform.

Image Deblurring Utilizing Inertial Sensors and a Short-Long-Short Exposure Strategy.

Ghost Detection And Removal Based On Super-Pixel Grouping In Exposure Fusion

Restoration of the Image Blurred by Motion Based on High-speed CCD Motion Detection

Method To Detect And Calculate Motion Blur Kernel

Research of diffraction effect in compressive sensing ghost imaging

Robust ghost-free multiexposure fusion for dynamic scenes.

Image Deblurring by Motion Estimation for Remote Sensing

High-Order Thermo-Optic Ghost Imaging for a Tangential Moving Target

Motion Blurred Image Restoration Based on Hartmann-Shack Wavefront Sensor

The Influence of Intensity Correlation Order on Lensless Ghost Imaging

Beyond Camera Motion Removing: How to Handle Outliers in Deblurring

Computational Ghost Imaging Using a Dynamic Scattering Medium by the Point-by-Point Compensation Method

Ghost Imaging with N-order Speckle Light

Improving the Image Quality of Ghost Imaging Based on Wiener Filtering

Optimizations of Canny Edge Detection in Ghost Imaging

Visual Salience And Stack Extension Based Ghost Removal For High-Dynamic-Range Imaging

Hanbury Brown–Twiss Effect and Thermal Light Ghost Imaging: A Unified Approach

Enhancing image quality of ghost imaging by fuzzy c-means clustering method