Defogging imaging using second-order correlations in the time domain

Deyang Duan,Yuge Li,Yunjie Xia

DOI: https://doi.org/10.1364/oe.542761

IF: 3.8

2024-11-29

Optics Express

Abstract:Deyang Duan, Yuge Li, Yunjie Xia The traditional space-domain McCartney model simplifies fog as a time-invariant medium, as the fluctuation of light field introduced by ... [Opt. Express 32, 45231-45240 (2024)]

optics

What problem does this paper attempt to address?

Quantum defogging: temporal photon number fluctuation correlation in time-variant fog scattering medium

Deyang Duan,Yuge Li,Yunjie Xia

2023-06-06

Abstract:The conventional McCartney model simplifies fog as a scattering medium with space-time invariance, as the time-variant nature of fog is a pure noise for classical optical imaging. In this letter, an opposite finding to traditional idea is reported. The time parameter is incorporated into the McCartney model to account for photon number fluctuation introduced by time-variant fog. We demonstrated that the randomness of ambient photons in the time domain results in the absence of a stable correlation, while the scattering photons are the opposite. This difference can be measured by photon number fluctuation correlation when two conditions are met. A defogging image is reconstructed from the target's information carried by scattering light. Thus, the noise introduced by time-variant fog is eliminated by itself. Distinguishable images can be obtained even when the target is indistinguishable by conventional cameras, providing a prerequisite for subsequent high-level computer vision tasks.

Quantum Physics,Optics
The spatial correlation problem of noise in imaging deblurring and its solution.

Chenwei Yang,Huajun Feng,Zhihai Xu,Qi Li,Yue-ting Chen

DOI: https://doi.org/10.1016/j.jvcir.2018.09.013

IF: 2.887

2018-01-01

Journal of Visual Communication and Image Representation

Abstract:•The spatial correlation problem of noise in colour digital images and its causes.•A new noise model to revise the existing deconvolution algorithm.•Well performance in deblurring experiments with the proposed model.
Multispectral Image Out-of-Focus Deblurring Using Interchannel Correlation.

Shu-Jie Chen,Hui-Liang Shen

DOI: https://doi.org/10.1109/TIP.2015.2465162

2015-01-01

Abstract:Out-of-focus blur occurs frequently in multispectral imaging systems when the camera is well focused at a specific (reference) imaging channel. As the effective focal lengths of the lens are wavelength dependent, the blurriness levels of the images at individual channels are different. This paper proposes a multispectral image deblurring framework to restore out-of-focus spectral images based on the characteristic of interchannel correlation (ICC). The ICC is investigated based on the fact that a high-dimensional color spectrum can be linearly approximated using rather a few number of intrinsic spectra. In the method, the spectral images are classified into an out-of-focus set and a well-focused set via blurriness computation. For each out-of-focus image, a guiding image is derived from the well-focused spectral images and is used as the image prior in the deblurring framework. The out-of-focus blur is modeled as a Gaussian point spread function, which is further employed as the blur kernel prior. The regularization parameters in the image deblurring framework are determined using generalized cross validation, and thus the proposed method does not need any parameter tuning. The experimental results validate that the method performs well on multispectral image deblurring and outperforms the state of the arts.
Mean Square Convergence Unbiased Estimation of Thermal Light Correlated Imaging

Shi Zhan,Fan Xiang,Cheng Zhengdong,Zhu Bin,Zhang Hongwei

DOI: https://doi.org/10.3788/irla201645.0424003

2016-01-01

Abstract:The theory that light can transmit information in a unique way has been proved by the experiment and theory of correlated imaging. In this paper, the principles of correlated imaging were discussed in semi-classical interpretations. In the view of pseudo-thermal light field, photoelectric detection and correlated computation, the imaging process was analyzed. Field of view, spatial resolution and contrast of the system were given. On this basis, the traditional linear correlation algorithm was improved to make the ghost image a mean square convergence unbiased estimation of the object transmission function. The corresponding computational ghost imaging experiment measurement indicates that under the same number, especially less than the Nyquist frequency, the PSNR is significantly improved and background noise is effectively suppressed compared with the traditional algorithm.
High-Order Thermo-Optic Ghost Imaging for a Tangential Moving Target

Liang Zhenyu,Fan Xiang,Cheng Zhengdong,Zhu Bin,Shi Zhan

DOI: https://doi.org/10.3788/lop53.081102

2016-01-01

Laser & Optoelectronics Progress

Abstract:In order to investigate the impact of light field high-order correlation on the tangential moving target ghost imaging,high order background-subtracted ghost imaging theory can be applied.Some numerical simulations and experiments are carried out,and the relevant simulated images are obtained.In this study of tangential moving targets ghost imaging based on the high-order background-subtracted ghost imaging theory,the results show that the high-order correlation of the light field increases the background fluctuation noise when the reference beam order increases,and the quality of image reconstruction deteriorates.Moreover,the increase of the signal beam order has little effect on the image quality.So the best quality can be obtained by the lowest-order ghost imaging.
Quantum image rain removal: second-order photon number fluctuation correlations in the time domain

Yuge Li,Yunjie Xia,Deyang Duan

2023-07-13

Abstract:Falling raindrops are usually considered purely negative factors for traditional optical imaging because they generate not only rain streaks but also rain fog, resulting in a decrease in the visual quality of images. However, this work demonstrates that the image degradation caused by falling raindrops can be eliminated by the raindrops themselves. The temporal second-order correlation properties of the photon number fluctuation introduced by falling raindrops has a remarkable attribute: the rain streak photons and rain fog photons result in the absence of a stable second-order photon number correlation, while this stable correlation exists for photons that do not interact with raindrops. This fundamental difference indicates that the noise caused by falling raindrops can be eliminated by measuring the second-order photon number fluctuation correlation in the time domain. The simulation and experimental results demonstrate that the rain removal effect of this method is even better than that of deep learning methods when the integration time of each measurement event is short. This high-efficient quantum rain removal method can be used independently or integrated into deep learning algorithms to provide front-end processing and high-quality materials for deep learning.

Quantum Physics,Optics
Addressing the constraints of turbulence-free ghost imaging using photon number fluctuation correlations in the time domain

Deyang Duan,Qiang Gao,Yunjie Xia

DOI: https://doi.org/10.1063/5.0185836

IF: 4

2023-01-01

Applied Physics Letters

Abstract:Turbulence-free ghost imaging is a promising solution for the degraded image caused by atmospheric turbulence. However, turbulence-free ghost imaging requires two harsh conditions. To solve this problem, the temporal statistical property of the photon number fluctuations introduced by space-time fluctuating atmospheric turbulence is investigated. We find that the photons collected by the detectors is a superposition of the fluctuating photons introduced by space-time fluctuating atmospheric turbulence and the nonfluctuating photons with probabilities inversely proportional to the beam diameter. The fluctuating photons, which cause image degradation, lead to the absence of stable temporal photon number correlations, while the nonfluctuating photons have the opposite effect. Thus, fluctuating photons are eliminated by measuring the temporal correlations of the signal light and reference light separately. The results show that turbulence-free ghost images can be reconstructed even if the typical conditions are not met. This work does not negate the results of Meyers et al. and provides a method to address the harsh constraints of turbulence-free ghost imaging.
Image defogging:a survey

Jing Yu,Dongbin Xu,Qingmin Liao

2011-01-01

Journal of Image and Graphics

Abstract:Imaging in the atmosphere is often degraded by scattering due to atmospheric particles such as haze,fog and mist.The task of visibility enhancement techniques is to correct for the loss of contrast and color fidelity,which can lead to large improvement in image quality.In this paper,we present a review on established approaches for visibility enhancement of images taken under foggy and hazy conditions.These approaches are grouped into two categories,namely,physics based and non physics based.We illustrate them in detail and then characterize their strengths and limitations,respectively. Additionally,some reference-free objective quality metrics are provided for quantifying the performance related to contrast and chromatic diversity.Finally,further discussions are pointed out on technical challenges and future development.
Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Yuki Fujimura,Motoharu Sonogashira,Masaaki Iiyama

DOI: https://doi.org/10.48550/arXiv.1904.00558

2019-04-01

Abstract:Three-dimensional (3D) reconstruction and scene depth estimation from 2-dimensional (2D) images are major tasks in computer vision. However, using conventional 3D reconstruction techniques gets challenging in participating media such as murky water, fog, or smoke. We have developed a method that uses a time-of-flight (ToF) camera to estimate an object region and depth in participating media simultaneously. The scattering component is saturated, so it does not depend on the scene depth, and received signals bouncing off distant points are negligible due to light attenuation in the participating media, so the observation of such a point contains only a scattering component. These phenomena enable us to estimate the scattering component in an object region from a background that only contains the scattering component. The problem is formulated as robust estimation where the object region is regarded as outliers, and it enables the simultaneous estimation of an object region and depth on the basis of an iteratively reweighted least squares (IRLS) optimization scheme. We demonstrate the effectiveness of the proposed method using captured images from a Kinect v2 in real foggy scenes and evaluate the applicability with synthesized data.

Computer Vision and Pattern Recognition
Optical velocimeter by second order correlation

Yaji Suo,Yaming Feng,Da-xiao Xu,Wenjie Wan

DOI: https://doi.org/10.1088/1555-6611/aa6e7f

IF: 1.2

2017-01-01

Laser Physics

Abstract:Motional information can be buried inside the temporal statistics of scattering light. Here we explore the second order correlation of scattering light to trace back the transverse velocity of objects, verifying the inverse relationship between the coherence time and the velocity. Based on this principle, a new type of optical velocimeter is demonstrated, which has been further applied to study the fluid flow inside a microfluidic channel. This new noninvasive and easy-to-implement velocimeter may offer a new avenue in many applications.
Resolution-enhanced Imaging Through Scattering Media by High-Order Correlation

Yuehan Liu,Lei Chen,Wei Liu,Xiaogan Liang,Wenjie Wan

DOI: https://doi.org/10.1364/ao.58.002350

IF: 1.9

2019-01-01

Applied Optics

Abstract:Super-resolution optical imaging is a rapidly emerging technology enabling many applications. Recently, correlation imaging has shown its capability in imaging beyond the diffraction limit, relying on quantum and statistical properties of light. High-order correlation imaging can further enhance resolution, however, at the expense of complicated algorithms. Here, we experimentally demonstrate a resolution-enhanced method of imaging through scattering media by exploiting high-order correlation of fluorescence light. Based on this method, individual fluorophores' temporal fluctuations are recorded and computed for their distinguished high-order correlations that enable super-resolution. Special designed time sequences are chosen to reduce computation time and memory. Such high-order correlation imaging exhibits reliable performance through scattering media with significant resolution enhancement and background noise reduction. This efficient imaging method paves the way for new biomedical applications.
High-order Correlation of Non-Rayleigh Speckle Fields and Its Application in Super-Resolution Imaging

Suzhen Zhang,Wei Wang,Rong Yu,Xiaoxue Yang

DOI: https://doi.org/10.1088/1054-660x/26/5/055007

IF: 1.2

2016-01-01

Laser Physics

Abstract:Classical correlation of Rayleigh speckle fields E(x) can only mimic second-order correlation in quantum imaging. Here, we propose a method to explore the high-order correlation of non-Rayleigh speckle fields EN(x) which shows a totally different property from the Rayleigh speckle fields. As a specific example, we illustrate and analyze in detail the third-order speckle scanning imaging which overcomes the diffraction barrier by a factor of 3. The influences of diffractions in the illumination path and the detection path are also discussed. This investigation may pave the way for applications in super-resolution imaging.
Analyses and Applications of the Second-Order Cross Correlation in the Passive Imaging

Lingdi Wang,Wenbin Chen,Jin Cheng

DOI: https://doi.org/10.4208/cicp.scpde14.26s

IF: 3.791

2016-01-01

Communications in Computational Physics

Abstract:The first-order cross correlation and corresponding applications in the passive imaging are deeply studied by Gamier and Papanicolaou in their pioneer works. In this paper, the results of the first-order cross correlation are generalized to the second-order cross correlation. The second-order cross correlation is proven to be a statistically stable quantity, with respective to the random ambient noise sources. Specially, with proper time scales, the stochastic fluctuation for the second-order cross correlation converges much faster than the first-order one. Indeed, the convergent rate is of order O(T (1 vertical bar alpha)), with 0 < alpha < 1. Besides, by using the stationary phase method in both homogeneous and scattering medium, similar behaviors of the singular components for the second-order cross correlation are obtained. Finally, two imaging methods are proposed to search for a target point reflector: One method is based on the imaging function, and has a better signal-to-noise rate; Another method is based on the geometric property, and can improve the bad range resolution of the imaging results.
Multispectral image defogging based on a wavelength-dependent extinction coefficient model in fog

Feng Huang,Chaozhen Ke,Xianyu Wu,Cuixia Guo,Yu Liu

DOI: https://doi.org/10.1364/JOSAA.511058

2024-04-01

Abstract:Most of the state-of-the-art defogging models presented in the literature assume that the attenuation coefficient of all spectral channels is constant, which inevitably leads to spectral distortion and information bias. To address this issue, this paper proposes a defogging method that takes into account the difference between the extinction coefficients of multispectral channels of light traveling through fog. Then the spatially distributed transmission map of each spectral channel is reconstructed to restore the fog-degraded images. The experimental results of various realistic complex scenes show that the proposed method has more outstanding advantages in restoring lost detail, compensating for degraded spectral information, and recognizing more targets hidden in uniform ground fog than state-of-the-art technologies. In addition, this work provides a method to characterize the intrinsic property of fog expressed as multispectral relative extinction coefficients, which act as a fundament for further reconstruction of multispectral information.
Characterization of Defocused Coherent Imaging Systems with Periodic Objects

Gianlorenzo Massaro,Milena D'Angelo

DOI: https://doi.org/10.3390/s24216885

IF: 3.9

2024-10-26

Sensors

Abstract:Recent advancements in quantum and quantum-inspired imaging techniques have enabled high-resolution 3D imaging through photon correlations. These techniques exhibit reduced degradation of image resolution for out-of-focus samples compared to conventional methods (i.e., intensity-based incoherent imaging). A key advantage of these correlation-based approaches is their independence from the system numerical aperture (NA). Interestingly, both improved resolution of defocused images and NA-independent scaling are linked to the spatial coherence of light. This suggests that while correlation measurements exploit spatial coherence, they are not essential for achieving this imaging advantage. This discovery has led to the development of optical systems that achieve similar performance by using spatially coherent illumination and relying on intensity measurements: direct 3D imaging with NA-independent resolution was recently demonstrated in a correlation-free setup using LED light. Here, we explore the physics behind the enhanced performance of defocused coherent imaging, showing that it arises from the modification of the sample's spatial harmonic content due to diffraction, unlike the blurring seen in conventional imaging. The results we present are crucial for understanding the implications of the physical differences between coherent and incoherent imaging, and are expected to pave the way for the practical application of the discovered phenomena.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation
Fast single image defogging algorithm

LI Fang,WANG Hao-xian,MAO Xing-peng,SUN Yun-lei,SONG Hui-yao

DOI: https://doi.org/10.16208/j.issn1000-7024.2011.12.056

2011-01-01

Abstract:In order to improve the visual quality of fog-degraded images,a new fast defogging algorithm is proposed taking the imaging model and the dark channel prior into consideration.Firstly,the atmospheric parameter is estimated by using dark channel prior,after that,some pixels matching conditions are selected uniformly from the image to estimate their transmittances,then,based on the attained transmittances,a multi-linear regression equation is obtained,thus,the other transmittances are computed,finally a fog-free image is obtained naturally.In this way,the computational complexity is reduced significantly,compared with the traditional single image defogging methods,the results show that the algorithm has advantages of fast and high effectiveness.
Single Image Defogging with Single and Multiple Hybrid Scattering Model

Weijiang Feng,Naiyang Guan,Xiang Zhang,Xuhui Huang,Zhigang Luo

DOI: https://doi.org/10.1109/spac.2014.6982693

2014-01-01

Abstract:Image defogging (IDF) removes influences of fogs from an image to improve its quality. Since defogged images can significantly boost the performance of subsequent processing, IDF has attracted many attentions from the computer vision community. However, existing IDF algorithms are built on the assumption that light is scattered once by a grain. Since such assumption is violated if images are contaminated by dense haze or heavy fog, traditional IDF algorithms often fail in this situation. In this paper, we propose a hybrid image defogging (HIDF) algorithm to overcome this deficiency. In particular, HIDF applies the single scattering physics model (SSPM) to pixels dominated by single scattering of light, and applies the multiple scattering physics model (MSPM) to remaining pixels. To distinguish two types of pixels, HIDF utilizes the optical thickness of corresponding pixels. If optical thickness is smaller than a threshold that determines whether the single scattering or the multiple scattering dominates, HIDF applies the SSPM, and HIDF applies the MSPM otherwise. Experimental results on several popular foggy images demonstrate that HIDF competes with the state-of-the-art algorithms, and show the promise of HIDF for defogging heavily foggy images.
Based on single image defogging algorithm

Yunfei Du,Yimin Tian,Hongmei Chen,Saisai Zhang

DOI: https://doi.org/10.1117/12.2660792

2023-02-02

Abstract:The atmosphere contains many tiny, suspended particles, and due to the scattering and absorption of these particles, images can show reduced visibility, distorted colors’, blurred details and other situations. Many computer vision applications are unable to accept these degraded images and therefore require high quality input images to ensure accurate work, provided by a defogging method. Single image deblurring utilizes physical models where transmission estimation is an important parameter in obtaining a fog-free image. The fog image is analyzed and pre-processed to highlight details and make it more suitable for human and machine recognition. The analysis of different deblurring methods divides them mainly into methods based on image a priori recovery, image enhancement and deep learning. The content of defogging-related algorithms is described, and future directions are analyzed.

Computer Science,Environmental Science,Engineering
A Survey Based on Image Defogging

Nicolas,Hautière,Jean-Philippe TarelDidier Aubert,Kaiming He,Jian Sun,Xiaoou Tang,Sarit Shwartz,Einav Namer,Srinivasa G. Narasimhan,Shree K. Nayar,Qingsong Zhu,Jiaming Mai

2017-01-01

Abstract:Defogging in visibility is often introduced to images captured in poor weather conditions, such as haze, rain, fog, pollutants particles. To remove haze, and other pollutants from the image many algorithm are used, here mainly used is Gaussian -based dark channel. The Gaussian –based dark channel method improves is used to improve the light source in the image. All the images taken in a poor weather has a flickering effect, to remove flickering effect a flicker free module is formulated. So overall the image is enhanced toget aquality image.
Correlating light fields through disordered media across multiple degrees of freedom

Louisiane Devaud,Bernhard Rauer,Simon Mauras,Stefan Rotter,Sylvain Gigan

DOI: https://doi.org/10.1103/PhysRevResearch.6.033265

2024-09-17

Abstract:Speckle patterns are inherent features of coherent light propagation through complex media. As a result of interference, they are sensitive to multiple experimental parameters such as the configuration of disorder or the propagating wavelength. Recent developments in wavefront shaping have made it possible to control speckle pattern statistics and correlations, for example using the concept of the transmission matrix. In this article, we address the problem of correlating scattered fields across multiple degrees of freedom. We highlight the common points between the specific techniques already demonstrated, and we propose a general framework based on the singular value decomposition of a linear combination of multiple transmission matrices. Following analytical predictions, we experimentally illustrate the technique on spectral and temporal correlations, and we show that both the amplitude and the phase of the field correlations can be tuned. Our work opens up new perspectives in speckle correlation manipulation, with potential applications in coherent control.

Optics,Disordered Systems and Neural Networks

Defogging imaging using second-order correlations in the time domain

Quantum defogging: temporal photon number fluctuation correlation in time-variant fog scattering medium

The spatial correlation problem of noise in imaging deblurring and its solution.

Multispectral Image Out-of-Focus Deblurring Using Interchannel Correlation.

Mean Square Convergence Unbiased Estimation of Thermal Light Correlated Imaging

High-Order Thermo-Optic Ghost Imaging for a Tangential Moving Target

Quantum image rain removal: second-order photon number fluctuation correlations in the time domain

Addressing the constraints of turbulence-free ghost imaging using photon number fluctuation correlations in the time domain

Image defogging:a survey

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

Optical velocimeter by second order correlation

Resolution-enhanced Imaging Through Scattering Media by High-Order Correlation

High-order Correlation of Non-Rayleigh Speckle Fields and Its Application in Super-Resolution Imaging

Analyses and Applications of the Second-Order Cross Correlation in the Passive Imaging

Multispectral image defogging based on a wavelength-dependent extinction coefficient model in fog

Characterization of Defocused Coherent Imaging Systems with Periodic Objects

Fast single image defogging algorithm

Single Image Defogging with Single and Multiple Hybrid Scattering Model

Based on single image defogging algorithm

A Survey Based on Image Defogging

Correlating light fields through disordered media across multiple degrees of freedom