Time-gated imaging through dense fog via physics-driven Swin transformer

Shaohui Jin,Ziqin Xu,Mingliang Xu,Hao Liu

DOI: https://doi.org/10.1364/oe.519662

IF: 3.8

2024-05-08

Optics Express

Abstract:Shaohui Jin, Ziqin Xu, Mingliang Xu, Hao Liu Imaging through the fog is valuable for many areas, such as autonomous driving and cosmic exploration. However, due to the influence of ... [Opt. Express 32, 18812-18830 (2024)]

optics

What problem does this paper attempt to address?

Passive imaging through dense scattering media

Yaoming Bian,Fei Wang,Yuanzhe Wang,Zhenfeng Fu,Haishan Liu,Haiming Yuan,Guohai Situ

DOI: https://doi.org/10.1364/prj.503451

IF: 7.6

2023-12-22

Photonics Research

Abstract:Yaoming Bian, Fei Wang, Yuanzhe Wang, Zhenfeng Fu, Haishan Liu, Haiming Yuan, Guohai Situ Imaging through non-static and optically thick scattering media such as dense fog, heavy smoke, and turbid water is crucial in various ... [Photon. Res. 12, 134-140 (2024)]

optics
Off-axis spatiotemporally gated multimode detection toward deep fog imaging

Zijing Guo,Chuan Li,Tao Zhou,Boyu Chen,Meng Cui

DOI: https://doi.org/10.1364/OE.27.033326

2019-11-11

Abstract:Towards better imaging through fog for vehicles, we developed an off-axis spatiotemporally gated multimode laser scanning imaging system. Utilizing fog mimicking liquid suspension, we tested the imaging system with different levels of scattering. The experimental results suggest that the system can yield high quality images at seven scattering path lengths, which far exceeds the capability of conventional imaging systems. We also found that the multimode detection can not only make the system robust in the presence of aberration but also help to reduce the speckles in images for the case of coherent illumination.
Time-of-flight based imaging in strong scattering underwater environments

Xin Jin,Dongyu Du,Jiawei Jin,Yihui Fan

DOI: https://doi.org/10.1364/oe.534170

IF: 3.8

2024-10-03

Optics Express

Abstract:Xin Jin, Dongyu Du, Jiawei Jin, Yihui Fan Time-of-flight (TOF) based underwater imaging is of great importance in practical applications due to its high image quality. Existing ... [Opt. Express 32, 37247-37259 (2024)]

optics
Active imaging through dense fog by utilizing the joint polarization defogging and denoising optimization based on range-gated detection

Feng Huang,Shaoping Qiu,Hao Liu,Yu Liu,Pengfei Wang

DOI: https://doi.org/10.1364/OE.491831

2023-07-31

Abstract:Imaging through the scattering medium, such as fog, is important for military and civilian applications. However, the fog concentration restricts the current defogging methods; the image will be seriously degraded in dense fog scenes. Here, an imaging technique by developing joint active polarization defogging and denoising optimization methods based on range-gated detection is proposed for the target in fog conditions. The range-gated imaging method shields the scattering light from outside the selected region to improve the signal intensity. The properties of signal light, backscattering light, and forward scattering light in the range-gated imaging way are analyzed experimentally and theoretically. Thus the elimination method of backscattering light is developed in terms of polarization differences in the degree of polarization and angle of polarization, and the block-matching with 3D transform-domain collaborative filtering (BM3D) algorithm is developed to remove the effect of the forward scattering light on the image. By adopting the proposed defogging method, the clear imaging of the target under fog with an optical thickness of up to 5 is realized, and the target contour and detail information are successfully recovered. Compared with the complete failure of the current defogging method, this method can recover targets with high contrast and signal-to-noise ratio in dense fog scenes, which exhibits widespread application potential for target detection and recognition in severe weather and turbid underwater environment.
Fast Optical High-Resolution Imaging Through Scattering Medium Based on Virtual Synthetic Aperture Model

Kai Qiao,Xiaorui Tian,Xiaojie Shi,Jie Yang,Meng Tang,Siqi Zhang,Chenfei Jin

DOI: https://doi.org/10.1016/j.optlastec.2024.111742

IF: 4.939

2024-01-01

Optics & Laser Technology

Abstract:High resolution real-time optical imaging through macro-scale scattering medium is challenging in applications. Based on prior spatiotemporal characteristics, existing methods have improved the imaging performance of simple scattering scenarios. Here, we introduce a virtual synthetic aperture model (VSAM) into optical scattering imaging, which focuses on real-time imaging with high resolution and robustness. Our experiments are conducted under the complex scenarios: imaging static or moving targets through acrylic plates or fog. Even though the exposure time is 0.488ms/pixel and average photon counts are less than 4, the proposed method can successfully reconstruct the target located at 1.5m away from acrylic plates or moving with 1m/s. Furthermore, for the fog with one-way optical thickness greater than 6.5 and spatial thickness similar to 50cm, our method is also applicable. The experiments indicate that the proposed method without prior knowledge outperforms the related methods in terms of resolution and scene robustness, which significantly benefits its application.
Three-dimensional Single-Photon Imaging Through Realistic Fog in an Outdoor Environment During the Day

Yinbo Zhang,Sining LI,Jianfeng Sun,Xin Zhang,Di Liu,Xin Zhou,Haoyang LI,Yue Hou

DOI: https://doi.org/10.1364/oe.464297

IF: 3.8

2022-01-01

Optics Express

Abstract:Due to the strong scattering of fog and the strong background noise, the signal-to-background ratio (SBR) is extremely low, which severely limits the 3D imaging capability of single-photon detector array through fog. Here, we propose an outdoor three-dimensional imaging algorithm through fog, which can separate signal photons from non-signal photons (scattering and noise photons) with SBR as low as 0.003. This is achieved by using the observation model based on multinomial distribution to compensate for the pile-up, and using dual-Gamma estimation to eliminate non-signal photons. We show that the proposed algorithm enables accurate 3D imaging of 1.4 km in the visibility of 1.7 km. Compared with the traditional algorithms, the target recovery (TR) of the reconstructed image is improved by 20.5%, and the relative average ranging error (RARE) is reduced by 28.2%. It has been successfully demonstrated for targets at different distances and imaging times. This research successfully expands the fog scattering estimation model from indoor to outdoor environment, and improves the weather adaptability of the single-photon detector array.
Towards Real-Time Through-Obstacle Imaging Based on Compressed Sensing for Sparse Objects

Tianyi Zhou,Fazhong Shen,Qingyang Meng,Huan Li,Kuiwen Xu,Dexin Ye,Jiangtao Huangfu,Shiwei Dong,Tayeb Ahmed Denidni,Lixin Ran

DOI: https://doi.org/10.1049/iet-map.2019.0238

2019-01-01

Abstract:Although significant progress has been made in microwave imaging, real-time imaging, especially for objects behind walls or closed obstacles, remains a technical challenge. In this work, highly efficient imaging for complex-structured objects surrounded by a closed obstacle was experimentally demonstrated. The imaging equations are derived based on a combination of the inverse-scattering problem and the concept of compressed sensing. Making use of the spatial sparsity of objects and obstacles, the compressed imaging can be implemented using a time-division multi-antenna setup with reduced transmitting antennas. Owing to the spatial compressed sensing applied to the sparse imaging region and objects, the imaging time can be reduced by two orders of magnitude compared with the conventional twofold subspace-based optimisation method with a comparable imaging quality. Taking advantage of the sparsity of the entire imaging area, objects with larger relative permittivity can also be reconstructed. The proposed method can be potentially used in applications such as security examination through boxes. It also provides a new clue for solving the practicability difficulty faced by existing microwave imaging systems.
Harnessing Optical Imaging Limit through Atmospheric Scattering Media

Libang Chen,Jun Yang,Lingye Chen,Yuyang Shui,Yikun Liu,Jianying Zhou

2024-04-23

Abstract:Recording and identifying faint objects through atmospheric scattering media by an optical system are fundamentally interesting and technologically important. In this work, we introduce a comprehensive model that incorporates contributions from target characteristics, atmospheric effects, imaging system, digital processing, and visual perception to assess the ultimate perceptible limit of geometrical imaging, specifically the angular resolution at the boundary of visible distance. The model allows to reevaluate the effectiveness of conventional imaging recording, processing, and perception and to analyze the limiting factors that constrain image recognition capabilities in atmospheric media. The simulations were compared with the experimental results measured in a fog chamber and outdoor settings. The results reveal general good agreement between analysis and experimental, pointing out the way to harnessing the physical limit for optical imaging in scattering media. An immediate application of the study is the extension of the image range by an amount of 1.2 times with noise reduction via multi-frame averaging, hence greatly enhancing the capability of optical imaging in the atmosphere.

Optics,Computer Vision and Pattern Recognition
Imaging through fog using quadrature lock-in discrimination

Shashank Kumar,Bapan Debnath,Meena M. S.,Julien Fade,Sankar Dhar,Mehdi Alouini,Fabien Bretenaker,Hema Ramachandran

DOI: https://doi.org/10.48550/arXiv.2105.08524

2021-05-17

Image and Video Processing

Abstract:We report experiments conducted in the field in the presence of fog, that were aimed at imaging under poor visibility. By means of intensity modulation at the source and two-dimensional quadrature lock-in detection by software at the receiver, a significant enhancement of the contrast-to-noise ratio was achieved in the imaging of beacons over hectometric distances. Further by illuminating the field of view with a modulated source, the technique helped reveal objects that were earlier obscured due to multiple scattering of light. This method, thus, holds promise of aiding in various forms of navigation under poor visibility due to fog.
Imaging Through Dynamical Scattering Media by Two-Photon Absorption Detectors.

Wei Liu,Zhihao Zhou,Lei Chen,Xin Luo,Yuehan Liu,Xianfeng Chen,Wenjie Wan

DOI: https://doi.org/10.1364/oe.433513

IF: 3.8

2021-01-01

Optics Express

Abstract:Imaging through a dynamical opaque scattering medium is an almost impossible task, where strong multiple light scattering from moving scatters dynamically prevents imaging formations even with state-of-art techniques like correlation imaging or adaptive optics. Meanwhile, a small number of ballistic photons can still penetrate through but require demanding detection in terms of a ultrashort time gate and high sensitivity. However, visible light is strongly scattered for most of scattering media. Here we experimentally demonstrate a non-invasive coherent imaging scheme based on two-photon absorption capable of imaging through dynamical scattering media with a length equivalent to 28 times mean free paths for single photon transport, where two-photon absorption in a conventional semiconductor photodetector when phase matching is not required works over a wide bandwidth so it can support a fast time gate down to femtosecond level, short enough to distinguish ballistic photons from scattering background, and allows accessing longer wavelengths for deeper penetration. This technique combined with successful optical coherence tomography may pave a new way for imaging through fog, storm, and rain as well as biomedical imaging applications.
An Algorithm Of Imaging Simulation Of Fog With Different Visibility

Cuimin Sun,Bin Kong,Lixin He,Qiang Tian

DOI: https://doi.org/10.1109/ICInfA.2015.7279542

2015-01-01

Abstract:An algorithm of imaging simulation of fog with different visibility basing on single image input was proposed. It includes three steps: (1) the defocus map is obtained firstly from the single image input, and then converted to the depth map according to the theory of lens imaging; (2) the depth map is converted into a transmittance map by using a correlation equation; (3) the fog simulation image is generated through an atmospheric scattering model. The algorithm was tested with the photographs of distant view and close-up view respectively. The simulation results of the scenes in fog in different visibility are obtained, which are natural and realistic, and in accordance with the principle of atmospheric scattering and space transmission. It confirms that the algorithm is suitable for both the image of distant scene and close-up scene, and it is a simple yet effective approach to fog simulation.
Demonstration of computational ghost imaging through fog

Huakang Lin,Chunling Luo

DOI: https://doi.org/10.1016/j.optlastec.2024.112075

IF: 4.939

2024-11-24

Optics & Laser Technology

Abstract:Imaging through fog is an active and challenging topic in the fields of optical imaging and image processing. Ghost imaging (GI), as an indirect optical imaging technique, can acquire clear images of unknown objects hidden in some hostile environments, such as underwater, turbulence, and scattering media. Here the computational ghost imaging (CGI) technique is employed to retrieve images of objects hidden in a foggy environment. Based on the extended Huygens-Fresnel principle, the imaging formula for the CGI system through fog is developed with a Lorentz shaped incoherent source. The fog model is established by combining atmospheric turbulence and atmospheric scattering. Two objects with different slit widths are applied in the numerical examples and the effects of the propagation distance, turbulence strength, and scattering particle concentration are analyzed in detail. The results show that the quality of retrieved images is hardly degraded in the CGI system through fog under short-distance conditions. While the effect of fog on imaging quality becomes more pronounced as the distance increases. To improve the quality of the CGI system through fog, the Lorentz shaped incoherent source is effectively employed to obtain better ghost images than the widely used Gaussian source, especially in long-distance conditions. Thus the work is very useful for promoting CGI real applications, such as marine navigation, road transportation safety, and remote sensing imaging.

optics,physics, applied
Single pixel structured imaging through fog

Mark Bashkansky,Samuel D. Park,John Reintjes

DOI: https://doi.org/10.1364/AO.425281

2021-03-24

Abstract:We describe the application of structured imaging with a single pixel camera to imaging through fog. We demonstrate the use of a high-pass filter on the detected bucket signals to suppress the effects of temporal variations of fog density and enable an effective reconstruction of the image. A quantitative analysis and comparison of several high-pass filters are demonstrated for the application. Both computational ghost imaging and compressive sensing techniques were used for image reconstruction and compressive sensing was observed to give a higher reconstructed image quality.

Optics,Image and Video Processing
Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Peng-Yu Jiang,Zheng-Ping Li,Wen-Long Ye,Yu Hong,Chen Dai,Xin Huang,Shui-Qing Xi,Jie Lu,Da-Jian Cui,Yuan Cao,Feihu Xu,Jian-Wei Pan

DOI: https://doi.org/10.1364/oe.487560

IF: 3.8

2023-01-01

Optics Express

Abstract:Single-photon light detection and ranging (LiDAR) has emerged as a strong candidate technology for active imaging applications. In particular, the single-photon sensitivity and picosecond timing resolution permits high-precision three-dimensional (3D) imaging capability through atmospheric obscurants including fog, haze and smoke. Here we demonstrate an array-based single-photon LiDAR system, which is capable of performing 3D imaging in atmospheric obscurant over long ranges. By adopting the optical optimization of system and the photon-efficient imaging algorithm, we acquire depth and intensity images through dense fog equivalent to 2.74 attenuation lengths at distances of 13.4 km and 20.0 km. Furthermore, we demonstrate real-time 3D imaging for moving targets at 20 frames per second in mist weather conditions over 10.5 km. The results indicate great potential for practical applications of vehicle navigation and target recognition in challenging weather.
Non-line-of-sight transient imaging via using time-of-flight camera

月刘,国栋李,一菲韩,钰琳崔,福郑,希浩陈,志斌孙

DOI: https://doi.org/10.1117/12.2586918

2021-03-12

Abstract:The image reconstruction of objects that are hidden from a camera’s view is a challenging issue of imaging in many fields of research due to its many potential applications in robotic vision , remote sensing and autonomous vehicles and so on. However, most of non-line-of -sight (NLOS) imaging experiments were demonstrated through spatially scanning a visible target surface with a pulsed laser and a time resolved detector, where both the system and image reconstruction are complicated. Here, we performed a transient non-line-of-sight imaging experiment by using a time-of-flight (TOF) camera, in which the images can be recovered via just capturing the light transport information encoded in multiply scattered light in a short time of 8.3 ms. It also has some advantages of lower 8W power requirements, lower cost, and shorter reconstruction time compared to the previous systems. Additionally, we propose a method of data processing based on Gaussian fitting to reduce the noises of images, where image quality can significantly improved.
Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

Xiaohua Feng,Liang Gao

DOI: https://doi.org/10.1038/s41467-021-22461-0

IF: 16.6

2021-04-12

Nature Communications

Abstract:Abstract Cameras with extreme speeds are enabling technologies in both fundamental and applied sciences. However, existing ultrafast cameras are incapable of coping with extended three-dimensional scenes and fall short for non-line-of-sight imaging, which requires a long sequence of time-resolved two-dimensional data. Current non-line-of-sight imagers, therefore, need to perform extensive scanning in the spatial and/or temporal dimension, restricting their use in imaging only static or slowly moving objects. To address these long-standing challenges, we present here ultrafast light field tomography (LIFT), a transient imaging strategy that offers a temporal sequence of over 1000 and enables highly efficient light field acquisition, allowing snapshot acquisition of the complete four-dimensional space and time. With LIFT, we demonstrated three-dimensional imaging of light in flight phenomena with a <10 picoseconds resolution and non-line-of-sight imaging at a 30 Hz video-rate. Furthermore, we showed how LIFT can benefit from deep learning for an improved and accelerated image formation. LIFT may facilitate broad adoption of time-resolved methods in various disciplines.

multidisciplinary sciences
Model Study of Transient Imaging With Multi-Frequency Time-of-Flight Sensors

Hongman Wang,Hui Qiao,Jingyu Lin,Rihui Wu,Yebin Liu,Qionghai Dai

DOI: https://doi.org/10.1109/TPAMI.2020.2981574

IF: 23.6

2021-01-01

IEEE Transactions on Pattern Analysis and Machine Intelligence

Abstract:As an emerging imaging modality, transient imaging that records the transient information of light transport has significantly shaped our understanding of scenes. In spite of the great progress made in computer vision and optical imaging fields, commonly used multi-frequency time-of-flight (ToF) sensors are still afflicted with the band-limited modulation frequency and long acquisition process. To...
ASF-Transformer: neutralizing the impact of atmospheric turbulence on optical imaging through alternating learning in the spatial and frequency domains

Ziran Zhang,Bin Zhao,Yueting Chen,Zhigang Wang,Dong Wang,Jiawei Sun,Jie Zhang,Zhihai Xu,Xuelong Li

DOI: https://doi.org/10.1364/oe.503131

IF: 3.8

2023-10-21

Optics Express

Abstract:Ziran Zhang, Bin Zhao, Yueting Chen, Zhigang Wang, Dong Wang, Jiawei Sun, Jie Zhang, Zhihai Xu, Xuelong Li Atmospheric turbulence, a pervasive and complex physical phenomenon, challenges optical imaging across various applications. This paper ... [Opt. Express 31, 37128-37141 (2023)]

optics
Discrete Illumination‐Based Compressed Ultrafast Photography for High‐Fidelity Dynamic Imaging (Adv. Sci. 41/2024)

Jiali Yao,Zihan Guo,Dalong Qi,Shiyu Xu,Wenzhang Lin,Long Cheng,Chengzhi Jin,Yu He,Ning Xu,Zhen Pan,Jiayi Mao,Yunhua Yao,Lianzhong Deng,Yuecheng Shen,Heng Zhao,Zhenrong Sun,Shian Zhang

DOI: https://doi.org/10.1002/advs.202470247

IF: 15.1

2024-11-07

Advanced Science

Abstract:Ultrafast Imaging The cover image depicts that an ultrafast computational camera based on pulse shaping and compressed ultrafast photography can faithfully capture an ultrafast laser‐induced micro‐explosion process in matter with the temporally discretized illumination from a laser pulse train in real time. Ore details can be found in article number 2403854 by Dalong Qi, Shian Zhang, and co‐workers.

materials science, multidisciplinary,nanoscience & nanotechnology,chemistry
Learning-based real-time imaging through dynamic scattering media

Haishan Liu,Fei Wang,Ying Jin,Xianzheng Ma,Siteng Li,Yaoming Bian,Guohai Situ

DOI: https://doi.org/10.1038/s41377-024-01569-0

2024-08-18

Light Science & Applications

Abstract:Imaging through dynamic scattering media is one of the most challenging yet fascinating problems in optics, with applications spanning from biological detection to remote sensing. In this study, we propose a comprehensive learning-based technique that facilitates real-time, non-invasive, incoherent imaging of real-world objects through dense and dynamic scattering media. We conduct extensive experiments, demonstrating the capability of our technique to see through turbid water and natural fog. The experimental results indicate that the proposed technique surpasses existing approaches in numerous aspects and holds significant potential for imaging applications across a broad spectrum of disciplines.

optics

Time-gated imaging through dense fog via physics-driven Swin transformer

Passive imaging through dense scattering media

Off-axis spatiotemporally gated multimode detection toward deep fog imaging

Time-of-flight based imaging in strong scattering underwater environments

Active imaging through dense fog by utilizing the joint polarization defogging and denoising optimization based on range-gated detection

Fast Optical High-Resolution Imaging Through Scattering Medium Based on Virtual Synthetic Aperture Model

Three-dimensional Single-Photon Imaging Through Realistic Fog in an Outdoor Environment During the Day

Towards Real-Time Through-Obstacle Imaging Based on Compressed Sensing for Sparse Objects

Harnessing Optical Imaging Limit through Atmospheric Scattering Media

Imaging through fog using quadrature lock-in discrimination

Imaging Through Dynamical Scattering Media by Two-Photon Absorption Detectors.

An Algorithm Of Imaging Simulation Of Fog With Different Visibility

Demonstration of computational ghost imaging through fog

Single pixel structured imaging through fog

Long Range 3D Imaging Through Atmospheric Obscurants Using Array-Based Single-Photon LiDAR.

Non-line-of-sight transient imaging via using time-of-flight camera

Ultrafast light field tomography for snapshot transient and non-line-of-sight imaging

Model Study of Transient Imaging With Multi-Frequency Time-of-Flight Sensors

ASF-Transformer: neutralizing the impact of atmospheric turbulence on optical imaging through alternating learning in the spatial and frequency domains

Discrete Illumination‐Based Compressed Ultrafast Photography for High‐Fidelity Dynamic Imaging (Adv. Sci. 41/2024)

Learning-based real-time imaging through dynamic scattering media