Light transport in turbid water for 3D underwater imaging

Jostein Thorstensen,Simone Zonetti,Jens Thielemann

DOI: https://doi.org/10.1364/oe.539546

IF: 3.8

2024-11-28

Optics Express

Abstract:Jostein Thorstensen, Simone Zonetti, Jens Thielemann In this work, we have investigated the properties of light transport in turbid water for underwater 3D imaging, by comparing literature, ... [Opt. Express 32, 45013-45028 (2024)]

optics

What problem does this paper attempt to address?

Investigating the Rate of Turbidity Impact on Underwater Spectral Reflectance Detection

Hong Song,Syed Raza Mehdi,Zixin Li,Mengjie Wang,Chaopeng Wu,Vladimir Yu Venediktov,Hui Huang

DOI: https://doi.org/10.3389/fmars.2023.1031869

IF: 5.247

2023-01-01

Frontiers in Marine Science

Abstract:Spectral reflectance detection of the targeted object is considered a vital inherent optical property for its potential to provide abundant spectral information, which is crucial in underwater spectral imaging. However, the coarse condition of the underwater environment due to turbidity causes extreme distortions in spectral reflectance detection due to the high absorption and scattering of light. To cope with the effects of light degradation on underwater spectral reflectance detection accuracy, the rate of the impacts of turbidity on spectral reflectance should be examined thoroughly. Therefore, we utilize a stare-type underwater spectral imaging system based on a liquid crystal tunable filter (LCTF) to study the effects of turbidity in underwater spectral imaging of various colored bodies. To examine the accuracy of underwater spectral reflectance detection based on escalating turbidity, the paper models the rate of increase in scattering intensity of the water body. Results show that, based on the non-linear increase in the pixel response of the black and white board, the rapid upsurge in scattering intensity occurs between 400nm to 500nm at different turbidity levels. Additionally, the spectral reconstruction of color bodies relative to the black and white board shows the maximum absolute deviation of 5.3% in spectral reflectance detection accuracy under varying turbidity. While employing underwater spectral imaging, the above findings of optimal band selection can find significant applications to improve the quality of underwater object detection.
Temporal frequency probing for 5D transient analysis of global light transport

Matthew O'Toole,Felix Heide,Lei Xiao,Matthias B. Hullin,Wolfgang Heidrich,Kiriakos N. Kutulakos

DOI: https://doi.org/10.1145/2601097.2601103

IF: 6.2

2014-07-27

ACM Transactions on Graphics

Abstract:We analyze light propagation in an unknown scene using projectors and cameras that operate at transient timescales. In this new photography regime, the projector emits a spatio-temporal 3D signal and the camera receives a transformed version of it, determined by the set of all light transport paths through the scene and the time delays they induce. The underlying 3D-to-3D transformation encodes scene geometry and global transport in great detail, but individual transport components ( e.g ., direct reflections, inter-reflections, caustics, etc .) are coupled nontrivially in both space and time. To overcome this complexity, we observe that transient light transport is always separable in the temporal frequency domain . This makes it possible to analyze transient transport one temporal frequency at a time by trivially adapting techniques from conventional projector-to-camera transport. We use this idea in a prototype that offers three never-seen-before abilities: (1) acquiring time-of-flight depth images that are robust to general indirect transport, such as interreflections and caustics; (2) distinguishing between direct views of objects and their mirror reflection; and (3) using a photonic mixer device to capture sharp, evolving wavefronts of "light-in-flight".

computer science, software engineering
Decomposing Global Light Transport Using Time of Flight Imaging

Di Wu,Andreas Velten,Matthew O’Toole,Belen Masia,Amit Agrawal,Qionghai Dai,Ramesh Raskar

DOI: https://doi.org/10.1007/s11263-013-0668-2

2012-01-01

Abstract:Global light transport is composed of direct and indirect components. In this paper, we take the first steps toward analyzing light transport using the high temporal resolution information of time of flight (ToF) images. With pulsed scene illumination, the time profile at each pixel of these images separates different illumination components by their finite travel time and encodes complex interactions between the incident light and the scene geometry with spatially-varying material properties. We exploit the time profile to decompose light transport into its constituent direct, subsurface scattering, and interreflection components. We show that the time profile is well modelled using a Gaussian function for the direct and interreflection components, and a decaying exponential function for the subsurface scattering component. We use our direct, subsurface scattering, and interreflection separation algorithm for five computer vision applications: recovering projective depth maps, identifying subsurface scattering objects, measuring parameters of analytical subsurface scattering models, performing edge detection using ToF images and rendering novel images of the captured scene with adjusted amounts of subsurface scattering.
Real‐Time Underwater Spectral Rendering

Nestor Monzon,Diego Gutierrez,Derya Akkaynak,Adolfo Muñoz

DOI: https://doi.org/10.1111/cgf.15009

IF: 2.5

2024-04-18

Computer Graphics Forum

Abstract:The light field in an underwater environment is characterized by complex multiple scattering interactions and wavelength‐dependent attenuation, requiring significant computational resources for the simulation of underwater scenes. We present a novel approach that makes it possible to simulate multi‐spectral underwater scenes, in a physically‐based manner, in real time. Our key observation is the following: In the vertical direction, the steady decay in irradiance as a function of depth is characterized by the diffuse downwelling attenuation coefficient, which oceanographers routinely measure for different types of waters. We rely on a database of such real‐world measurements to obtain an analytical approximation to the Radiative Transfer Equation, allowing for real‐time spectral rendering with results comparable to Monte Carlo ground‐truth references, in a fraction of the time. We show results simulating underwater appearance for the different optical water types, including volumetric shadows and dynamic, spatially varying lighting near the water surface.

computer science, software engineering
Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

Hao Fan,Lin Qi,Changhao Chen,Yuan Rao,Linghui Kong,Junyu Dong,Hui Yu

DOI: https://doi.org/10.1109/joe.2021.3085968

IF: 3.883

2022-01-01

IEEE Journal of Oceanic Engineering

Abstract:Photometric stereo is a widely used optical 3-D reconstruction method, which has advantages for high-resolution and well-detailed 3-D reconstruction even in weak texture regions. However, in underwater photometric stereo, the light refraction and attenuation using the camera and point light sources usually result in significant errors in shape recovery. In this article, we present a novel solution to address these challenges for improving the performance of underwater photometric stereo by combining it with underwater laser triangulation. First, we employ underwater laser triangulation as references to correct the global surface-shape distortion caused by nonuniform close-range illumination. Second, we propose to use an underwater camera refractive model to eliminate nonlinear refraction distortion. Third, we build a device implementing the proposed method for 3-D seabed reconstruction in on-site sea trials. Experimental results demonstrate that the proposed approach is able to produce accurate 3-D reconstruction results in the underwater environment.

engineering, electrical & electronic, civil, ocean,oceanography
Underwater single photon 3D imaging with millimeter depth accuracy and reduced blind range

Jie Wang,Wei Hao,Songmao Chen,Zhenyang Zhang,Weihao Xu,Meilin Xie,Wenhua Zhu,Xiuqin Su

DOI: https://doi.org/10.1364/oe.499763

IF: 3.8

2023-09-01

Optics Express

Abstract:Jie Wang, Wei Hao, Songmao Chen, Zhenyang Zhang, Weihao Xu, Meilin Xie, Wenhua Zhu, Xiuqin Su Mono-static system benefits from its more flexible field of view and simplified structure, however, the backreflection photons from ... [Opt. Express 31, 30588-30603 (2023)]

optics
An Overview and Suggestions

Shuangquan Li,Zhichen Zhang,Qixian Zhang,Haiyang Yao,Xudong Li,Jianjun Mi,Haiyan Wang

DOI: https://doi.org/10.3390/jmse12071055

IF: 2.744

2024-06-24

Journal of Marine Science and Engineering

Abstract:Underwater optics have seen a notable surge of interest in recent years, emerging as a critical medium for conveying information crucial to underwater resource exploration, autonomous underwater vehicle navigation, etc. The intricate dynamics of underwater optical transmission, influenced by factors such as the absorption by the water and scattering by multiple particles, present considerable challenges. One of the most critical issues is that the optical information representation methods fail to take into account the impact of the underwater physical environment. We conducted a comprehensive review and analysis of recent advancements in underwater optical transmission laws and models. We summarized and analyzed relevant research on the effects of underwater particles and turbulence on light and analyzed the polarization effects in various environments. Then, the roles of various types of underwater optical propagation models were analyzed. Although optical models in complex environments are still mostly based on Monte Carlo methods, many underwater optical propagation mechanisms have been revealed and can promote the impacts of optical information expression. We delved into the cutting-edge research findings across three key domains: the enhancement of underwater optical image quality, the 3D reconstruction from monocular images, and the underwater wireless optical communication, examining the pivotal role played by light transmission laws and models in these areas. Drawing upon our extensive experience in underwater optics, including underwater optical sensor development and experiments, we identified and underscored future directions in this field. We advocate for the necessity of further advancements in the comprehension of underwater optical laws and physical models, emphasizing the importance of their expanded application in underwater optical information representations. Deeper exploration into these areas is not only warranted but essential for pushing the boundaries of current underwater optical technologies and unlocking new potential for their application in underwater optical sensor developments, underwater exploration, environmental monitoring, and beyond.

oceanography,engineering, marine, ocean
Virtual light transport matrices for non-line-of-sight imaging

Julio Marco,Adrian Jarabo,Ji Hyun Nam,Xiaochun Liu,Andreas Velten,Diego Gutierrez,Miguel Angel Cosculluela

DOI: https://doi.org/10.1109/iccv48922.2021.00244

2021-10-01

Abstract:The light transport matrix (LTM) is an instrumental tool in line-of-sight (LOS) imaging, describing how light interacts with the scene and enabling applications such as relighting or separation of illumination components. We introduce a framework to estimate the LTM of non-line-of-sight (NLOS) scenarios, coupling recent virtual forward light propagation models for NLOS imaging with the LOS light transport equation. We design computational projector-camera setups, and use these virtual imaging systems to estimate the transport matrix of hidden scenes. We introduce the specific illumination functions to compute the different elements of the matrix, overcoming the challenging wide-aperture conditions of NLOS setups. Our NLOS light transport matrix allows us to (re)illuminate specific locations of a hidden scene, and separate direct, first-order indirect, and higher-order indirect illumination of complex cluttered hidden scenes, similar to existing LOS techniques.
Underwater object detection and temporal signal detection in turbid water using 3D-integral imaging and deep learning

Rakesh Joshi,Kashif Usmani,Gokul Krishnan,Fletcher Blackmon,Bahram Javidi

DOI: https://doi.org/10.1364/oe.510681

IF: 3.8

2024-01-04

Optics Express

Abstract:Rakesh Joshi, Kashif Usmani, Gokul Krishnan, Fletcher Blackmon, Bahram Javidi Underwater scattering caused by suspended particles in the water severely degrades signal detection performance and poses significant ... [Opt. Express 32, 1789-1801 (2024)]

optics
Underwater Optical Imaging: Methods, Applications and Perspectives

Yansheng Hao,Yaoyao Yuan,Hongman Zhang,Ze Zhang

DOI: https://doi.org/10.3390/rs16203773

IF: 5

2024-10-12

Remote Sensing

Abstract:Underwater optical imaging is essential for exploring the underwater environment to provide information for planning and regulating underwater activities in various underwater applications, such as aquaculture farm observation, underwater topographical survey, and underwater infrastructure monitoring. Thus, there is a need to investigate the underwater imaging process and propose clear and long-range underwater optical imaging methods to fulfill the demands of academia and industry. In this manuscript, we classify the eighteen most commonly used underwater optical imaging methods into two groups regarding the imaging principle, (1) hardware and (2) software-based methods, each with an explanation of the theory, features, and applications. Furthermore, we also discuss the current challenges and future directions for improving the performance of current methods, such as improving the accuracy of underwater image formation model estimation, enlarging the underwater image dataset, proposing comprehensive underwater imaging evaluation metrics, estimating underwater depth and integrating different methods (e.g., hardware- and software-based methods for computational imaging) to promote the imaging performance not only in the laboratory but also in practical underwater scenarios.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary
3D visualization in turbid water using optimal photon counting and a GAT-based peplography method

Riffat Tehseen,Muhammad Shahzad,Mithilesh K. Mane,Amjad Ali,Zejun Zhang,Jing Xu

DOI: https://doi.org/10.1364/ao.522546

IF: 1.9

2024-06-04

Applied Optics

Abstract:Riffat Tehseen, Muhammad Shahzad, Mithilesh K. Mane, Amjad Ali, Zejun Zhang, Jing Xu Peplography is a three-dimensional (3D) approach for the visualization of targets in environments characterized by heavy scattering. It ... [Appl. Opt. 63, 4558-4565 (2024)]

optics
Towards a more accurate light transport model for non-line-of-sight imaging

Talha Sultan,Syed Azer Reza,Andreas Velten,Syed Reza

DOI: https://doi.org/10.1364/oe.508034

IF: 3.8

2024-02-22

Optics Express

Abstract:Talha Sultan, Syed Azer Reza, Andreas Velten Non-line-of-sight (NLOS) imaging systems involve the measurement of an optical signal at a diffuse surface. A forward model encodes the ... [Opt. Express 32, 7731-7761 (2024)]

optics
Commercial Optical and Acoustic Sensor Performances under Varying Turbidity, Illumination, and Target Distances

Fredrik Fogh Sørensen,Christian Mai,Ole Marius Olsen,Jesper Liniger,Simon Pedersen

DOI: https://doi.org/10.3390/s23146575

2023-07-21

Abstract:Acoustic and optical sensing modalities represent two of the primary sensing methods within underwater environments, and both have been researched extensively in previous works. Acoustic sensing is the premier method due to its high transmissivity in water and its relative immunity to environmental factors such as water clarity. Optical sensing is, however, valuable for many operational and inspection tasks and is readily understood by human operators. In this work, we quantify and compare the operational characteristics and environmental effects of turbidity and illumination on two commercial-off-the-shelf sensors and an additional augmented optical method, including: a high-frequency, forward-looking inspection sonar, a stereo camera with built-in stereo depth estimation, and color imaging, where a laser has been added for distance triangulation. The sensors have been compared in a controlled underwater environment with known target objects to ascertain quantitative operation performance, and it is shown that optical stereo depth estimation and laser triangulation operate satisfactorily at low and medium turbidites up to a distance of approximately one meter, with an error below 2 cm and 12 cm, respectively; acoustic measurements are almost completely unaffected up to two meters under high turbidity, with an error below 5 cm. Moreover, the stereo vision algorithm is slightly more robust than laser-line triangulation across turbidity and lighting conditions. Future work will concern the improvement of the stereo reconstruction and laser triangulation by algorithm enhancement and the fusion of the two sensing modalities.
Time-of-flight based imaging in strong scattering underwater environments

Xin Jin,Dongyu Du,Jiawei Jin,Yihui Fan

DOI: https://doi.org/10.1364/oe.534170

IF: 3.8

2024-10-03

Optics Express

Abstract:Xin Jin, Dongyu Du, Jiawei Jin, Yihui Fan Time-of-flight (TOF) based underwater imaging is of great importance in practical applications due to its high image quality. Existing ... [Opt. Express 32, 37247-37259 (2024)]

optics
Single Underwater Image Enhancement with a New Optical Model.

Haocheng Wen,Yonghong Tian,Tiejun Huang,Wen Gao

DOI: https://doi.org/10.1109/iscas.2013.6571956

2013-01-01

Abstract:As light is attenuated when disseminating in water, the clarity of images or videos captured under water is usually degraded to varying degrees. By exploring the difference in light attenuation between in atmosphere and in water, we derive a new underwater optical model to describe the formation of an underwater image in the true physical process, and then propose an effective enhancement algorithm with the derived optical model to improve the perception of underwater images or video frames. In our algorithm, a new underwater dark channel is derived to estimate the scattering rate, and an effective method is also presented to estimate the background light in the underwater optical model. Experimental results show that our algorithm can well handle underwater images, especially for deep-sea images and those captured from turbid waters.
Target recognition and segmentation in turbid water using data from non-turbid conditions: a unified approach and experimental validation

Luping Liu,Xin Li,Jianmin Yang,Xinliang Tian,Lei Liu

DOI: https://doi.org/10.1364/oe.524714

IF: 3.8

2024-05-21

Optics Express

Abstract:Luping Liu, Xin Li, Jianmin Yang, Xinliang Tian, Lei Liu Semantic segmentation of targets in underwater images within turbid water environments presents significant challenges, hindered by factors ... [Opt. Express 32, 20654-20668 (2024)]

optics
Transparent Object Reconstruction via Coded Transport of Intensity

Chenguang Ma,Xing Lin,Jin-Li Suo,Qionghai Dai,Gordon Wetzstein

DOI: https://doi.org/10.1109/CVPR.2014.420

2014-01-01

Abstract:Capturing and understanding visual signals is one of the core interests of computer vision. Much progress has been made w.r.t. many aspects of imaging, but the reconstruction of refractive phenomena, such as turbulence, gas and heat flows, liquids, or transparent solids, has remained a challenging problem. In this paper, we derive an intuitive formulation of light transport in refractive media using light fields and the transport of intensity equation. We show how coded illumination in combination with pairs of recorded images allow for robust computational reconstruction of dynamic two and three-dimensional refractive phenomena.
Modeling for Underwater Optical Channel in Relatively Turbid Waters Based on the Monte Carlo Method

Tianheng Ma,Zihao Du,Jing Xu

DOI: https://doi.org/10.1109/ICAIT52638.2021.9702095

2021-01-01

Abstract:With the development of marine research and exploitation, underwater optical communications have been widely used in numerous scenes. However, seawater would absorb and scatter the optical signal, causing the energy attenuation and the time-domain broadening of the pulse. In this work, based on the basic optical properties of seawater, the Monte Carlo method is applied to simulate the energy attenuation and the time-domain response of the light pulse in relatively turbid waters. The feasibility of optical communication in relatively turbid waters is estimated, with an interesting finding that the requirement for optical link alignment can be significantly relaxed in turbid waters.
High-speed in toto 3D imaging with isotropic resolution by scanning light-field tomography

Yifan Chen,Jiamin Wu,Bo Xiong,Zhi Lu,Yuduo Guo,Yi Zhang,Jiaqi Fan,Guihua Xiao,Guoxun Zhang,Xiaopeng Li,Xukang Wang,Zhifeng Zhao,Qionghai Dai

DOI: https://doi.org/10.1364/optica.534412

IF: 10.4

2024-10-17

Optica

Abstract:Yifan Chen, Jiamin Wu, Bo Xiong, Zhi Lu, Yuduo Guo, Yi Zhang, Jiaqi Fan, Guihua Xiao, Guoxun Zhang, Xiaopeng Li, Xukang Wang, Zhifeng Zhao, Qionghai Dai In toto imaging of large-scale transparent samples or cleared tissue is in high demand in broad biological applications such as oncology, ... [Optica 11, 1445-1453 (2024)]

optics
Underwater Image Transmission and Blurred Image Restoration

ZS Liu,YF Yu,KL Zhang,HL Huang

DOI: https://doi.org/10.1117/1.1364500

IF: 1.3

2001-01-01

Optical Engineering

Abstract:Because light is scattered and absorbed by seawater, the images obtained underwater are always blurry after transmitted through a certain distance. The point spread function (PSF) and modulation transfer function (MTF) are important properties of seawater to predict underwater light propagation and underwater image quality. We describe the laboratory facilities to measure the PSF and MTF of water body by the image transmission method and the restoration methods of under- water blurred images. The measured results are given and compared with the theories. The blurred images of a bar target transmitted through different water paths are restored with the measured MTF using a Wiener filter. © 2001 Society of Photo-Optical Instrumentation Engineers.

Light transport in turbid water for 3D underwater imaging

Investigating the Rate of Turbidity Impact on Underwater Spectral Reflectance Detection

Temporal frequency probing for 5D transient analysis of global light transport

Decomposing Global Light Transport Using Time of Flight Imaging

Real‐Time Underwater Spectral Rendering

Underwater Optical 3-D Reconstruction of Photometric Stereo Considering Light Refraction and Attenuation

Underwater single photon 3D imaging with millimeter depth accuracy and reduced blind range

An Overview and Suggestions

Virtual light transport matrices for non-line-of-sight imaging

Underwater object detection and temporal signal detection in turbid water using 3D-integral imaging and deep learning

Underwater Optical Imaging: Methods, Applications and Perspectives

3D visualization in turbid water using optimal photon counting and a GAT-based peplography method

Towards a more accurate light transport model for non-line-of-sight imaging

Commercial Optical and Acoustic Sensor Performances under Varying Turbidity, Illumination, and Target Distances

Time-of-flight based imaging in strong scattering underwater environments

Single Underwater Image Enhancement with a New Optical Model.

Target recognition and segmentation in turbid water using data from non-turbid conditions: a unified approach and experimental validation

Transparent Object Reconstruction via Coded Transport of Intensity

Modeling for Underwater Optical Channel in Relatively Turbid Waters Based on the Monte Carlo Method

High-speed in toto 3D imaging with isotropic resolution by scanning light-field tomography

Underwater Image Transmission and Blurred Image Restoration