Let You See in Haze and Sandstorm: Two-in-One Low-Visibility Enhancement Network

Yuan Gao,Wenyu Xu,Yuxu Lu

DOI: https://doi.org/10.1109/tim.2023.3304668

IF: 5.6

2023-09-01

IEEE Transactions on Instrumentation and Measurement

Abstract:Scattering particles (such as water vapor and dust) in the atmosphere excessively absorb and scatter light, which causes the image collected by imaging sensors with low visibility, low contrast, color shifting, etc. This limitation hinders the development of vision-driven artificial intelligence applications, such as the intelligent traffic monitoring system (ITMS). To improve the imaging quality in hazy and sandstorm conditions, this article proposes a novel two-in-one low-visibility enhancement network (termed TOENet). Specifically, we take into account the changes in the histogram distributions of the red, green, and blue channels of the hazy and sandstorm images and present a multilayer perceptron (MLP)-based channel correlation extraction module (CCEM) to learn and reconstruct the correlation between the channels of low-visibility images. The multiscale channel attention features generated by CCEM will be embedded into the backbone (i.e., the encoder–decoder network) of TOENet to extract additional latent feature information from low-visibility images. TOENet can achieve both dehazing and sandstorm enhancement through a single deep network model without incurring extra computational costs. Extensive experimental results demonstrate that the proposed TOENet outperforms several state-of-the-art methods on challenging datasets. Furthermore, the running time and object detection experiments indicate the practical benefits of our method for high-level visual task under low-visibility weathers in ITMS. The source code is available at https://github.com/YuanGao-YG/TOENet.

engineering, electrical & electronic,instruments & instrumentation