Real-time video dehazing via incremental transmission learning and spatial-temporally coherent regularization

Shu-Juan Peng,He Zhang,Xin Liu,Wentao Fan,Bineng Zhong,Ji-Xiang Du

DOI: https://doi.org/10.1016/j.neucom.2020.02.134

IF: 6

2021-10-01

Neurocomputing

Abstract:<p>Video dehazing is of crucial importance to the outdoor surveillance, and its main challenges mainly come from the spatial-temporal coherence and computational efficiency. This paper presents an efficient real-time video dehazing approach via incremental transmission learning and spatial-temporally coherent regularization, while explicitly suppressing the possible visual artifacts. First, we propose to initialize the transmission map frame-by-frame by a boundary constrained open dark channel model. Then, supposing a scene point yields highly correlated transmission values between adjacent frames, we impose a temporally coherent term to maintain the temporal consistency of consecutive transmission values, and simultaneously derive an incremental transmission adjusting term to adapt the abrupt scene depth changes between the adjacent frames. Accordingly, the highly correlated and spatial-temporally coherent transmission maps can be optimized for each video frame dehazing, whereby the flickering artifacts can be well reduced. Finally, we group each haze/haze-free images in pair and further utilize the guided joint bilateral filter to suppress the visual artifacts that possibly amplified during the dehazing process. The experimental results show that the proposed video dehazing approach is able to well preserve the spatial-temporal coherence, runs sufficiently fast, and also performs favorably compared to the state-of-the-art methods.</p>

computer science, artificial intelligence

What problem does this paper attempt to address?

This paper attempts to address several major challenges in video dehazing, including spatial-temporal coherence, computational efficiency, and visual artifact suppression. Specifically:

1. **Spatial-Temporal Coherence**: Video dehazing needs to maintain temporal coherence and spatial coherence between adjacent frames to avoid flickering artifacts and other unnatural phenomena.
2. **Computational Efficiency**: The amount of video data is much larger than that of a single image, so efficient algorithms are crucial for real-time processing.
3. **Visual Artifact Suppression**: During the dehazing process, existing image artifacts such as noise and color aliasing may be amplified, requiring effective methods to suppress these artifacts.

To address these challenges, the authors propose an efficient real-time video dehazing method based on incremental transmission learning and spatial-temporally coherent regularization. The main contributions of this method include:

1. **Reliable Transmission Map Initialization**: The transmission map is initialized using a boundary constrained dark channel model to reduce halo artifacts in regions with depth jumps.
2. **Spatial-Temporally Coherent Transmission Learning**: A spatial-temporally coherent transmission learning method is proposed to obtain highly correlated and consistent transmission maps, enabling efficient video dehazing.
3. **Visual Artifact Suppression Scheme**: A guided joint bilateral filter is utilized to effectively suppress visual artifacts that may be amplified during the dehazing process.

Experimental results show that the algorithm can achieve real-time video processing while maintaining spatial-temporal coherence, and the dehazing effect is superior to existing advanced methods.