Video quality enhancement using recursive deep residual learning network

Abeer Ayoub,Ensherah A. Naeem,Walid El-Shafai,Eman A. Sultan,O. Zahran,Fathi E. Abd El-Samie,El-Sayed M. EL-Rabaie
DOI: https://doi.org/10.1007/s11760-022-02228-w
2023-01-27
Abstract:Outdoor images and videos suffer from several problems, such as the hazing problem due to the particles of dust, smoke, and other particles in the atmosphere. Videos in such atmospheric conditions are subject to visible quality degradations, such as low contrast and information loss. This paper presents a dehazing algorithm that enhances the video contrast, removes haze from hazy frames, and reduces frame degradation. We use a recursive deep residual learning (DRL) network as a dehazing tool to enhance video quality. The DRL network estimates the nonlinear mapping from the space of hazy input frames to that of output dehazed frames without estimating the transmission map and the atmospheric light as in traditional dehazing methods. After that, the dehazed frame is fed back to the input of the DRL network. This process is counted as an iteration. Our proposed algorithm depends on pre-processing of frames before the dehazing process to remove noise or enhance the visual quality, because all frames contain some noise due to sensor measurement errors. Noise can be amplified in the haze removal process if ignored. We use different types of enhancement techniques before the dehazing process. In addition, we modify the DRL network to be suitable for both near infrared (NIR) and visible frames. The number of iterations in the DRL network is increased from three iterations to nine iterations and the effect of increasing the number of iterations on the output dehazed frames is studied. We stopped at nine iterations, because elapsed time increases with the increase in the number of iterations. The peak signal-to-noise ratio and correlation after the dehazing process between dehazed and input hazy frames are used as evaluation metrics for our proposed algorithm. Results show that by increasing the number of iterations in the DRL network, dehazed frames record the best contrast, the highest spectral entropy, and the highest visual quality.
engineering, electrical & electronic,imaging science & photographic technology
What problem does this paper attempt to address?