Rain Removal from a Single Image Using Refined Inception ResNet v2

Das, Bijaylaxmi,Saha, Ayan,Mukhopadhyay, Sudipta
DOI: https://doi.org/10.1007/s00034-022-02279-x
2023-01-11
Abstract:The atmospheric conditions like rain degrade visibility, creating problems for computer vision applications. In single-image de-raining, the lack of temporal information creates challenges. Rain removal requires a high-frequency layer extraction, as rain affects an image's high-frequency layer (detail layer). This article has proposed using a combination of image decomposition and Inception ResNet v2 (IR v2) network for single-image rain removal. A guided filter decomposes the rainy image into the base and detail layers. The use of the Inception ResNet v2 (IR v2) network is proposed to create the residual map of the rain streaks from the high-frequency layer of the input image. The de-rained image obtained by subtracting the residual from the original rainy image provides comparable results. SSIM is added to MSE to train the IR v2 network, which improves the network's performance. The complexity of the network (IR v2) is high. A systematic reduction in the network is done first at the module level and later at convolution filters. The proposed refinement decreases network complexity and reduces execution time without degrading the performance. An extensive test using natural and artificial rainy images reveals that the proposed refined Inception ResNet v2 (rIR v2) favorably competes against the recent single-image de-raining techniques.
engineering, electrical & electronic
What problem does this paper attempt to address?