A Total Variation and Group Sparsity Based Tensor Optimization Model for Video Rain Streak Removal

Ye-Tao Wang,Xi-Le Zhao,Tai-Xiang Jiang,Liang-Jian Deng,Tian-Hui Ma,Yue-Tian Zhang,Ting-Zhu Huang
DOI: https://doi.org/10.1016/j.image.2018.11.008
IF: 3.453
2018-01-01
Signal Processing Image Communication
Abstract:Rain streak removal is an important issue of the outdoor vision system and has been investigated extensively. In this paper, we propose a novel tensor optimization model for video rain streak removal by fully considering the discriminatively intrinsic characteristics of the rain streaks and the clean video. In specific, the rain streaks are group sparse and smooth along the rain streaks direction; the clean video is smooth along the perpendicular direction of the rain streaks and the temporal direction. For the rain streaks, we use ℓ2,1 norm to characterize the group sparsity and the unidirectional total variation (UTV) to promote the smoothness along the rain streaks direction. For the clean video, we use two UTV regularizers to enhance the smoothness along the perpendicular direction of the rain streaks and the temporal direction. To solve the proposed model we develop an efficient alternating direction method of multipliers (ADMM) algorithm. Experiments on synthetic and real data demonstrate the superiority of the proposed method over state-of-the-art methods both quantitatively and qualitatively.
What problem does this paper attempt to address?