A self-supervised CNN for image watermark removal

Chunwei Tian,Menghua Zheng,Tiancai Jiao,Wangmeng Zuo,Yanning Zhang,Chia-Wen Lin
2024-03-09
Abstract:Popular convolutional neural networks mainly use paired images in a supervised way for image watermark removal. However, watermarked images do not have reference images in the real world, which results in poor robustness of image watermark removal techniques. In this paper, we propose a self-supervised convolutional neural network (CNN) in image watermark removal (SWCNN). SWCNN uses a self-supervised way to construct reference watermarked images rather than given paired training samples, according to watermark distribution. A heterogeneous U-Net architecture is used to extract more complementary structural information via simple components for image watermark removal. Taking into account texture information, a mixed loss is exploited to improve visual effects of image watermark removal. Besides, a watermark dataset is conducted. Experimental results show that the proposed SWCNN is superior to popular CNNs in image watermark removal.
Computer Vision and Pattern Recognition,Image and Video Processing
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the lack of robustness of image watermark removal techniques in the real world. Specifically, the existing convolutional neural networks (CNNs) mainly rely on the supervised method, using pairs of watermarked images and non - watermarked images to train the model for watermark removal. However, in practical applications, watermarked images usually do not have corresponding non - watermarked reference images, which leads to the poor robustness of the existing watermark removal techniques. For this reason, the paper proposes a self - supervised convolutional neural network (SWCNN) for image watermark removal. SWCNN constructs reference watermark images in a self - supervised manner instead of relying on given paired training samples, thus solving the problem of the absence of non - watermarked reference images. The key contributions of the paper include: 1. Proposing a self - supervised mechanism for constructing reference watermark images instead of providing paired watermark images. 2. Designing a heterogeneous U - Net architecture to extract more complementary structural information using simple components in order to improve the effect of watermark removal. 3. Introducing a hybrid loss function that combines structural information and texture information to improve the robustness of the proposed image watermark removal method. 4. Constructing a dataset containing 12 new watermarks to facilitate the application of engineers and scholars in commercial and civilian fields. Through these innovations, the paper aims to improve the robustness and effectiveness of image watermark removal techniques in practical applications.