Abstract:Recently, learning-based algorithms have shown impressive performance in underwater image enhancement. Most of them resort to training on synthetic data and obtain outstanding performance. However, these deep methods ignore the significant domain gap between the synthetic and real data (i.e., inter-domain gap), and thus the models trained on synthetic data often fail to generalize well to real-world underwater scenarios. Moreover, the complex and changeable underwater environment also causes a great distribution gap among the real data itself (i.e., intra-domain gap). However, almost no research focuses on this problem and thus their techniques often produce visually unpleasing artifacts and color distortions on various real images. Motivated by these observations, we propose a novel Two-phase Underwater Domain Adaptation network (TUDA) to simultaneously minimize the inter-domain and intra-domain gap. Concretely, in the first phase, a new triple-alignment network is designed, including a translation part for enhancing realism of input images, followed by a task-oriented enhancement part. With performing image-level, feature-level and output-level adaptation in these two parts through jointly adversarial learning, the network can better build invariance across domains and thus bridging the inter-domain gap. In the second phase, an easy-hard classification of real data according to the assessed quality of enhanced images is performed, in which a new rank-based underwater quality assessment method is embedded. By leveraging implicit quality information learned from rankings, this method can more accurately assess the perceptual quality of enhanced images. Using pseudo labels from the easy part, an easy-hard adaptation technique is then conducted to effectively decrease the intra-domain gap between easy and hard samples. Extensive experimental results demonstrate that the proposed TUDA is significantly superior to existing works in terms of both visual quality and quan- itative metrics.

Deep Wavelet Network with Domain Adaptation for Single Image Demoireing.

Wavelet-Based Dual-Branch Network for Image Demoireing

An Underwater Image Enhancement Model for Domain Adaptation

Learning Frequency Domain Priors for Image Demoireing

Video Demoiréing with Deep Temporal Color Embedding and Video-Image Invertible Consistency

Multibranch Wavelet-Based Network for Image Demoiréing

Self-Adaptively Learning to Demoire from Focused and Defocused Image Pairs

Self-Adaptively Learning to Demoiré from Focused and Defocused Image Pairs

Learning Image Demoireing from Unpaired Real Data

Wavelet Siamese Network with Semi-supervised Domain Adaptation for Remote Sensing Image Change Detection

Domain Adaptation for Underwater Image Enhancement

MsDA: Multi-scale Domain Adaptation Dehazing Network

NTIRE 2020 Challenge on Image Demoireing: Methods and Results

Spatial Adaptive Filter Network With Scale-Sharing Convolution for Image Demoiréing

Direction-aware Video Demoireing with Temporal-guided Bilateral Learning

Domain Adaptation for In-Air to Underwater Image Enhancement Via Deep Learning

DADRnet: Cross-domain Image Dehazing Via Domain Adaptation and Disentangled Representation.

Real-Time Image Demoireing on Mobile Devices.

AADNet: Attention aware Demoiréing Network

Multi-scale Dynamic Feature Encoding Network for Image Demoireing

Efficient and Robust: A Cross-Modal Registration Deep Wavelet Learning Method for Remote Sensing Images