CrossDehaze: Scaling Up Image Dehazing with Cross-Data Vision Alignment and Augmentation

Yukai Shi,Zhipeng Weng,Yupei Lin,Cidan Shi,Xiaojun Yang,Liang Lin

2024-07-20

Abstract:In recent years, as computer vision tasks have increasingly relied on high-quality image inputs, the task of image dehazing has received significant attention. Previously, many methods based on priors and deep learning have been proposed to address the task of image dehazing. Ignoring the domain gap between different data, former de-hazing methods usually adopt multiple datasets for explicit training, which often makes the methods themselves be violated. To address this problem, we propose a novel method of internal and external data augmentation to improve the existing dehazing methodology. By using cross-data external augmentor. The dataset inherits samples from different domains that are firmly aligned, making the model learn more robust and generalizable features. By using the internal data augmentation method, the model can fully exploit local information within the images, thereby obtaining more image details. To demonstrate the effectiveness of our proposed method, we conduct training on both the Natural Image Dataset (NID) and the Remote Sensing Image Dataset (RSID). Experimental results show that our method clearly resolves the domain gap in different dehazing datasets and presents a new pipeline for joint training in the dehazing task. Our approach significantly outperforms other advanced methods in dehazing and produces dehazed images that are closest to real haze-free images. The code will be available at: <a class="link-external link-https" href="https://github.com/wengzp1/ScaleUpDehazing" rel="external noopener nofollow">this https URL</a>

Computer Vision and Pattern Recognition,Artificial Intelligence,Machine Learning,Multimedia,Image and Video Processing

What problem does this paper attempt to address?

The paper attempts to address the issue in image dehazing tasks where the domain gap between different datasets limits the performance of existing methods. Specifically, early dehazing methods mostly rely on prior knowledge or training on a single dataset, which makes it difficult for the model to achieve good robustness and generalization when dealing with multi-haze images from different domains (such as natural images and remote sensing images). Moreover, directly using multiple datasets for joint training often results in limited performance improvement.

To overcome these problems, the authors propose a new method to improve the robustness and generalization of the model through external data augmentation and internal data augmentation. External data augmentation aligns datasets from different domains in the color space through cross-data visual alignment techniques; internal data augmentation uses self-supervised learning techniques to enable the model to better capture local details of the images. Experimental results show that this method significantly outperforms existing state-of-the-art methods on various evaluation metrics, and the generated dehazed images are closer to real haze-free images.