Through the Real World Haze Scenes: Navigating the Synthetic-to-Real Gap in Challenging Image Dehazing
Chen Shijie,Mahdizadeh Mohammad,Yu Chong,Fan Jiayuan,Chen Tao
DOI: https://doi.org/10.1109/icra57147.2024.10611709
2024-01-01
Abstract:Dehazing and enhancing visibility in real-world hazy images pose significant challenges due to the physical complexity of haze, the variability in haze conditions, the tendency to capture more details in noisy scenes, and the risk of overexposure. Many existing single RGB image dehazing methods tend to perform well in synthetic hazy scenarios but struggle in real-world situations. It stems from the fact that these methods often rely solely on deep learning techniques or classical approaches. In addition, they neglect overall image quality improvement. To partially address these challenges, we introduce an innovative approach that harnesses the strengths of both modalities to dehaze and enhance visibility in a single real-world hazy RGB image. First, both Low-level and deep features are extracted, and then a pre-trained vector quantization GAN is employed to create a discrete codebook of well-detailed data patches. A decoder component, enhanced with a normalized module, effectively utilizes these high-quality features to produce clear results. Additionally, a controllable operation is introduced to improve feature matching. To further enhance dehazing and generalizability, the decoder's output undergoes a sequence of gamma-correction operations and generates a sequence of multi-exposure images that are combined to create a haze-free, visually pleasing, and higher-quality final image. The method effectively reduces haziness, enhances sharpness, preserves natural colors, and minimizes artifacts in challenging real-world scenarios. The proposed approach surpasses five SOTA methods in both qualitative and quantitative evaluations across three key metrics, utilizing two real-world and three synthetic hazy image datasets. Notably, it achieves a substantial improvement in real-world datasets over the second-best method, with gains of 0.5702 and 0.129 in FADE metrics for the RTTS and Fattal datasets, respectively.