Abstract:Specular highlight removal plays a pivotal role in multimedia applications, as it enhances the quality and interpretability of images and videos, ultimately improving the performance of downstream tasks such as content-based retrieval, object recognition, and scene understanding. Despite significant advances in deep learning-based methods, current state-of-the-art approaches often rely on additional priors or supervision, limiting their practicality and generalization capability. In this paper, we propose the Dual-Hybrid Attention Network for Specular Highlight Removal (DHAN-SHR), an end-to-end network that introduces novel hybrid attention mechanisms to effectively capture and process information across different scales and domains without relying on additional priors or supervision. DHAN-SHR consists of two key components: the Adaptive Local Hybrid-Domain Dual Attention Transformer (L-HD-DAT) and the Adaptive Global Dual Attention Transformer (G-DAT). The L-HD-DAT captures local inter-channel and inter-pixel dependencies while incorporating spectral domain features, enabling the network to effectively model the complex interactions between specular highlights and the underlying surface properties. The G-DAT models global inter-channel relationships and long-distance pixel dependencies, allowing the network to propagate contextual information across the entire image and generate more coherent and consistent highlight-free results. To evaluate the performance of DHAN-SHR and facilitate future research in this area, we compile a large-scale benchmark dataset comprising a diverse range of images with varying levels of specular highlights. Through extensive experiments, we demonstrate that DHAN-SHR outperforms 18 state-of-the-art methods both quantitatively and qualitatively, setting a new standard for specular highlight removal in multimedia applications.

SIHRNet: a fully convolutional network for single image highlight removal with a real-world dataset

Highlight Removal Network Based on an Improved Dichromatic Reflection Model.

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Highlight mask‐guided adaptive residual network for single image highlight detection and removal

Dual-Hybrid Attention Network for Specular Highlight Removal

A Multi-Task Network for Joint Specular Highlight Detection and Removal

Image restoration for real-world under-display imaging

Hue Guidance Network for Single Image Reflection Removal.

Single-Image Specular Highlight Removal via Real-World Dataset Construction

Weakly Supervised Specular Highlight Removal Using Only Highlight Images

Towards High-Resolution Specular Highlight Detection

Text-Aware Single Image Specular Highlight Removal

ITERATIVE REFINEMENT NETWORK FOR HYPERSPECTRAL IMAGE DENOISING

Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data

Bifurcated convolutional network for specular highlight removal

Single Image Highlight Removal with a Sparse and Low-Rank Reflection Model

Single Image Highlight Removal for Real-Time Image Processing Pipelines

M2-Net: Multi-stages Specular Highlight Detection and Removal in Multi-scenes

Single Image Reflection Removal with Reflection Intensity Prior Knowledge

IRNet: An Improved Zero-Shot Retinex Network for Low-Light Image Enhancement

HSCNN+: Advanced CNN-Based Hyperspectral Recovery from RGB Images