Abstract:Specular highlight removal plays a pivotal role in multimedia applications, as it enhances the quality and interpretability of images and videos, ultimately improving the performance of downstream tasks such as content-based retrieval, object recognition, and scene understanding. Despite significant advances in deep learning-based methods, current state-of-the-art approaches often rely on additional priors or supervision, limiting their practicality and generalization capability. In this paper, we propose the Dual-Hybrid Attention Network for Specular Highlight Removal (DHAN-SHR), an end-to-end network that introduces novel hybrid attention mechanisms to effectively capture and process information across different scales and domains without relying on additional priors or supervision. DHAN-SHR consists of two key components: the Adaptive Local Hybrid-Domain Dual Attention Transformer (L-HD-DAT) and the Adaptive Global Dual Attention Transformer (G-DAT). The L-HD-DAT captures local inter-channel and inter-pixel dependencies while incorporating spectral domain features, enabling the network to effectively model the complex interactions between specular highlights and the underlying surface properties. The G-DAT models global inter-channel relationships and long-distance pixel dependencies, allowing the network to propagate contextual information across the entire image and generate more coherent and consistent highlight-free results. To evaluate the performance of DHAN-SHR and facilitate future research in this area, we compile a large-scale benchmark dataset comprising a diverse range of images with varying levels of specular highlights. Through extensive experiments, we demonstrate that DHAN-SHR outperforms 18 state-of-the-art methods both quantitatively and qualitatively, setting a new standard for specular highlight removal in multimedia applications.

Towards High-Resolution Specular Highlight Detection

SIHRNet: a fully convolutional network for single image highlight removal with a real-world dataset

Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data

A Multi-Task Network for Joint Specular Highlight Detection and Removal

Single-Image Specular Highlight Removal via Real-World Dataset Construction

Weakly Supervised Specular Highlight Removal Using Only Highlight Images

Highlight detection and removal based on chromaticity

Specular Highlight Removal for Real‐world Images

Dual-Hybrid Attention Network for Specular Highlight Removal

Highlight mask‐guided adaptive residual network for single image highlight detection and removal

Deep Networks with Detail Enhancement for Infrared Image Super-Resolution

Bifurcated convolutional network for specular highlight removal

Highlight Removal Network Based on an Improved Dichromatic Reflection Model.

Text-Aware Single Image Specular Highlight Removal

From Coarse to Fine: A Two-Stage Network for Dense Haze removal

SpecSeg Network for Specular Highlight Detection and Segmentation in Real-World Images

Fast and High Quality Highlight Removal from A Single Image

DeepInspection: Deep learning based hierarchical network for specular surface inspection

Specular highlight removal of light field based on dichromatic reflection and total variation optimizations

Specular highlight removal by federated generative adversarial network with attention mechanism

Light Field Imaging Based Accurate Image Specular Highlight Removal