Abstract:Under-display camera (UDC) systems are the foundation of full-screen display devices in which the lens mounts under the display. The pixel array of light-emitting diodes used for display diffracts and attenuates incident light, causing various degradations as the light intensity changes. Unlike general video restoration which recovers video by treating different degradation factors equally, video restoration for UDC systems is more challenging that concerns removing diverse degradation over time while preserving temporal consistency. In this paper, we introduce a novel video restoration network, called D$^2$RNet, specifically designed for UDC systems. It employs a set of Decoupling Attention Modules (DAM) that effectively separate the various video degradation factors. More specifically, a soft mask generation function is proposed to formulate each frame into flare and haze based on the diffraction arising from incident light of different intensities, followed by the proposed flare and haze removal components that leverage long- and short-term feature learning to handle the respective degradations. Such a design offers an targeted and effective solution to eliminating various types of degradation in UDC systems. We further extend our design into multi-scale to overcome the scale-changing of degradation that often occur in long-range videos. To demonstrate the superiority of D$^2$RNet, we propose a large-scale UDC video benchmark by gathering HDR videos and generating realistically degraded videos using the point spread function measured by a commercial UDC system. Extensive quantitative and qualitative evaluations demonstrate the superiority of D$^2$RNet compared to other state-of-the-art video restoration and UDC image restoration methods. Code is available at https://github.com/ChengxuLiu/DDRNet.git

Learning a Practical SDR-to-HDRTV Up-conversion using New Dataset and Degradation Models

A New Journey from SDRTV to HDRTV

Towards Efficient SDRTV-to-HDRTV by Learning from Image Formation

Modular Degradation Simulation and Restoration for Under-Display Camera

Towards Robust SDRTV-to-HDRTV via Dual Inverse Degradation Network

Dual Inverse Degradation Network for Real-World SDRTV-to-HDRTV Conversion

Beyond Feature Mapping GAP: Integrating Real HDRTV Priors for Superior SDRTV-to-HDRTV Conversion

EffiHDR: An Efficient Framework for HDRTV Reconstruction and Enhancement in UHD Systems

FastHDRNet: A new efficient method for SDR-to-HDR Translation

Global priors guided modulation network for joint super-resolution and SDRTV-to-HDRTV

LHDR: HDR Reconstruction for Legacy Content using a Lightweight DNN

HDR Video Reconstruction with a Large Dynamic Dataset in Raw and sRGB Domains

Bidirectional Translation Between UHD-HDR and HD-SDR Videos

HDR Video Reconstruction: A Coarse-to-fine Network and A Real-world Benchmark Dataset

Deep Video Restoration for Under-Display Camera

Advancing Real-World Image Dehazing: Perspective, Modules, and Training

Redistributing the Precision and Content in 3D-LUT-based Inverse Tone-mapping for HDR/WCG Display

Decoupling Degradations with Recurrent Network for Video Restoration in Under-Display Camera

SDCNet:Spatially-Adaptive Deformable Convolution Networks for HR NonHomogeneous Dehazing

Degradation Oriented and Regularized Network for Blind Depth Super-Resolution