Abstract:Low-light enhancement is a crucial task that aims to enhance the under-exposed input in computer vision. While state-of-the-art static single-image enhancement methods have made remarkable progress, yet, few attempts are explored the spatial-temporal sequence problem in low-light video enhancement. In this paper, we propose a simple yet highly effective method, termed as Adaptive Locally-Aligned Transformer (ALAT) for low-light video enhancement based on visual transformers. ALAT consists of three parts: feature encoder, locally-aligned transformer block (LATB) and pyramid feature decoder. Specifically, the transformer block enables the network to model the long-range spatial and appearance dependencies in videos due to its self-attention parallel computing mechanism. However, different from some previous approaches directly using the vanilla transformer, we consider that locality is significant in low-level vision tasks since the misaligned contextual local features (i.e., edges, shapes) may affect the prediction quality. Therefore, the proposed LATB is designed to align the video pixel with its most relevant ones adaptively in the local region to preserve the regional content information. Furthermore, we publish a new real-world low-light video dataset, named ExpressWay, to fill the gaps in the lack of dynamic low-light video scenarios, which contains high-quality videos with moving objects in both dark- and bright-light conditions. We conduct experiments on five benchmarks under three comprehensive settings including synthesized, static and our proposed dynamic low-light video datasets. Extensive experimental results show that our ALAT can outperform the previous state-of-the-arts by a large margin of 0.20∼1.10 dB. Our method can be also extended to other video enhancement applications. The project is available at https://github.com/y1wencao/LLVE-ALAT.

Illumination Adaptive Transformer.

You Only Need 90K Parameters to Adapt Light: A Light Weight Transformer for Image Enhancement and Exposure Correction

An Illumination-Guided Dual Attention Vision Transformer for Low-Light Image Enhancement

IATN: illumination-aware two-stage network for low-light image enhancement

A Transformer-Based Network for Low-Light Image Enhancement

IGT: Illumination-guided RGB-T object detection with transformers

Lite Vision Transformer with Enhanced Self-Attention

Illumination-Aware Low-Light Image Enhancement with Transformer and Auto-Knee Curve

Pre‐trained low‐light image enhancement transformer

Retinexformer: One-stage Retinex-based Transformer for Low-light Image Enhancement

AdaViT: Adaptive Vision Transformers for Efficient Image Recognition

Adaptive Locally-Aligned Transformer for Low-Light Video Enhancement

EAT: an Enhancer for Aesthetics-Oriented Transformers

A non-uniform low-light image enhancement method with multi-scale attention transformer and luminance consistency loss

IRISformer: Dense Vision Transformers for Single-Image Inverse Rendering in Indoor Scenes

Illumination-aware window transformer for rgbt modality fusion

Adaptive Masked Autoencoder Transformer for Image Classification

Implicit Multi-Spectral Transformer: An Lightweight and Effective Visible to Infrared Image Translation Model

Vision Transformer with Sparse Scan Prior

Image attention transformer network for indoor 3D object detection