Abstract:Low-light enhancement is a crucial task that aims to enhance the under-exposed input in computer vision. While state-of-the-art static single-image enhancement methods have made remarkable progress, yet, few attempts are explored the spatial-temporal sequence problem in low-light video enhancement. In this paper, we propose a simple yet highly effective method, termed as Adaptive Locally-Aligned Transformer (ALAT) for low-light video enhancement based on visual transformers. ALAT consists of three parts: feature encoder, locally-aligned transformer block (LATB) and pyramid feature decoder. Specifically, the transformer block enables the network to model the long-range spatial and appearance dependencies in videos due to its self-attention parallel computing mechanism. However, different from some previous approaches directly using the vanilla transformer, we consider that locality is significant in low-level vision tasks since the misaligned contextual local features (i.e., edges, shapes) may affect the prediction quality. Therefore, the proposed LATB is designed to align the video pixel with its most relevant ones adaptively in the local region to preserve the regional content information. Furthermore, we publish a new real-world low-light video dataset, named ExpressWay, to fill the gaps in the lack of dynamic low-light video scenarios, which contains high-quality videos with moving objects in both dark- and bright-light conditions. We conduct experiments on five benchmarks under three comprehensive settings including synthesized, static and our proposed dynamic low-light video datasets. Extensive experimental results show that our ALAT can outperform the previous state-of-the-arts by a large margin of 0.20∼1.10 dB. Our method can be also extended to other video enhancement applications. The project is available at https://github.com/y1wencao/LLVE-ALAT.

WLiT: Windows and Linear Transformer for Video Action Recognition

LS-VIT: Vision Transformer for action recognition based on long and short-term temporal difference

Transformer With Linear-Window Attention for Feature Matching

Efficient Video Transformers via Spatial-Temporal Token Merging for Action Recognition

ViT-LSLA: Vision Transformer with Light Self-Limited-Attention

Interpretable Spatio-temporal Attention for Video Action Recognition

Linear Video Transformer with Feature Fixation

Action recognition using attention-based spatio-temporal VLAD networks and adaptive video sequences optimization

Adaptive Locally-Aligned Transformer for Low-Light Video Enhancement

An Attention Mechanism Based Convolutional LSTM Network for Video Action Recognition.

ActionFormer: Localizing Moments of Actions with Transformers

LASFormer: Light Transformer for Action Segmentation with Receptive Field-Guided Distillation and Action Relation Encoding

MgMViT: Multi-Granularity and Multi-Scale Vision Transformer for Efficient Action Recognition

An Efficient Lightweight Spatio-temporal Attention Module for Action Recognition.

Lite Vision Transformer with Enhanced Self-Attention

LGAFormer: transformer with local and global attention for action detection

Task-specific alignment and multiple-level transformer for few-shot action recognition

A Novel Shortcut between Local Windows for Window-based Vision Transformers

Sparse Dense Transformer Network for Video Action Recognition

An Efficient Motion Visual Learning Method for Video Action Recognition

FSformer: Fast-Slow Transformer for Video Action Recognition.