LLEMamba: Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network

Xuanqi Zhang,Haijin Zeng,Jinwang Pan,Qiangqiang Shen,Yongyong Chen

2024-06-03

Abstract:Transformer-based low-light enhancement methods have yielded promising performance by effectively capturing long-range dependencies in a global context. However, their elevated computational demand limits the scalability of multiple iterations in deep unfolding networks, and hence they have difficulty in flexibly balancing interpretability and distortion. To address this issue, we propose a novel Low-Light Enhancement method via relighting-guided Mamba with a deep unfolding network (LLEMamba), whose theoretical interpretability and fidelity are guaranteed by Retinex optimization and Mamba deep priors, respectively. Specifically, our LLEMamba first constructs a Retinex model with deep priors, embedding the iterative optimization process based on the Alternating Direction Method of Multipliers (ADMM) within a deep unfolding network. Unlike Transformer, to assist the deep unfolding framework with multiple iterations, the proposed LLEMamba introduces a novel Mamba architecture with lower computational complexity, which not only achieves light-dependent global visual context for dark images during reflectance relight but also optimizes to obtain more stable closed-form solutions. Experiments on the benchmarks show that LLEMamba achieves superior quantitative evaluations and lower distortion visual results compared to existing state-of-the-art methods.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

This paper aims to address several key issues in low-light image enhancement:

1. **Balance between Long-Range Dependency and Computational Complexity**: Existing Transformer-based methods, while excellent at capturing global context, have high computational demands, making it difficult to flexibly balance interpretability and distortion in deep unfolding networks.

2. **Limitations of Existing Methods**:
- Deep learning-based methods (such as convolutional neural networks) lack large-scale training data to reveal the diversity and complex mapping relationships from low-light to normal-light conditions.
- Model-based methods (such as the Retinex model) have theoretical advantages but are insufficient in denoising and recovering the reflective part of low-light images, and they converge slowly.

3. **Overexposure and Color Distortion**: Some advanced architectures (such as Transformers) can recover reflections well but suffer from overexposure in illuminated areas and usually have cumbersome training processes and high computational complexity.

To address these issues, the paper proposes a new low-light enhancement method—LLEMamba (Low-Light Enhancement via Relighting-Guided Mamba with Deep Unfolding Network). This method combines the advantages of Retinex optimization and Mamba deep priors by introducing a novel Mamba architecture (i.e., IFBMamba), which can effectively restore brightness and reflective parts while reducing computational complexity and maintaining theoretical interpretability. Experimental results show that LLEMamba outperforms existing state-of-the-art methods on multiple benchmark datasets.