Retinex-RAWMamba: Bridging Demosaicing and Denoising for Low-Light RAW Image Enhancement

Xianmin Chen,Peiliang Huang,Xiaoxu Feng,Dingwen Zhang,Longfei Han,Junwei Han

2024-09-11

Abstract:Low-light image enhancement, particularly in cross-domain tasks such as mapping from the raw domain to the sRGB domain, remains a significant challenge. Many deep learning-based methods have been developed to address this issue and have shown promising results in recent years. However, single-stage methods, which attempt to unify the complex mapping across both domains, leading to limited denoising performance. In contrast, two-stage approaches typically decompose a raw image with color filter arrays (CFA) into a four-channel RGGB format before feeding it into a neural network. However, this strategy overlooks the critical role of demosaicing within the Image Signal Processing (ISP) pipeline, leading to color distortions under varying lighting conditions, especially in low-light scenarios. To address these issues, we design a novel Mamba scanning mechanism, called RAWMamba, to effectively handle raw images with different CFAs. Furthermore, we present a Retinex Decomposition Module (RDM) grounded in Retinex prior, which decouples illumination from reflectance to facilitate more effective denoising and automatic non-linear exposure correction. By bridging demosaicing and denoising, better raw image enhancement is achieved. Experimental evaluations conducted on public datasets SID and MCR demonstrate that our proposed RAWMamba achieves state-of-the-art performance on cross-domain mapping.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The paper aims to address the problem of RAW image enhancement under low-light conditions, particularly in cross-domain tasks (mapping from the RAW domain to the sRGB domain). Specifically, the paper makes the following contributions:

1. **Proposed a novel scanning mechanism**: Designed a new scanning mechanism called RAWMamba, which features an attention mechanism with a global receptive field and linear complexity, better adapting to the characteristics of RAW images with different color filter arrays (CFA).

2. **Introduced the Retinex Decomposition Module (RDM)**: Based on the Retinex theory, the RDM module is proposed to separate illumination and reflection, achieving automatic nonlinear exposure correction, thereby improving denoising effects and the accuracy of brightness correction.

3. **Decoupled task processing**: The task is decoupled into two subtasks—RAW domain denoising and cross-domain mapping. By optimizing these two stages separately, overall performance is improved.

4. **Experimental validation**: Quantitative and qualitative evaluations were conducted on the SID and MCR benchmark datasets. The results show that the proposed method outperforms existing methods in terms of Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Learned Perceptual Image Patch Similarity (LPIPS).

In summary, the paper aims to address the limitations of single-stage methods in handling low-light RAW images by introducing the RAWMamba mechanism and the Retinex Decomposition Module, and significantly improves the final image quality through a multi-stage approach.