Deterministic Neural Illumination Mapping for Efficient Auto-White Balance Correction

Furkan Kınlı,Doğa Yılmaz,Barış Özcan,Furkan Kıraç
2023-08-08
Abstract:Auto-white balance (AWB) correction is a critical operation in image signal processors for accurate and consistent color correction across various illumination scenarios. This paper presents a novel and efficient AWB correction method that achieves at least 35 times faster processing with equivalent or superior performance on high-resolution images for the current state-of-the-art methods. Inspired by deterministic color style transfer, our approach introduces deterministic illumination color mapping, leveraging learnable projection matrices for both canonical illumination form and AWB-corrected output. It involves feeding high-resolution images and corresponding latent representations into a mapping module to derive a canonical form, followed by another mapping module that maps the pixel values to those for the corrected version. This strategy is designed as resolution-agnostic and also enables seamless integration of any pre-trained AWB network as the backbone. Experimental results confirm the effectiveness of our approach, revealing significant performance improvements and reduced time complexity compared to state-of-the-art methods. Our method provides an efficient deep learning-based AWB correction solution, promising real-time, high-quality color correction for digital imaging applications. Source code is available at <a class="link-external link-https" href="https://github.com/birdortyedi/DeNIM/" rel="external noopener nofollow">this https URL</a>
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
This paper aims to address the problem of Auto-White Balance (AWB) correction. Specifically, the study proposes a new efficient AWB correction method that can achieve at least a 35-fold increase in processing speed on high-resolution images, while performing comparably to or even better than existing state-of-the-art methods. Inspired by deterministic color style transfer techniques, the authors introduce a deterministic illumination color mapping method that handles standard illumination forms and AWB correction outputs through a learnable projection matrix. This method is not sensitive to input resolution and can seamlessly integrate any pre-trained AWB network as a backbone. Experimental results show that this method can significantly improve performance and reduce time complexity, offering clear advantages over existing methods, particularly suitable for digital imaging applications requiring real-time high-quality color correction.