Abstract:Color constancy is the recovery of true surface color from observed color, and requires estimating the chromaticity of scene illumination to correct for the bias it induces. In this paper, we show that the per-pixel color statistics of natural scenes---without any spatial or semantic context---can by themselves be a powerful cue for color constancy. Specifically, we describe an illuminant estimation method that is built around a "classifier" for identifying the true chromaticity of a pixel given its luminance (absolute brightness across color channels). During inference, each pixel's observed color restricts its true chromaticity to those values that can be explained by one of a candidate set of illuminants, and applying the classifier over these values yields a distribution over the corresponding illuminants. A global estimate for the scene illuminant is computed through a simple aggregation of these distributions across all pixels. We begin by simply defining the luminance-to-chromaticity classifier by computing empirical histograms over discretized chromaticity and luminance values from a training set of natural images. These histograms reflect a preference for hues corresponding to smooth reflectance functions, and for achromatic colors in brighter pixels. Despite its simplicity, the resulting estimation algorithm outperforms current state-of-the-art color constancy methods. Next, we propose a method to learn the luminance-to-chromaticity classifier "end-to-end". Using stochastic gradient descent, we set chromaticity-luminance likelihoods to minimize errors in the final scene illuminant estimates on a training set. This leads to further improvements in accuracy, most significantly in the tail of the error distribution.

Estimating the scene illumination chromaticity by using a neural network

Color Constancy via Multi-Scale Region-Weighed Network Guided by Semantics

A Neural Network Based Low-Light Image Denoising Method

U-Net-Based Multispectral Image Generation from an RGB Image

Color Constancy by Learning to Predict Chromaticity from Luminance

Deep Neural Models for color discrimination and color constancy

Dive into Illuminant Estimation from a Pure Color View

Learning Enriched Illuminants for Cross and Single Sensor Color Constancy

Color Constancy from a Pure Color View.

Multi Illumination Color Constancy Based on Multi-Scale Supervision and Single-Scale Estimation Cascade Convolution Neural Network.

Ambient-NeRF: light train enhancing neural radiance fields in low-light conditions with ambient-illumination

Self-Supervised Learning of Color Constancy

Learning to predict indoor illumination from a single image

Object-Based Illumination Estimation with Rendering-Aware Neural Networks

Underexposed Photo Enhancement Using Deep Illumination Estimation

Spatially and color consistent environment lighting estimation using deep neural networks for mixed reality

Color Constancy Using Bright-Neutral Pixels

A depth iterative illumination estimation network for low-light image enhancement based on retinex theory

Color Recognition in Challenging Lighting Environments: CNN Approach

Lit me up: A reference free adaptive low light image enhancement for in-the-wild conditions

Automatic Illumination Spectrum Recovery