Assessing Colour Differences For Images

Mingronnier Luo

2012-01-01

Abstract:This paper provides an overview of the development of colour difference formulae and uniform colour spaces. It will then extended for evaluating images. The work under CIE TC8-02 Colour Difference Evaluation in Images will be introduced together with mor erecent works will be introduced.

What problem does this paper attempt to address?

Colour Differences for Complex Images.

C Sano,T Song,MR Luo

DOI: https://doi.org/10.2352/cic.2003.11.1.art00021

2003-01-01

Abstract:This paper describes the research work associated with the CIE TC8-02 Colour Difference Evaluation in Images, which aims to derive an industrial colour-difference evaluation method that is appropriate for complex colour images. The main aim of the TC is to recommend a colour-difference formula for complex image together with suitable perceptibility thresholds for industrial applications. With this in mind, a set of experimental results for assessing perceptibility thresholds were accumulated using printed images. The results from different data sets were found to be quite consistent. This set of images are currently being circulated and assessed at different imaging companies.
Evaluation of Colour-difference Formulae for Different Colour-difference Magnitudes

Han Wang,Guihua Cui,M. Ronnier Luo,Haisong Xu

DOI: https://doi.org/10.1002/col.20693

2008-01-01

Abstract:Most of the colour-difference formulae were developed to fit data sets having a limited range of colour-difference magnitudes. Hence, their performances are uncertain when applying them to a range of colour differences from very small to very large colour differences. This article describes an experiment including three parts according to the colour-difference magnitudes: large colour difference (LCD), small colour difference (SCD), and threshold colour difference (TCD) corresponding to mean ΔE values of 50.3, 3.5, and 0.6, respectively. Three visual assessment techniques were used: ratio judgement, pair comparison, and threshold for LCD, SCD, and TCD experiments, respectively. Three data sets were used to test six colour-difference formulae and uniform colour spaces (CIELAB, CIE94, CIEDE2000, CAM02-SCD, CAM02-UCS, and CAM02-LCD). The results showed that all formulae predicted visual results with great accuracy except CIELAB. CIEDE2000 worked effectively for the full range of colour differences, i.e., it performed the best for the TCD and SCD data and reasonably well for the LCD data. The three CIECAM02 based colour spaces gave quite satisfactory performance. © Wiley Periodicals, Inc. Col Res Appl, 2012
Colour-Difference Evaluation Using Colour Appearance Models

Changjun Li,M. Ronnier Luo,Guihua Cui

DOI: https://doi.org/10.2352/cic.2003.11.1.art00022

2003-01-01

Abstract:Colour appearance models (CAM) such as CIECAM97s and CIECAM02 were originally developed to predict the change of colour appearance under different viewing conditions. This paper describes the development of CAM extensions for evaluating colour-differences. The performances of the original CAMs and their extensions were tested using two types of colour-difference data: large and small magnitude colour-differences. The results showed that the CIECAM02 based models in general gave a more accurate prediction than the CIECAM97s based models. The modified version of CIECAM02 gave satisfactory performance in predicting different data sets (better than or equal to the best available uniform colour spaces and colour- difference formulae). This strongly suggests that a universal colour model based upon a colour appearance model can be achieved for all colorimetric applications: colour specification, colour difference and colour appearance.
Assessing colour differences with different magnitudes

K. M. Raymond HO,Guihua CUI,Ming Ronnier LUO,B. RIGG

2004-01-01

Abstract:The CIEDE2000 colour difference formula recommended by the CIE in 2000 is mainly used for evaluating small size colour-differences (less than 5 * ab E ∆ units). This study is intended to investigate the performances of this formula together with the others in predicting a newly accumulated experimental data set having a wide range of colour differences. The data included 4 subsets: surface textile samples, and CRT colours with small, medium and large magnitudes. Each subset had 62 pairs surrounding 5 colour centers.
Color-difference evaluation for digital images using a categorical judgment method.

Haoxue Liu,Min Huang,Guihua Cui,M Ronnier Luo,Manuel Melgosa

DOI: https://doi.org/10.1364/JOSAA.30.000616

2013-01-01

Journal of the Optical Society of America

Abstract:The CIELAB lightness and chroma values of pixels in five of the eight ISO SCID natural images were modified to produce sample images. Pairs of images were displayed on a calibrated monitor and assessed by a panel of 12 observers with normal color vision using a categorical judgment method. The experimental results showed that assuming the lightness parametric factor k(L)=1 to predict color differences in images, CIELAB performed better than CIEDE2000, CIE94, or CMC, which is a different result to the one found in color-difference literature for homogeneous color pairs. However, observers perceived CIELAB lightness and chroma differences in images in different ways. To fit current experimental data, a specific methodology is proposed to optimize k(L) in the color-difference formulas CIELAB, CIEDE2000, CIE94, and CMC. From the standardized residual sum of squares (STRESS) index, it was found that the optimized formulas, CIEDE2000(2.3:1), CIE94(3.0:1), and CMC(3.4:1), performed significantly better than their corresponding original forms with lightness parametric factor k(L)=1. Specifically, CIEDE2000(2.3:1) performed the best, with a satisfactory average STRESS value of 25.8, which is very similar to the 27.5 value that was found from the CIEDE2000(1:1) formula for the combined weighted dataset of homogeneous color samples employed at the development of this formula [J. Opt. Soc. Am. A25, 1828 (2008), Table 2]. However, fitting our experimental data, none of the four optimized formulas CIELAB(1.5:1), CIEDE2000(2.3:1), CIE94(3.0:1), and CMC(3.4:1) is significantly better than the others. Current results roughly agree with the recent CIE recommendation that color difference in images can be predicted by simply adopting a lightness parametric factor k(L)=2 in CIELAB or CIEDE2000 [CIE Publication 199:2011]. It was also found that the different contents of the five images have considerable influence on the performance of the tested color-difference formulas.
Perceptually-based color difference for complex images

guowei hong,ming ronnier luo

DOI: https://doi.org/10.1117/12.464761

2002-01-01

Abstract:Faithful colour reproduction of digital images requires a reliable measure to compare such images in order to evaluate the reproduction performance. The conventional methods attempt to apply the CIE Colorimetry based colour difference equations, such as CIELAB, CMC, CIE94 and CIEDE2000, to complex images on a pixel-by-pixel basis, and calculates the overall colour difference as the averaged difference of each pixel in the image. This method is simple and straightforward but often does not represent the colour difference perceived by human visual system. This paper proposes a new algorithm for calculating the overall colour difference between complex images. The results show that this new metric corresponds more closely to the colour difference perceived by human visual system.
A Comprehensive Test of Colour‐difference Formulae and Uniform Colour Spaces Using Available Visual Datasets

Ming Ronnier Luo,Qiang Xu,Michael Pointer,Manuel Melgosa,Guihua Cui,Changjun Li,Kaida Xiao,Min Huang

DOI: https://doi.org/10.1002/col.22844

IF: 1.668

2023-01-01

Color Research & Application

Abstract:The paper describes a comprehensive test to evaluate the performance of current colour-difference models using available experimental datasets. In total, 28 individual datasets were accumulated to test 17 colour-difference formulae, 13 of them based on Uniform Colour Spaces (UCSs) in terms of the Standardized Residual Sum of Squares (STRESS) measure. The 28 datasets were divided into three groups: Large Colour-Difference data (LCD), Small Colour-Difference data for surface colours (SCDs), and Small Colour Difference data for display colours (SCDd). For each colour model, four versions were tested: the original model, and that including k(L)-, Gamma- and k(L)/Gamma, which are the lightness parametric factor, the colour-difference exponent factor, and the combination of both, respectively, optimized to fit particular dataset(s). The statistical F-test was applied to test the difference between each pair of models. Furthermore, parametric effects between the large/small colour-difference magnitudes, and between surface/display colours were investigated. The results showed that CAM16-UCS significantly outperformed the other models for all groups. It accurately predicted all types of data and should be proposed for colour-difference evaluation across all industries.
Evaluation of Very Large Colour Difference Based on Object Surface Colours

Han Wang,Haisong Xu,Cui Guihua,Luo M.Ronnier

DOI: https://doi.org/10.3788/AOS20092907.1801

2009-01-01

Abstract:The performances of colour-difference formulae were investigated for predicting very large colour difference based on visual evaluation of object surface colours. The experiment of psychophysical visual assessment of 60 sample pairs with ratio judgement was carried out on 18 observers. The evaluation data of visual colour difference were btained. The data were used to evaluate the two common colour-difference formulae, CIELAB and CIEDE2000, and the two latest CAM-based colour-difference formulae, CAM02-UCS and CAM02-LCD. The detailed comparison and analysis indicated that CAM02-UCS and CAM02-LCD outperformed others for very large colour difference. In addition, the experimental data were employed to test the power law model proposed by Attridge et al. and the consistent result was obtained.
Color Difference Evaluation for Wide-Color-gamut Displays.

Baiyue Zhao,Qiang Xu,Ming Ronnier Luo

DOI: https://doi.org/10.1364/josaa.394132

2020-01-01

Abstract:With the emerging demand for wide-color-gamut displays, an issue has been raised in which the commonly used color difference formulae or uniform color spaces that were derived based on the data produced in the relatively smaller color gamut could be unreliable for predicting color differences in the highly saturated color regions. A psychophysical experiment was carried out for evaluating color difference at a luminance level of 310cd/m2 on a wide-color-gamut display with an approximate DCI-P3 color gamut. Twelve color centers were selected to cover the entire gamut boundary. There were 192 pairs of samples over 12 color centers judged by 18 observers using the greyscale psychophysical method. The data set was used to test the performance of six uniform color spaces and color difference equations, CIELAB, CIEDE2000, CAM02-UCS, Jzazbz, ICTCP, and nICTCP, a newly revised ICTCP formula. The color discrimination ellipses were used to test local and global uniformity of color spaces and compared with previous studies. The results revealed that all formulae improved their performance to have a mean lightness parametric factor of about 0.5. CAM02-UCS significantly outperformed the others in overall, local, and global uniformity. The high-quality visual data set is recommended to evaluate or to derive color difference formulae for WCG applications in the future.
Development of colour-difference formulae

M Ronnier Luo

DOI: https://doi.org/10.1111/j.1478-4408.2002.tb00248.x

2002-01-01

Coloration Technology

Abstract:Review of Progress in Coloration and Related TopicsVolume 32, Issue 1 p. 28-39 Development of colour-difference formulae M Ronnier Luo, M Ronnier Luo The author is a professor of colour science at the colour & Imaging Institute, University of Derby, UK. He has been involved with the development of various colour standards and chairs two CIE technical committees.Search for more papers by this author M Ronnier Luo, M Ronnier Luo The author is a professor of colour science at the colour & Imaging Institute, University of Derby, UK. He has been involved with the development of various colour standards and chairs two CIE technical committees.Search for more papers by this author First published: 12 January 2010 https://doi.org/10.1111/j.1478-4408.2002.tb00248.xCitations: 32 AboutPDF ToolsRequest permissionExport citationAdd to favoritesTrack citation ShareShare Give accessShare full text accessShare full-text accessPlease review our Terms and Conditions of Use and check box below to share full-text version of article.I have read and accept the Wiley Online Library Terms and Conditions of UseShareable LinkUse the link below to share a full-text version of this article with your friends and colleagues. Learn more.Copy URL Share a linkShare onFacebookTwitterLinked InRedditWechat Citing Literature Volume32, Issue1June 2002Pages 28-39 RelatedInformation
Colour‐difference Evaluation Using CRT Colours. Part I: Data Gathering and Testing Colour Difference Formulae

GH Cui,MR Luo,B Rigg,W Li

DOI: https://doi.org/10.1002/col.1055

IF: 1.668

2001-01-01

Color Research & Application

Abstract:A large set of colour discrimination data based upon Cathode Ray Tube (CRT) colours was accumulated. The experiment was carried out to study the effect changes in viewing parameters on perceived colour differences. It was divided into sixteen phases. Each phase was conducted under a different set of experimental conditions including different sample sizes, backgrounds, frames, widths. and colours of separation between pairs of samples. For each phase, 134 pairs of colours with average 2.7 CIELAB colour difference were studied The colours closely corresponded to the five colour centers proposed by the CIE. Each pair was assessed by, 10 or 20 observers using the gray, scale method. The visual results from the present study were also used to test six colour-difference formulae: CIELAB, CMC, BFD, CIE94, LCD, and CIEDE2000. The latter outperformed the other formulae and is the new CIE colour-difference equation. The current results were also compared with the other datasets based upon surface colours. The present results are consistent with those obtained for surface colours. (C) 2001 John Wiley & Sons, Inc.
Experimental Filters for Estimating Image Differences.

Zhaohui Wang,M. Ronnier Luo

DOI: https://doi.org/10.2352/cgiv.2008.4.1.art00026

2008-01-01

Abstract:Evaluation of image difference including colour and spatial aspects is often required in colour reproduction industry. The objective of a successful image difference model should have a good agreement with the image difference perceived by observers. The perceived image difference is affected by many factors, such as image characteristics, human vision system, rendering methods and viewing conditions. The current conventional colour difference formulae can not well predict the perceived difference. In this paper, a new experimental method was designed to investigate how image difference is identified by human observers.
Testing Uniform Colour Spaces Using Printed Samples.

Min Huang,Haoxue Liu,M. Ronnier Luo,Guihua Cui

DOI: https://doi.org/10.1002/col.20689

2010-01-01

Abstract:A grey-scale psychophysical experiment was carried out for evaluating colour differences using printed colour patches. In total, 446 pairs of printed samples were prepared surrounding 17 colour centers recommended by the CIE with an average Delta E*(ab) of 3 units. Each pair was assessed 27 times by a panel of 9 normal colour vision observers.The visual results were used to test the existing colour difference formulae and uniform colour spaces. The results showed that all formulae and spaces outperformed CIELAB. The colour discrimination ellipses were used to compare with those of the earlier studies and they agreed with each other.
A Parametric Colour Difference Equation to Evaluate Colour Difference Magnitude Effect for Gapless Printed Stimuli

Fereshteh Mirjalili,Ming Ronnier Luo,Guihua Cui,Ján Morovic

DOI: https://doi.org/10.2352/issn.2169-2629.2018.26.123

2018-01-01

Color and Imaging Conference

Abstract:In the present study, attempts were made to investigate the effect of colour difference magnitude on colour difference perception of pairs with no separation. To this end, a large number of printed sample pairs with no separation were prepared around 11 CIE recommended colour centres. The sample pairs, representing four colour difference magnitudes of 1, 2, 4 and 8 CIELAB units, were visually evaluated by a panel of 19 observers using the grey scale method. By comparing the present data set with those previously published using pairs with hair-line separation, it was found that separation had a certain impact on colour difference perception. The visual data were used to test the performance of five colour difference formulae: CIELAB, CIE94, CIEDE2000, CAM02-UCS, and CAMI6-UCS. A clear effect of colour difference magnitude on total colour difference perception of pairs with no separation was revealed and a generic simple equation was modelled. By introducing this, a new colour difference equation as the modification of CIEDE2000 was proposed for pairs with no separation. The new formula was found to perform much more precise than the original formulae.
A Parametric Colour-difference Study on the Separation and CMF Effects.

Qiang Xu,Keyu Shi,Ming Ronnier Luo

DOI: https://doi.org/10.2352/cic.2022.30.1.09

2022-01-01

Abstract:An experiment was carried out to investigate separation and CMF effects on colour-difference evaluation using display colours. In total, 1120 sample pairs around 5 CIE recommended colour centres were assessed 20 times using the grey-scale method. Sample pairs were selected to have colour-difference of 4 and 8 CIELAB units, include or exclude separation between two colours on a pair, have four fields of view (FoVs), 2º, 4º, 10º and 20º. The experiment results were used to test 3 colour-difference equations or uniform colour spaces, CIELAB, CIEDE2000 and CAM16-UCS. For separation (S) sample pairs, CIEDE2000 performed the best, followed by CAM16-UCS and CIELAB the worst. For no-separation (NS) sample pairs, all models gave worse performance than separation (S) sample pairs. The parametric formula derived earlier was verified to predict colour-difference for sample pairs to have no-separation line. Five colour matching functions (CMFs), CIE 1931, CIE 1964, CIE 2006-2º, CIE 2006-10º and 2006-4º were tested and the results indicated very small CMF effect on calculating colour-difference.
Uniform Colour Spaces Based on CIECAM02 Colour Appearance Model

M. Ronnier Luo,Guihua Cui,Changjun Li

DOI: https://doi.org/10.1002/col.20227

2006-01-01

Abstract:Can a single colour model be used for all colorimetric applications? This article intends to answer that question. Colour appearance models have been developed to predict colour appearance under different viewing conditions. They are also capable of evaluating colour differences because of their embedded uniform colour spaces. This article first tests the performance of the CIE 2002 colour appearance model, CIECAM02, in predicting three types of colour discrimination data sets: large- and small-magnitude colour differences under daylight illuminants and small-magnitude colour differences under illuminant A. The results showed that CIECAM02 gave reasonable performance compared with the best available formulae and uniform colour spaces. It was further extended to give accurate predictions to all types of colour discrimination data. The results were very encouraging in that the CIECAM02 extensions performed second best among all the colour models tested and only slightly poorer than the models that were developed to fit a particular data set. One extension derived to fit all types of data can predict well for colour differences having a large range of difference magnitudes. (C) 2006 Wiley Periodicals, Inc.
EXTENSION OF COLOUR DIFFERENCE FORMULAE FOR HDR APPLICATIONS

Qiang Xu,Ming Luo

DOI: https://doi.org/10.25039/x46.2019.op25

2019-01-01

Abstract:The goal of the work was to extend uniform colour spaces and colour difference formulae for High Dynamic Range (HDR) applications.An experiment was carried out using 140 paint sample pairs to visual assess colour differences of 9 levels from very dark (0.25 cd/m 2 ) to very bright (1128 cd/m 2 ) luminance range.The results were used to test and extend 5 colour difference equations to consider HDR application, including CIELAB, CIEDE2000, CAM02-UCS, ICtCp and Jzazbz.
Colour Difference Modelling for Moving Images.

Jin-Seo Kim,Maeng-Sub Cho,Bon-Ki Koo,M. Ronnier Luo,Stephen Westland

DOI: https://doi.org/10.2352/cgiv.2008.4.1.art00038

2008-01-01

Abstract:Psychophysical experiments were carried out to collect the observer accuracy data which are used to analyse the performance of state of the art colour difference formulae, and to derive a colour difference model for moving images. Three MPEG standard test streams were used to the study. The initial hypothesis for the data analysis of moving images is that the moving images are combinations of consecutive still images. Seven image quality attributes were asked to the observers. colour difference thresholds were analysed before the calculation of colour differences. The result showed that human visual system (HVS) is highly sensitive to the difference of memory colours especially to skin tone, and the sensitivity decrease along with the increase of spatial and temporal frequencies. Then the performance analysis of state of the art colour difference formulae such as CIELAB, CIE94, CIELAB CMC, CIEDE2000, SCIELAB and iCAM were performed to see which formula can best predict the differences of various image quality attributes for moving images. Wrong decision (WD) analysis was used and the results showed that CIELAB performed best for question of overall image difference. For sharpness difference, SCIELAB performed best followed by CIELAB. Colour difference models for moving images are proposed by use of temporal blur filter to the array of corresponding pixels throughout the sequences of images. CIELAB colour difference model with temporal blur performed best and it can be the final candidate of the novel colour difference model for moving images.
Evaluation of Threshold Color Differences Using Printed Samples.

Min Huang,Haoxue Liu,Guihua Cui,M. Ronnier Luo,Manuel Melgosa

DOI: https://doi.org/10.1364/josaa.29.000883

2012-01-01

Abstract:The performances of uniform color spaces and color-difference formulae for predicting threshold color differences were investigated based on visual assessments of 893 pairs of printed color patches under a D65 source. The average ΔE(ab,10)* of the pairs was 1.1 units. A threshold psychophysical experiment was repeated three times by a panel of 16 observers with normal color vision. The experimental data were used to evaluate nine color-difference formulae and uniform color spaces using the standardized residual sum of squares (STRESS) measure. The results indicated that all formulae and spaces performed very similarly to each other, and outperformed CIELAB for threshold color differences. The chromaticity-discrimination ellipses were used to compare with previous results from small color differences [Color Res. Appl. (2011), doi:10.1002/col.20689], and they agreed with each other, except for the purple color center.
Image Quality Assessment and Color Difference

Dogancan Temel,Ghassan AlRegib

DOI: https://doi.org/10.1109/GlobalSIP.2014.7032265

2018-11-23

Abstract:An average healthy person does not perceive the world in just black and white. Moreover, the perceived world is not composed of pixels and through vision humans perceive structures. However, the acquisition and display systems discretize the world. Therefore, we need to consider pixels, structures and colors to model the quality of experience. Quality assessment methods use the pixel-wise and structural metrics whereas color science approaches use the patch-based color differences. In this work, we combine these approaches by extending CIEDE2000 formula with perceptual color difference to assess image quality. We examine how perceptual color difference-based metric (PCDM) performs compared to PSNR, CIEDE2000, SSIM, MS-SSIM and CW-SSIM on the LIVE database. In terms of linear correlation, PCDM obtains compatible results under white noise (97.9%), Jpeg (95.9%) and Jp2k (95.6%) with an overall correlation of 92.7%. We also show that PCDM captures color-based artifacts that can not be captured by structure-based metrics.

Image and Video Processing,Multimedia,Signal Processing

Assessing Colour Differences For Images

Colour Differences for Complex Images.

Evaluation of Colour-difference Formulae for Different Colour-difference Magnitudes

Colour-Difference Evaluation Using Colour Appearance Models

Assessing colour differences with different magnitudes

Color-difference evaluation for digital images using a categorical judgment method.

Perceptually-based color difference for complex images

A Comprehensive Test of Colour‐difference Formulae and Uniform Colour Spaces Using Available Visual Datasets

Evaluation of Very Large Colour Difference Based on Object Surface Colours

Color Difference Evaluation for Wide-Color-gamut Displays.

Development of colour-difference formulae

Colour‐difference Evaluation Using CRT Colours. Part I: Data Gathering and Testing Colour Difference Formulae

Experimental Filters for Estimating Image Differences.

Testing Uniform Colour Spaces Using Printed Samples.

A Parametric Colour Difference Equation to Evaluate Colour Difference Magnitude Effect for Gapless Printed Stimuli

A Parametric Colour-difference Study on the Separation and CMF Effects.

Uniform Colour Spaces Based on CIECAM02 Colour Appearance Model

EXTENSION OF COLOUR DIFFERENCE FORMULAE FOR HDR APPLICATIONS

Colour Difference Modelling for Moving Images.

Evaluation of Threshold Color Differences Using Printed Samples.

Image Quality Assessment and Color Difference