Abstract:The long-standing theory that a colour-naming system evolves under dual pressure of efficient communication and perceptual mechanism is supported by more and more linguistic studies, including analysing four decades of diachronic data from the Nafaanra language. This inspires us to explore whether machine learning could evolve and discover a similar colour-naming system via optimising the communication efficiency represented by high-level recognition performance. Here, we propose a novel colour quantisation transformer, CQFormer, that quantises colour space while maintaining the accuracy of machine recognition on the quantised images. Given an RGB image, Annotation Branch maps it into an index map before generating the quantised image with a colour palette; meanwhile the Palette Branch utilises a key-point detection way to find proper colours in the palette among the whole colour space. By interacting with colour annotation, CQFormer is able to balance both the machine vision accuracy and colour perceptual structure such as distinct and stable colour distribution for discovered colour system. Very interestingly, we even observe the consistent evolution pattern between our artificial colour system and basic colour terms across human languages. Besides, our colour quantisation method also offers an efficient quantisation method that effectively compresses the image storage while maintaining high performance in high-level recognition tasks such as classification and detection. Extensive experiments demonstrate the superior performance of our method with extremely low bit-rate colours, showing potential to integrate into quantisation network to quantities from image to network activation. The source code is available at <a class="link-external link-https" href="https://github.com/ryeocthiv/CQFormer" rel="external noopener nofollow">this https URL</a>

Learning to Structure an Image with Few Colors

Learning to Structure an Image with Few Colors and Beyond

Scalable Deep Color Quantization: a Cluster Imitation Approach

Name Your Colour For the Task: Artificially Discover Colour Naming via Colour Quantisation Transformer

Structured Binary Neural Networks for Image Recognition

Sparsity-based Color Quantization with Preserved Image Details

Lossy Image Compression with Stochastic Quantization

A Novel Color Space Quantization Scheme

MultiColor: Image Colorization by Learning from Multiple Color Spaces

ColorNet: Investigating the importance of color spaces for image classification

Gated CNN for Visual Quality Assessment Based on Color Perception

Hierarchical Color Quantization Based on Self-organization

An Efficient Color Quantization Based on Generic Roughness Measure

Evaluating the Effectiveness of Hybrid Quantum-Classical Convolutional Neural Networks for Image Classification in Multiple Color Spaces

Focused Quantization for Sparse CNNs

You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement

Perceptually Based Approach To Color Quantization

A new approach of color image quantization based on Normalized Cut algorithm.

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System.

Invertible Grayscale with Sparsity Enforcing Priors.

Improvement to Color Quantization Based on Self-Organizing Maps for Computer Graphics Partition