Abstract:The long-standing theory that a colour-naming system evolves under dual pressure of efficient communication and perceptual mechanism is supported by more and more linguistic studies, including analysing four decades of diachronic data from the Nafaanra language. This inspires us to explore whether machine learning could evolve and discover a similar colour-naming system via optimising the communication efficiency represented by high-level recognition performance. Here, we propose a novel colour quantisation transformer, CQFormer, that quantises colour space while maintaining the accuracy of machine recognition on the quantised images. Given an RGB image, Annotation Branch maps it into an index map before generating the quantised image with a colour palette; meanwhile the Palette Branch utilises a key-point detection way to find proper colours in the palette among the whole colour space. By interacting with colour annotation, CQFormer is able to balance both the machine vision accuracy and colour perceptual structure such as distinct and stable colour distribution for discovered colour system. Very interestingly, we even observe the consistent evolution pattern between our artificial colour system and basic colour terms across human languages. Besides, our colour quantisation method also offers an efficient quantisation method that effectively compresses the image storage while maintaining high performance in high-level recognition tasks such as classification and detection. Extensive experiments demonstrate the superior performance of our method with extremely low bit-rate colours, showing potential to integrate into quantisation network to quantities from image to network activation. The source code is available at <a class="link-external link-https" href="https://github.com/ryeocthiv/CQFormer" rel="external noopener nofollow">this https URL</a>

Learning to Structure an Image with Few Colors and Beyond

Learning to Structure an Image with Few Colors

Scalable Deep Color Quantization: a Cluster Imitation Approach

Structured Binary Neural Networks for Image Recognition

MultiColor: Image Colorization by Learning from Multiple Color Spaces

ColorNet: Investigating the importance of color spaces for image classification

Gated CNN for Visual Quality Assessment Based on Color Perception

Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System.

Spatially Consistent Transformer for Colorization in Monochrome-Color Dual-Lens System

A Neural Network Model for Color Element Data Analysis for Urban Spatial Environment

A Long Skip Connection for Enhanced Color Selectivity in CNN Architectures

Learn to Be Clear and Colorful: An End-to-End Network for Panchromatic Image Enhancement

Name Your Colour For the Task: Artificially Discover Colour Naming via Colour Quantisation Transformer

Selective, Structural, Subtle: Trilinear Spatial-Awareness for Few-Shot Fine-Grained Visual Recognition

Evaluating the Effectiveness of Hybrid Quantum-Classical Convolutional Neural Networks for Image Classification in Multiple Color Spaces

You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement

Learning Color Equivariant Representations

Convolutional Neural Network Image Classification Based on Different Color Spaces

Pyramid Convolutional Network for Colorization in Monochrome-Color Multi-Lens Camera System.

Ensemble Learning Based Multi-Color Space in Convolutional Neural Network

Color Equivariant Convolutional Networks