Abstract:Although it seems counter-intuitive, categorical colours do not exist as external physical entities but are very much the product of our brains. Our cortical machinery segments the world and associate objects to specific colour terms, which is not only convenient for communication but also increases the efficiency of visual processing by reducing the dimensionality of input scenes. Although the neural substrate for this phenomenon is unknown, a recent study of cortical colour processing has discovered a set of neurons that are isoresponsive to stimuli in the shape of 3D-ellipsoidal surfaces in colour-opponent space. We hypothesise that these neurons might help explain the underlying mechanisms of colour naming in the visual cortex. Following this, we propose a biologically-inspired colour naming model where each colour term - e.g. red, green, blue, yellow, etc. - is represented through an ellipsoid in 3D colour-opponent space. This paradigm is also supported by previous psychophysical colour categorisation experiments whose results resemble such shapes. "Belongingness" of each pixel to different colour categories is computed by a non-linear sigmoidal logistic function. The final colour term for a given pixel is calculated by a maximum pooling mechanism. The simplicity of our model allows its parameters to be learnt from a handful of segmented images. It also offers a straightforward extension to include further colour terms. Additionally, ellipsoids of proposed model can adapt to image contents offering a dynamical solution in order to address phenomenon of colour constancy. Our results on the Munsell chart and two datasets of real-world images show an overall improvement comparing to state-of-the-art algorithms.

Image cognition using contour curvature statistics

Image classification and cognition using contour curvature statistics

Boundary Cues for 3D Object Shape Recovery

The Geometric Invariance in Representing Multiple Objects in Visual Working Memory

Shape-Based Measures Improve Scene Categorization

Geometric probability, psychophysics and invariance

Neighbor-constrained Active Contours Without Edges.

Third-Order Edge Statistics: Contour Continuation, Curvature, and Cortical Connections

Predicting and Enhancing the Fairness of DNNs with the Curvature of Perceptual Manifolds

Curvature coding in early visual system revealed by scale variance during adaptation to flashing circles

The illumination-invariant recognition of 3D objects using local color invariants

Computing the Spatial Probability of Inclusion inside Partial Contours for Computer Vision Applications

A Cortical-Inspired Contour Completion Model Based on Contour Orientation and Thickness

Colour Terms: a Categorisation Model Inspired by Visual Cortex Neurons

Curvature Domains in V4 of Macaque Monkey.

Visualizing Point Cloud Classifiers by Curvature Smoothing

Curvature Integration in a 5D Kernel for Extracting Vessel Connections in Retinal Images

Qualitative perception of 3D shape from patterns of luminance curvature

3D Mixed Invariant and Its Application on Object Classification

Affine invariant descriptors for color images based on independent component analysis

Capturing human categorization of natural images at scale by combining deep networks and cognitive models