Abstract:Evolution has shaped animal brains to detect sensory regularities in environmental stimuli. In addition, many species map one-dimensional quantities across sensory modalities, such as conspecific faces to voices, or high-pitched sounds to bright light. If basic patterns like repetitions and identities are frequently perceived in different sensory modalities, it could be advantageous to detect cross-modal isomorphisms, i.e. develop modality-independent representations of structural features, exploitable in visual, tactile, and auditory processing. While cross-modal mappings are common in the animal kingdom, the ability to map similar (isomorphic) structures across domains has been demonstrated in humans but no other animals. We tested cross-modal isomorphisms in two chimpanzees (Pan troglodytes). Individuals were previously trained to choose structurally 'symmetric' image sequences (two identical geometrical shapes separated by a different shape) presented beside 'edge' sequences (two identical shapes preceded or followed by a different one). Here, with no additional training, the choice between symmetric and edge visual sequences was preceded by playback of three concatenated sounds, which could be symmetric (mimicking the symmetric structure of reinforced images) or edge. The chimpanzees spontaneously detected a visual-auditory isomorphism. Response latencies in choosing symmetric sequences were shorter when presented with (structurally isomorphic) symmetric, rather than edge, sound triplets: The auditory stimuli interfered, based on their structural properties, with processing of the learnt visual rule. Crucially, the animals had neither been exposed to the acoustic sequences before the experiment, nor were they trained to associate sounds to images. Our result provides the first evidence of structure processing across modalities in a non-human species. It suggests that basic cross-modal abstraction capacities transcend linguistic abilities and might involve evolutionary ancient neural mechanisms.

Sensitivity to geometric shape regularity in humans and baboons: A putative signature of human singularity

Two brain systems for the perception of geometric shapes

Human-Like Geometric Abstraction in Large Pre-trained Neural Networks

Relational Constraints On Neural Networks Reproduce Human Biases towards Abstract Geometric Regularity

Humans and marmosets share similar face recognition signatures in shape-based visual face discrimination behavior

Visual Complexity of Shapes: a Hierarchical Perceptual Learning Model

Human shape perception spontaneously discovers the biological origin of novel, but natural, stimuli

Approaching human 3D shape perception with neurally mappable models

The language of geometry: Fast comprehension of geometrical primitives and rules in human adults and preschoolers

Chimpanzees process structural isomorphisms across sensory modalities

Brain areas for reversible symbolic reference, a potential singularity of the human brain

Curvature Domains in V4 of Macaque Monkey.

Shape-invariant encoding of dynamic primate facial expressions in human perception

New Human-Specific Brain Landmark: the Depth Asymmetry of Superior Temporal Sulcus

Revisiting the baby schema by a geometric morphometric analysis of infant facial characteristics across great apes

Symmetry as an Organizing Principle for Geometric Intelligence

Expertise for conspecific face individuation in the human brain

Recognition of Shapes across Modalities by Infants

The Structures of Letters and Symbols Throughout Human History Are Selected to Match Those Found in Objects in Natural Scenes.

Monkeys engage in visual simulation to solve complex problems

Shape Selectivity of Middle Superior Temporal Sulcus Body Patch Neurons