Abstract:The goal of the present paper is to provide an embodied cognitive science view on representation. Using the fundamental task of category learning, we will demonstrate that this perspective enables us to shed new light on many pertinent issues and opens up new prospects for investigation. The main focus of this paper is on the prerequisites to acquire representations of objects in the real world. We suggest that the main prerequisite is embodiment which allows an agent--human, animal or robot--to manipulate its sensory input such that invariances are generated. These invariances, in turn, are the basis of representation formation. In other words, the paper does not focus on representations per se, but rather discusses the various processes involved in order to make learning and representation acquisition possible. The argument structure is as follows. First we introduce two new perspectives on representation, namely frame-of-reference, and complete agent. Then we elaborate the complete agent perspective and focus in particular on embodiment and situatedness. We argue that embodiment has two main aspects, a dynamic and an information theoretic one. Focusing on the latter, there are a number of implications: Representation can only be understood if the embedding of the neural substrate in the physical agent is known, which includes morphology (shape), positioning and nature of sensors. Because an autonomous mobile agent in the real world is exposed to a continuously changing high-dimensional stream of sensory stimulation, if it is to learn category distinctions, it first needs a focus of attention mechanism, and then it must have a way to reduce the dimensionality of this high-dimensional sensory stream. Learning is very hard because the invariances are typically not found in the sensory data directly--the classical problem of object constancy: it is a so-called type 2 problem. Rather than trying to improve the learning algorithms--which is the standard approach--the embodied cognitive science view suggests a different approach which focuses on the nature of the data: the agent is not passively exposed to a given data distribution, but, by exploiting its body and through the interaction with the environment, it can actually generate the data. More specifically, it can generate correlated data that has the property that it can be easily learned. This learnability is due to redundancies resulting from the appropriate interactions with the environment. Through such interactions, the former type 2 problem is transformed into a type 1 problem, thus reducing the complexity of the learning task by orders of magnitude. By observing the frame-of-reference problem we will discuss to what extent these invariances are reflected--represented--in the "neural substrate", i.e. the internal mechanisms of the agent. It is concluded, that representation is not a concept that can be studied in the abstract, but should be elaborated in the context of concrete agent-environment interactions. These ideas are all illustrated with examples of natural agents and artificial agents. In particular, we will present a suite of experiments on simulated and real-world artificial agents instantiating the main arguments.

A Philosophical Understanding of Representation for Neuroscience

Three aspects of representation in neuroscience

Desiderata of evidence for representation in neuroscience

Representation and identity - convergence of brain research and mind-brain philosophy

What is neurorepresentationalism? From neural activity and predictive processing to multi-level representations and consciousness

Formalising the role of behaviour in neuroscience

Neural and phenotypic representation under the free-energy principle

The Metaphysics of Representation

The Neurobiology Of Thinking, Identity, And Geniality

Arguments about the nature of concepts: Symbols, embodiment, and beyond

On the Relation Between the Mind and the Brain: A Neuroscience Perspective

The Neuronal Representation of Information in the Human Brain

Conscious Representations: An Intractable Problem for the Computational Theory of Mind

A Goal-Driven Approach to Systems Neuroscience

On the Nature of Explanations Offered by Network Science: A Perspective From and for Practicing Neuroscientists

The Neuroscience of Advanced Scientific Concepts

Representational maps in the brain: concepts, approaches, and applications

Representation in natural and artificial agents: an embodied cognitive science perspective

Neural representation in active inference: using generative models to interact with -- and understand -- the lived world

Naming our concerns about neuroscience: a review of Bennett and Hacker's philosophical foundations of neuroscience

Neural representation in active inference: Using generative models to interact with—and understand—the lived world