Abstract:The goal of the present paper is to provide an embodied cognitive science view on representation. Using the fundamental task of category learning, we will demonstrate that this perspective enables us to shed new light on many pertinent issues and opens up new prospects for investigation. The main focus of this paper is on the prerequisites to acquire representations of objects in the real world. We suggest that the main prerequisite is embodiment which allows an agent--human, animal or robot--to manipulate its sensory input such that invariances are generated. These invariances, in turn, are the basis of representation formation. In other words, the paper does not focus on representations per se, but rather discusses the various processes involved in order to make learning and representation acquisition possible. The argument structure is as follows. First we introduce two new perspectives on representation, namely frame-of-reference, and complete agent. Then we elaborate the complete agent perspective and focus in particular on embodiment and situatedness. We argue that embodiment has two main aspects, a dynamic and an information theoretic one. Focusing on the latter, there are a number of implications: Representation can only be understood if the embedding of the neural substrate in the physical agent is known, which includes morphology (shape), positioning and nature of sensors. Because an autonomous mobile agent in the real world is exposed to a continuously changing high-dimensional stream of sensory stimulation, if it is to learn category distinctions, it first needs a focus of attention mechanism, and then it must have a way to reduce the dimensionality of this high-dimensional sensory stream. Learning is very hard because the invariances are typically not found in the sensory data directly--the classical problem of object constancy: it is a so-called type 2 problem. Rather than trying to improve the learning algorithms--which is the standard approach--the embodied cognitive science view suggests a different approach which focuses on the nature of the data: the agent is not passively exposed to a given data distribution, but, by exploiting its body and through the interaction with the environment, it can actually generate the data. More specifically, it can generate correlated data that has the property that it can be easily learned. This learnability is due to redundancies resulting from the appropriate interactions with the environment. Through such interactions, the former type 2 problem is transformed into a type 1 problem, thus reducing the complexity of the learning task by orders of magnitude. By observing the frame-of-reference problem we will discuss to what extent these invariances are reflected--represented--in the "neural substrate", i.e. the internal mechanisms of the agent. It is concluded, that representation is not a concept that can be studied in the abstract, but should be elaborated in the context of concrete agent-environment interactions. These ideas are all illustrated with examples of natural agents and artificial agents. In particular, we will present a suite of experiments on simulated and real-world artificial agents instantiating the main arguments.

Principled Limitations on Self-Representation for Generic Physical Systems

Is Subjective Self-Identity Programmable?

Are models our tools not our masters?

An Internal Model Principle For Robots

A Formalizable Proof of the No-Supervenience Theorem: A Diagonal Limitation on the Viability of Physicalist Theories of Consciousness

Inner-model reflection principles

The 'No-Supervenience' Theorem and its Implications for Theories of Consciousness

Reflexive measurements, self-inspection and self-representation

Modeling the subjective perspective of consciousness and its role in the control of behaviours

The Limits to Machine Consciousness

Fundamental constraints to the logic of living systems

The modularity of action and perception revisited using control theory and active inference

Representation in natural and artificial agents: an embodied cognitive science perspective

Modeling observers as physical systems representing the world from within: Quantum theory as a physical and self-referential theory of inference

Emergent Causality and the Foundation of Consciousness

Moderate Physical Perspectivalism

Understanding and Synergy: A Single Concept at Different Levels of Analysis?

Analysis of how a consciousness-lacking mechanistic observer perceives real events and those simulated by a computer

An Enactivist-Inspired Mathematical Model of Cognition

Bodily Boundaries of Sociality: Consciousness and the Self between Biology and Culture

Virtualization of Classical Reality: Limits and Possibilities in Physical Simulation