Abstract:The goal of the present paper is to provide an embodied cognitive science view on representation. Using the fundamental task of category learning, we will demonstrate that this perspective enables us to shed new light on many pertinent issues and opens up new prospects for investigation. The main focus of this paper is on the prerequisites to acquire representations of objects in the real world. We suggest that the main prerequisite is embodiment which allows an agent--human, animal or robot--to manipulate its sensory input such that invariances are generated. These invariances, in turn, are the basis of representation formation. In other words, the paper does not focus on representations per se, but rather discusses the various processes involved in order to make learning and representation acquisition possible. The argument structure is as follows. First we introduce two new perspectives on representation, namely frame-of-reference, and complete agent. Then we elaborate the complete agent perspective and focus in particular on embodiment and situatedness. We argue that embodiment has two main aspects, a dynamic and an information theoretic one. Focusing on the latter, there are a number of implications: Representation can only be understood if the embedding of the neural substrate in the physical agent is known, which includes morphology (shape), positioning and nature of sensors. Because an autonomous mobile agent in the real world is exposed to a continuously changing high-dimensional stream of sensory stimulation, if it is to learn category distinctions, it first needs a focus of attention mechanism, and then it must have a way to reduce the dimensionality of this high-dimensional sensory stream. Learning is very hard because the invariances are typically not found in the sensory data directly--the classical problem of object constancy: it is a so-called type 2 problem. Rather than trying to improve the learning algorithms--which is the standard approach--the embodied cognitive science view suggests a different approach which focuses on the nature of the data: the agent is not passively exposed to a given data distribution, but, by exploiting its body and through the interaction with the environment, it can actually generate the data. More specifically, it can generate correlated data that has the property that it can be easily learned. This learnability is due to redundancies resulting from the appropriate interactions with the environment. Through such interactions, the former type 2 problem is transformed into a type 1 problem, thus reducing the complexity of the learning task by orders of magnitude. By observing the frame-of-reference problem we will discuss to what extent these invariances are reflected--represented--in the "neural substrate", i.e. the internal mechanisms of the agent. It is concluded, that representation is not a concept that can be studied in the abstract, but should be elaborated in the context of concrete agent-environment interactions. These ideas are all illustrated with examples of natural agents and artificial agents. In particular, we will present a suite of experiments on simulated and real-world artificial agents instantiating the main arguments.

Categorization in Artificial Agents: Guidance on Empirical Research?

Coordinating perceptually grounded categories through language: a case study for colour

Categorization in the Wild: Generalizing Cognitive Models to Naturalistic Data across Languages

Cultural evolution of categorization

The Information‐Processing Perspective on Categorization

Neuropsychology of AI: Relationship Between Activation Proximity and Categorical Proximity Within Neural Categories of Synthetic Cognition

Exploring the Categorical Nature of Colour Perception: Insights from Artificial Networks

When categorization-based stranger avoidance explains the uncanny valley: A comment on MacDorman & Chattopadhyay (2016)

Human Cognitive Categorization and English Teaching

Artificial Moral Agents: A Survey of the Current Status

Categories in Social Interaction: Unlocking the Resources of Conversation Analysis and Membership Categorization for Psychological Science

Influences of Culture and Visual Context on Real-Time Social Categorization.

Cultural Differences in People's Reactions and Applications of Robots, Algorithms, and Artificial Intelligence

Representation in natural and artificial agents: an embodied cognitive science perspective

Modeling the emergence of universality in color naming patterns

Toward an Epistemic-Logical Theory of Categorization

Cognitive and Neural Mechanisms of Category-based Feature Inference

How Culture Shapes Social Categorization and Inductive Reasoning:A Developmental Comparison between the United States and China

A theory of moral categorization: The conceptual performance of moral cognition

A Taxonomy of Social Cues for Conversational Agents