Abstract:This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. In this study, the semiotic communication refers to exchanging signs composed of the signifier (i.e., words) and the signified (i.e., categories). We define the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchanging signs with other agents as basic functions of the semiotic communication. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system (i.e., agent society) is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, i.e., the complete system can be regarded as a single agent performing multimodal categorization using the sensors of all agents, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence, i.e., forming and sharing signs and categories, is also verified in an experiment with two agents observing daily objects in the real-world environment. In the experiment, we compared three communication algorithms: no communication, no rejection, and the proposed algorithm. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories.

Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Models

Emergent communication through Metropolis-Hastings naming game with deep generative models

Metropolis-Hastings algorithm in joint-attention naming game: Experimental semiotics study

Symbol emergence as interpersonal cross-situational learning: the emergence of lexical knowledge with combinatoriality

Emergent communication of multimodal deep generative models based on Metropolis-Hastings naming game

A Bayesian Approach to the Naming Game Model

Collective predictive coding hypothesis: symbol emergence as decentralized Bayesian inference

Multiagent multimodal categorization for symbol emergence: emergent communication via interpersonal cross-modal inference

Symbol Emergence as an Interpersonal Multimodal Categorization

Naming Games in Spatially-Embedded Random Networks

Language games meet multi-agent reinforcement learning: A case study for the naming game

Naming Games in Two-Dimensional and Small-World-Connected Random Geometric Networks

SimSiam Naming Game: A Unified Approach for Representation Learning and Emergent Communication

Improving Cooperation in Language Games with Bayesian Inference and the Cognitive Hierarchy

Control as Probabilistic Inference as an Emergent Communication Mechanism in Multi-Agent Reinforcement Learning

Emergence of Numeric Concepts in Multi-Agent Autonomous Communication

The Role of bilinguals in the Bayesian naming game

An uncertainty quantification framework for agent-based modeling and simulation in networked anagram games

In-depth analysis of the Naming Game dynamics: the homogeneous mixing case

MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration

Multi-lingual agents through multi-headed neural networks