Abstract:Constructive studies on symbol emergence systems seek to investigate computational models that can better explain human language evolution, the creation of symbol systems, and the construction of internal representations. Specifically, emergent communication aims to formulate a computational model that enables agents to build efficient sign systems and internal representations. This study provides a new model for emergent communication, which is based on a probabilistic generative model (PGM) instead of a discriminative model based on deep reinforcement learning. We define the Metropolis-Hastings (MH) naming game by generalizing previously proposed models. It is not a referential game with explicit feedback, as assumed by many emergent communication studies. Instead, it is a game based on joint attention without explicit feedback. Mathematically, the MH naming game is proved to be a type of MH algorithm for an integrative PGM that combines two agents that play the naming game. From this viewpoint, symbol emergence is regarded as decentralized Bayesian inference , and semiotic communication is regarded as inter-personal cross-modal inference. This notion leads to the collective predictive coding hypothesis regarding language evolution and, in general, the emergence of symbols. We also propose the inter-Gaussian mixture model (GMM)+ variational autoencoder (VAE), a deep generative model for emergent communication based on the MH naming game. In this model, two agents create internal representations and categories and share signs (i.e. names of objects) from raw visual images observed from different viewpoints. The model has been validated on MNIST and Fruits 360 datasets. Experimental findings demonstrate that categories are formed from real images observed by agents, and signs are correctly shared across agents by successfully utilizing both of the observations of agents via the MH naming game. Furthermore, scholars verified that visual images were recalled from signs uttered by agents. Notably, emergent communication without supervision and reward feedback improved the performance of the unsupervised representation learning of agents.

A Bayesian Approach to the Naming Game Model

A Bird's-Eye View of Naming Game Dynamics: From Trait Competition to Bayesian Inference

The Role of bilinguals in the Bayesian naming game

Language games meet multi-agent reinforcement learning: A case study for the naming game

Generalized Naming Game and Bayesian Naming Game as Dynamical Systems

In-depth analysis of the Naming Game dynamics: the homogeneous mixing case

Improving Cooperation in Language Games with Bayesian Inference and the Cognitive Hierarchy

Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Models

The Naming Game in Social Networks : Community Formation and Consensus Engineering

Naming Games in Two-Dimensional and Small-World-Connected Random Geometric Networks

Non-equilibrium dynamics of language games on complex networks

Metropolis-Hastings algorithm in joint-attention naming game: Experimental semiotics study

Naming Games in Spatially-Embedded Random Networks

The naming game in language dynamics revisited

A gentle introduction to the minimal Naming Game

Semantic uncertainty guides the extension of conventions to new referents

Analysis of Naming Game Based Collective Behavior with Biased Assimilation over Adaptive Networks

Emergent communication through Metropolis-Hastings naming game with deep generative models

A Bayesian theory of mind approach to modeling cooperation and communication

Human-like Few-Shot Learning via Bayesian Reasoning over Natural Language