Collective effect of self-learning and social learning on language dynamics: a naming game approach in social networks

Tao Wen,Yu-wang Chen,Renaud Lambiotte

DOI: https://doi.org/10.1098/rsif.2024.0406

IF: 4.293

2024-12-06

Journal of The Royal Society Interface

Abstract:Journal of The Royal Society Interface, Volume 21, Issue 221, December 2024.

multidisciplinary sciences

What problem does this paper attempt to address?

Non-equilibrium dynamics of language games on complex networks

Luca Dall'Asta,Andrea Baronchelli,Alain Barrat,Vittorio Loreto

DOI: https://doi.org/10.1103/PhysRevE.74.036105

2006-07-07

Abstract:The Naming Game is a model of non-equilibrium dynamics for the self-organized emergence of a linguistic convention or a communication system in a population of agents with pairwise local interactions. We present an extensive study of its dynamics on complex networks, that can be considered as the most natural topological embedding for agents involved in language games and opinion dynamics. Except for some community structured networks on which metastable phases can be observed, agents playing the Naming Game always manage to reach a global consensus. This convergence is obtained after a time generically scaling with the population's size $N$ as $t\_{conv} \sim N^{1.4 \pm 0.1}$, i.e. much faster than for agents embedded on regular lattices. Moreover, the memory capacity required by the system scales only linearly with its size. Particular attention is given to heterogenous networks, in which the dynamical activity pattern of a node depends on its degree. High degree nodes have a fundamental role, but require larger memory capacity. They govern the dynamics acting as spreaders of (linguistic) conventions. The effects of other properties, such as the average degree and the clustering, are also discussed.

Physics and Society,Other Condensed Matter,Statistical Mechanics
Language games meet multi-agent reinforcement learning: A case study for the naming game

Paul Van Eecke,Katrien Beuls,Jérôme Botoko Ekila,Roxana Rădulescu

DOI: https://doi.org/10.1093/jole/lzad001

2023-04-18

Journal of Language Evolution

Abstract:Abstract Today, computational models of emergent communication in populations of autonomous agents are studied through two main methodological paradigms: multi-agent reinforcement learning (MARL) and the language game paradigm. While both paradigms share their main objectives and employ strikingly similar methods, the interaction between both communities has so far been surprisingly limited. This can to a large extent be ascribed to the use of different terminologies and experimental designs, which sometimes hinder the detection and interpretation of one another’s results and progress. Through this paper, we aim to remedy this situation by (1) formulating the challenge of re-conceptualising the language game experimental paradigm in the framework of MARL, and by (2) providing both an alignment between their terminologies and an MARL−based reformulation of the canonical naming game experiment. Tackling this challenge will enable future language game experiments to benefit from the rapid and promising methodological advances in the MARL community, while it will enable future MARL experiments on learning emergent communication to benefit from the insights and results gained through language game experiments. We strongly believe that this cross-pollination has the potential to lead to major breakthroughs in the modelling of how human-like languages can emerge and evolve in multi-agent systems.
Analysis of Collective Behavior over Complex Network Based on Naming Game with Memory Loss.

Guiyuan Fu,Weidong Zhang

DOI: https://doi.org/10.23919/acc.2017.7963184

2017-01-01

Abstract:In this paper, we study the dynamics of collective behavior based on naming game where individuals are under the influence of memory loss. Firstly, an extended naming game incorporating memory loss is proposed. Different from the existing naming game models, the individual in the proposed model would forget some words with a probability in his memory during interaction and keep his conveyed word unchanged until he reaches a local agreement. We analyze the dynamics of the proposed model through extensive and comprehensive simulations, where four typical networks with different configuration are employed and the influence of memory loss on the performance of the proposed model is investigated. The simulation results show that i) the stronger memory loss, the larger convergence time; ii) maximum number of total words will decrease with larger strength of memory loss, while the maximum number of different words among the population remains almost unchanged. The findings introduced by the proposed model may give an insight to understand better the influence of memory loss on the transient dynamics of language evolution and opinion formation over networks.
Naming game on small-world networks with geographical effects

Run-Ran Liu,Chun-Xiao Jia,Han-Xin Yang,Bing-Hong Wang

DOI: https://doi.org/10.1016/j.physa.2009.05.007

2009-01-01

Abstract:The naming game model characterizes the main evolutionary features of languages or more generally of communication systems. Very recently, the combination of complex networks and the naming game has received much attention and the influences of various topological properties on the corresponding dynamical behavior have been widely studied. In this paper, we investigate the naming game on small-world geographical networks. The small-world geographical networks are constructed by randomly adding links to two-dimensional regular lattices, and it is found that the convergence time is a nonmonotonic function of the geographical distance of randomly added shortcuts. This phenomenon indicates that, although a long geographical distance of the added shortcuts favors consensus achievement, too long a geographical distance of the added shortcuts inhibits the convergence process, making it even slower than the moderates.
The Naming Game in Social Networks : Community Formation and Consensus Engineering

Abstract:We study the dynamics of the Naming Game [Baronchelli et al., (2006) J. Stat. Mech.: Theory Exp. P06014] in empirical social networks. This stylized agent-based model captures essential features of agreement dynamics in a network of autonomous agents, corresponding to the development of shared classification schemes in a network of artificial agents or opinion spreading and social dynamics in social networks. Our study focuses on the impact that communities in the underlying social graphs have on the outcome of the agreement process. We find that networks with strong community structure hinder the system from reaching global agreement; the evolution of the Naming Game in these networks maintains clusters of coexisting opinions indefinitely. Further, we investigate agent-based network strategies to facilitate convergence to global consensus.

Sociology,Computer Science
Coevolution with weights of names in structured language games

Chuang Lei,Jianyuan Jia,Te Wu,Long Wang

DOI: https://doi.org/10.1016/j.physa.2010.08.039

2010-01-01

Abstract:We propose a coevolutionary version to investigate the naming game, a model recently introduced to describe how shared vocabulary can emerge and persist spontaneously in communication systems. We base our model on the fact that more popular names have more opportunities to be selected by agents and then spread in the population. A name’s popularity is concerned with its communication frequency, characterized by its weight coevolving with the name. A tunable parameter governs the influence of name weight. We implement this modified version on both scale-free networks and small-world networks, in which interactions proceed between paired agents by means of the reverse naming game. It is found that there exists an optimal value of the parameter that induces the fastest convergence of the population. This illustration indicates that a moderately strong influence of evolving name weight favors the rapid achievement of final consensus, but very strong influences inhibit the convergence process. The rank-distribution of the final accumulated weights of names qualitatively explains this nontrivial phenomenon. Investigations of some pertinent quantities are also provided, including the time evolution of the number of different names and the success rate, as well as the total memory of agents for different parameter values, which are helpful for better understanding the coevolutionary dynamics. Finally, we explore the scaling behavior in the convergence time and conclude a smaller scaling parameter compared to the previous naming game models.
Language Urban Odyssey: A Serious Game for Enhancing Second Language Acquisition Through Large Language Models

Yijun Zhao,Jiangyu Pan,Yan Dong,Tianshu Dong,Guanyun Wang,Fangtian Ying,Qihang Shen,Jiacheng Cao

DOI: https://doi.org/10.1145/3613905.3651112

2024-01-01

Abstract:Traditional second language acquisition (SLA) often lacks deep immersion in authentic environments, presenting high learning and resource challenges. To overcome this, we introduced "Language Urban Odyssey" (LUO), a serious game designed to offer an affordable language practice environment. LUO combines Large Language Models (LLMs) with game-based learning, creating an immersive and interactive experience. Players interact with AI-driven characters in a fictional city, leveraging ChatGPT 3.5’s capabilities for simulating real language use and cultural diversity. The game aims to reduce language learning barriers, ignite interest, and provide practical scenarios. Test results show LUO significantly boosts interest and proficiency in language learning. Players praise its engaging narrative, interactive dialogues, and adaptive experience. However, while LUO is beneficial, it’s crucial to recognize gamified learning’s limits; genuine language fluency still requires real-life communication practice and validation.
A Bayesian Approach to the Naming Game Model

Gionni Marchetti,Marco Patriarca,Els Heinsalu

DOI: https://doi.org/10.3389/fphy.2020.00010

2019-11-29

Abstract:We present a novel Bayesian approach to semiotic dynamics, which is a cognitive analogue of the naming game model restricted to two conventions. The one-shot learning that characterizes the agent dynamics in the basic naming game is replaced by a word-learning process, in which agents learn a new word by generalizing from the evidence garnered through pairwise-interactions with other agents. The principle underlying the model is that agents, like humans, can learn from a few positive examples and that such a process is modeled in a Bayesian probabilistic framework. We show that the model presents some analogies but also crucial differences with respect to the dynamics of the basic two-convention naming game model. The model introduced aims at providing a starting point for the construction of a general framework for studying the combined effects of cognitive and social dynamics.

Physics and Society
Characterizing the Dynamics of Learning in Repeated Reference Games

Robert D. Hawkins,Michael C. Frank,Noah D. Goodman

DOI: https://doi.org/10.1111/cogs.12845

IF: 2.617

2020-06-01

Cognitive Science

Abstract:<p>The language we use over the course of conversation changes as we establish common ground and learn what our partner finds meaningful. Here we draw upon recent advances in natural language processing to provide a finer‐grained characterization of the dynamics of this learning process. We release an open corpus (>15,000 utterances) of extended dyadic interactions in a classic repeated reference game task where pairs of participants had to coordinate on how to refer to initially difficult‐to‐describe tangram stimuli. We find that different pairs discover a wide variety of idiosyncratic but efficient and stable solutions to the problem of reference. Furthermore, these conventions are shaped by the communicative context: words that are more discriminative in the initial context (i.e., that are used for one target more than others) are more likely to persist through the final repetition. Finally, we find systematic structure in how a speaker's referring expressions become more efficient over time: Syntactic units drop out in clusters following positive feedback from the listener, eventually leaving short labels containing open‐class parts of speech. These findings provide a higher resolution look at the quantitative dynamics of ad hoc convention formation and support further development of computational models of learning in communication.</p>

psychology, experimental
Win–stay, lose–shift in language learning from peers

Frederick A Matsen, Martin A Nowak

2004-12-28

Abstract:Traditional language learning theory explores an idealized interaction between a teacher and a learner. The teacher provides sentences from a language, while the learner has to infer the underlying grammar. Here, we study a new approach by considering a population of individuals that learn from each other. There is no designated teacher. We are inspired by the observation that children grow up to speak the language of their peers, not of their parents. Our goal is to characterize learning strategies that generate “linguistic coherence,” which means that most individuals use the same language. We model the resulting learning dynamics as a random walk of a population on a graph. Each vertex represents a candidate language. We find that a simple strategy using a certain aspiration level with the principle of win–stay, lose–shift does extremely well: stay with your current language, if at least three others use that …
Collective Behavior Decision Based on Edge Dynamics

Tao You,Yunchao Liu,Muslimbek Mengibaev,Ying Zhang,Jinchao Chen,Peng Zhang

DOI: https://doi.org/10.1016/j.physleta.2021.127654

IF: 2.707

2021-01-01

Physics Letters A

Abstract:In real-world social networks, the diversity of social members usually affects the decision-making behaviors in daily human life. Here, to better capture the interaction characteristics of realistic individuals, we explore the evolution of cooperative behaviour in multi-game under interactive heterogeneity based on edge dynamics. Simulation results show that interactive heterogeneity can lead to the formation of larger clusters of cooperators in the network and significantly improve the cooperative behaviour of the group. However, when interactive heterogeneity and network heterogeneity coexist, worse results are obtained. (C) 2021 Elsevier B.V. All rights reserved.
The Social Dynamics of Language Change in Online Networks

Rahul Goel,Sandeep Soni,Naman Goyal,John Paparrizos,Hanna Wallach,Fernando Diaz,Jacob Eisenstein

DOI: https://doi.org/10.48550/arXiv.1609.02075

2016-09-08

Abstract:Language change is a complex social phenomenon, revealing pathways of communication and sociocultural influence. But, while language change has long been a topic of study in sociolinguistics, traditional linguistic research methods rely on circumstantial evidence, estimating the direction of change from differences between older and younger speakers. In this paper, we use a data set of several million Twitter users to track language changes in progress. First, we show that language change can be viewed as a form of social influence: we observe complex contagion for phonetic spellings and "netspeak" abbreviations (e.g., lol), but not for older dialect markers from spoken language. Next, we test whether specific types of social network connections are more influential than others, using a parametric Hawkes process model. We find that tie strength plays an important role: densely embedded social ties are significantly better conduits of linguistic influence. Geographic locality appears to play a more limited role: we find relatively little evidence to support the hypothesis that individuals are more influenced by geographically local social ties, even in their usage of geographical dialect markers.

Computation and Language,Social and Information Networks,Physics and Society
Language Change and Social Networks

Jinyun Ke,Tao Gong,William S-Y Wang

IF: 3.791

2008-01-01

Communications in Computational Physics

Abstract:Social networks play an important role in determining the dynamics and outcome of language change. Early empirical studies only examine small-scale local social networks, and focus on the relationship between the individual speakers’ linguistic behaviors and their characteristics in the network. In contrast, computer models can provide an efficient tool to consider large-scale networks with different structures and discuss the long-term effect of individuals’ learning and interaction on language change. This paper presents an agent-based computer model which simulates language change as a process of innovation diffusion, to address the threshold problem of language change. In the model, the population is implemented as a network of agents with age differences and different learning abilities, and the population is changing, with new agents born periodically to replace old ones. Four typical types of networks and their effect on the diffusion dynamics are examined. When the functional bias is sufficiently high, innovations always diffuse to the whole population in a linear manner in regular and small-world networks, but diffuse quickly in a sharp S-curve in random and scale-free networks. The success rate of diffusion is higher in regular and small-world networks than in random and scale-free networks. In addition, the model shows that as long as the population contains a small number of statistical learners who can learn and use both linguistic variants statistically according to the impact of these variants in the input, there is a very high probability for linguistic innovations with only small functional advantage to overcome the threshold of diffusion. AMS subject classifications: 91.D30 PACS: 89.65.-s, 89.75.Hc
Naming Game on Networks: Let Everyone be Both Speaker and Hearer

Yuan Gao,Guanrong Chen,Rosa H. M. Chan

DOI: https://doi.org/10.1038/srep06149

2014-08-22

Abstract:To investigate how consensus is reached on a large self-organized peer-to-peer network, we extended the naming game model commonly used in language and communication to Naming Game in Groups (NGG). Differing from other existing naming game models, in NGG, everyone in the population (network) can be both speaker and hearer simultaneously, which resembles in a closer manner to real-life scenarios. Moreover, NGG allows the transmission (communication) of multiple words (opinions) for multiple intra-group consensuses. The communications among indirectly-connected nodes are also enabled in NGG. We simulated and analyzed the consensus process in some typical network topologies, including random-graph networks, small-world networks and scale-free networks, to better understand how global convergence (consensus) could be reached on one common word. The results are interpreted on group negotiation of a peer-to-peer network, which shows that global consensus in the population can be reached more rapidly when more opinions are permitted within each group or when the negotiating groups in the population are larger in size. The novel features and properties introduced by our model have demonstrated its applicability in better investigating general consensus problems on peer-to-peer networks.

Social and Information Networks,Physics and Society
Naming Games in Spatially-Embedded Random Networks

Qiming Lu,G. Korniss,Boleslaw K. Szymanski

DOI: https://doi.org/10.48550/arXiv.cs/0604075

2006-04-19

Multiagent Systems

Abstract:We investigate a prototypical agent-based model, the Naming Game, on random geometric networks. The Naming Game is a minimal model, employing local communications that captures the emergence of shared communication schemes (languages) in a population of autonomous semiotic agents. Implementing the Naming Games on random geometric graphs, local communications being local broadcasts, serves as a model for agreement dynamics in large-scale, autonomously operating wireless sensor networks. Further, it captures essential features of the scaling properties of the agreement process for spatially-embedded autonomous agents. We also present results for the case when a small density of long-range communication links are added on top of the random geometric graph, resulting in a "small-world"-like network and yielding a significantly reduced time to reach global agreement.
Fast convergence in language games induced by majority rule

Chuang Lei,Te Wu,Long Wang,Jian-Yuan Jia

DOI: https://doi.org/10.1016/j.physa.2010.05.036

2010-01-01

Abstract:We propose a simple model to investigate the evolutionary dynamics of a naming game on well-mixed populations. We assume that each individual has an inherent propensity to maintain his own word about an object whereas other individuals would affect his decision when they communicate. On the one hand, individuals learn the word of another one with a probability pertaining to their propensities. On the other hand, the focal individual would adopt the word held by the majority in a randomly selected group. We have numerically explored how dynamical behavior evolves as a result of combination of these two competing update patterns. A parameter governs the time scale ratio at which the two update patterns separately progress. We find that an increasing tendency to adopt the word held by the majority results in a rapid extinction of most words, thus more easily induces the system to a global consensus. Large initial probabilities denoting propensity are found to be unfavorable for the achievement of the consensus. Interestingly, simulation results indicate that the convergence time is negligibly affected by the number of initial distinct words when this number exceeds a certain value. Results from our model may offer an insight into better understanding the intricate dynamics of naming games.
In-depth analysis of the Naming Game dynamics: the homogeneous mixing case

Andrea Baronchelli,Vittorio Loreto,Luc Steels

DOI: https://doi.org/10.1142/S0129183108012522

2008-03-04

Abstract:Language emergence and evolution has recently gained growing attention through multi-agent models and mathematical frameworks to study their behavior. Here we investigate further the Naming Game, a model able to account for the emergence of a shared vocabulary of form-meaning associations through social/cultural learning. Due to the simplicity of both the structure of the agents and their interaction rules, the dynamics of this model can be analyzed in great detail using numerical simulations and analytical arguments. This paper first reviews some existing results and then presents a new overall understanding.

Physics and Society,Statistical Mechanics,Computer Science and Game Theory,Multiagent Systems
Optimal convergence in naming game with geography-based negotiation on small-world networks

Run-Ran Liu,Wen-Xu Wang,Ying-Cheng Lai,Guanrong Chen,Bing-Hong Wang

DOI: https://doi.org/10.1016/j.physleta.2010.12.007

IF: 2.707

2011-01-01

Physics Letters A

Abstract:We propose a negotiation strategy to address the effect of geography on the dynamics of naming games over small-world networks. Communication and negotiation frequencies between two agents are determined by their geographical distance in terms of a parameter characterizing the correlation between interaction strength and the distance. A finding is that there exists an optimal parameter value leading to fastest convergence to global consensus on naming. Numerical computations and a theoretical analysis are provided to substantiate our findings.
Reciprocal Social Strategy in Social Repeated Games and Emergence of Social Norms.

Chi-Kong Chan,Jianye Hao,Ho-Fung Leung

DOI: https://doi.org/10.1142/s0218213017600077

2017-01-01

Abstract:In an artificial society where agents repeatedly interact with one another, effective coordination among agents is generally a challenge. This is especially true when the participating agents are self-interested, and that there is no central authority to coordinate, and direct communication or negotiation are not possible. Recently, the problem was studied in a paper by Hao and Leung, where a new repeated game mechanism for modeling multi-agent interactions as well as a new reinforcement learning based agent learning method were proposed. In particular, the game mechanism differs from traditional repeated games in that the agents are anonymous, and the agents interact with randomly chosen opponents during each iteration. Their learning mechanism allows agents to coordinate without negotiations. The initial results had been promising. However, extended simulation also reveals that the outcomes are not stable in the long run in some cases, as the high level of cooperation is eventually not sustainable. In this work, we revisit he problem and propose a new learning mechanism as follows. First, we propose an enhanced Q-learning-based framework that allows the agents to better capture both the individual and social utilities that they have learned through observations. Second, we propose a new concept of \social attitude" for determining the action of the agents throughout the game. Simulation results reveal that this approach can achieve higher social utility, including close-to-optimal results in some scenarios, and more importantly, the results are sustainable with social norms emerging.
Effects of Geographic Scaling Property on the Evolution of Naming Game

Qian ZHUANG,Zhesi SHEN,Lin HE,Zengru DI

DOI: https://doi.org/10.13306/j.1672-3813.2016.03.003

2016-01-01

Abstract:The structure of social networks is of paramount importance in collective behaviors ,e .g . information propagation ,consensus and formation of social norms .In this paper ,a special net‐work is constructed by adding remote links among nodes over lattice graphs with total energy constraints .A power law distribution is used to model the relation between the link probability and the distance .We study the effect of geographic scaling property on the dynamics of Naming Game with a group interaction rule .We find that there exists an optimal parameter value which minimizes the time to converge to global consensus .When the total energy constraint is large e‐nough the optimal parameter value is approximately 1.5 .Numerical simulations indicate that the geographic scaling property in social network plays an important role in the emergence of social collective behavior and rules .

Collective effect of self-learning and social learning on language dynamics: a naming game approach in social networks

Non-equilibrium dynamics of language games on complex networks

Language games meet multi-agent reinforcement learning: A case study for the naming game

Analysis of Collective Behavior over Complex Network Based on Naming Game with Memory Loss.

Naming game on small-world networks with geographical effects

The Naming Game in Social Networks : Community Formation and Consensus Engineering

Coevolution with weights of names in structured language games

Language Urban Odyssey: A Serious Game for Enhancing Second Language Acquisition Through Large Language Models

A Bayesian Approach to the Naming Game Model

Characterizing the Dynamics of Learning in Repeated Reference Games

Win–stay, lose–shift in language learning from peers

Collective Behavior Decision Based on Edge Dynamics

The Social Dynamics of Language Change in Online Networks

Language Change and Social Networks

Naming Game on Networks: Let Everyone be Both Speaker and Hearer

Naming Games in Spatially-Embedded Random Networks

Fast convergence in language games induced by majority rule

In-depth analysis of the Naming Game dynamics: the homogeneous mixing case

Optimal convergence in naming game with geography-based negotiation on small-world networks

Reciprocal Social Strategy in Social Repeated Games and Emergence of Social Norms.

Effects of Geographic Scaling Property on the Evolution of Naming Game