Measures of upper limb function for people with neck pain: a systematic review of measurement and practical properties (protocol)

A. Alreni,D. Harrop,A. Gumber,S. McLean

DOI: https://doi.org/10.1186/s13643-015-0034-2

2015-04-07

Systematic Reviews

Abstract:

What problem does this paper attempt to address?

Learning and Complexity in Genetic Auto-Adaptive Systems

Chris Adami

DOI: https://doi.org/10.1016/0167-2789%2895%2990073-X

1994-01-28

Abstract:We describe and investigate the learning capablities displayed by a population of self-replicating segments of computer-code subject to random mutation: the tierra environment. We find that learning is achieved through phase transitions that adapt the population to whichever environment it encounters, with a learning rate characterized by the environmental variables. Our results suggest that most effective learning is achieved close to the edge of chaos.

Adaptation and Self-Organizing Systems,Quantitative Biology
Towards Large-Scale Simulations of Open-Ended Evolution in Continuous Cellular Automata

Bert Wang-Chak Chan

2023-04-12

Abstract:Inspired by biological and cultural evolution, there have been many attempts to explore and elucidate the necessary conditions for open-endedness in artificial intelligence and artificial life. Using a continuous cellular automata called Lenia as the base system, we built large-scale evolutionary simulations using parallel computing framework JAX, in order to achieve the goal of never-ending evolution of self-organizing patterns. We report a number of system design choices, including (1) implicit implementation of genetic operators, such as reproduction by pattern self-replication, and selection by differential existential success; (2) localization of genetic information; and (3) algorithms for dynamically maintenance of the localized genotypes and translation to phenotypes. Simulation results tend to go through a phase of diversity and creativity, gradually converge to domination by fast expanding patterns, presumably a optimal solution under the current design. Based on our experimentation, we propose several factors that may further facilitate open-ended evolution, such as virtual environment design, mass conservation, and energy constraints.

Neural and Evolutionary Computing,Cellular Automata and Lattice Gases
Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversity

Maxence Faldor,Antoine Cully

2024-06-07

Abstract:From the formation of snowflakes to the evolution of diverse life forms, emergence is ubiquitous in our universe. In the quest to understand how complexity can arise from simple rules, abstract computational models, such as cellular automata, have been developed to study self-organization. However, the discovery of self-organizing patterns in artificial systems is challenging and has largely relied on manual or semi-automatic search in the past. In this paper, we show that Quality-Diversity, a family of Evolutionary Algorithms, is an effective framework for the automatic discovery of diverse self-organizing patterns in complex systems. Quality-Diversity algorithms aim to evolve a large population of diverse individuals, each adapted to its ecological niche. Combined with Lenia, a family of continuous cellular automata, we demonstrate that our method is able to evolve a diverse population of lifelike self-organizing autonomous patterns. Our framework, called Leniabreeder, can leverage both manually defined diversity criteria to guide the search toward interesting areas, as well as unsupervised measures of diversity to broaden the scope of discoverable patterns. We demonstrate both qualitatively and quantitatively that Leniabreeder offers a powerful solution for discovering self-organizing patterns. The effectiveness of unsupervised Quality-Diversity methods combined with the rich landscape of Lenia exhibits a sustained generation of diversity and complexity characteristic of biological evolution. We provide empirical evidence that suggests unbounded diversity and argue that Leniabreeder is a step toward replicating open-ended evolution in silico.

Neural and Evolutionary Computing
Development of 2-t butyl-N-methyl pyrimidones as potent inhibitors of HIV integrase.

M. Di Francesco,P. Pace,F. Fiore,Francesca Naimo,F. Bonelli,M. Rowley,V. Summa

DOI: https://doi.org/10.1016/j.bmcl.2008.03.017

IF: 2.94

2008-04-15

Bioorganic & Medicinal Chemistry Letters

Abstract:
Adaptability and Homeostasis in the Game of Life interacting with the evolved Cellular Automata

Keisuke Suzuki,Takashi Ikegami

DOI: https://doi.org/10.4018/978-1-4666-1574-8.ch013

2024-05-09

Abstract:In this paper we study the emergence of homeostasis in a two-layer system of the Game of Life, in which the Game of Life in the first layer couples with another system of cellular automata in the second layer. Homeostasis is defined here as a space-time dynamic that regulates the number of cells in state-1 in the Game of Life layer. A genetic algorithm is used to evolve the rules of the second layer to control the pattern of the Game of Life. We discovered that there are two antagonistic attractors that control the numbers of cells in state-1 in the first layer. The homeostasis sustained by these attractors are compared with the homeostatic dynamics observed in Daisy World.

Neural and Evolutionary Computing,Adaptation and Self-Organizing Systems,Cellular Automata and Lattice Gases
Artificial Life using a Book and Bookmarker

Keishu Utimula

DOI: https://doi.org/10.48550/arXiv.2210.12854

2022-11-26

Abstract:Reproduction, development, and individual interactions are essential topics in artificial life. The cellular automata, which can handle these in a composite way, is highly restricted in its form and behavior because it represents life as a pattern of cells. In contrast, the virtual creatures proposed by Karl Sims have a very high degree of freedom in terms of morphology and behavior. However, they have limited expressive capacity in terms of those viewpoints. This study carefully extracts the characteristics of the cellular automata and Sims models to propose a new artificial life model that can simulate reproduction, development, and individual interactions while exhibiting high expressive power for morphology and behavior. The simulation was performed by sequentially reading a book with genetic information and repeatedly executing four actions: expansion, connection, disconnection, and transition. The virtual creatures in the proposed model exhibit unique survival strategies and lifestyles and acquire interesting properties in reproduction, development, and individual interactions while having freedom in morphology and behavior.

Neural and Evolutionary Computing,Artificial Intelligence
Open to Evolve Embodied Intelligence

W B Langdon

DOI: https://doi.org/10.1088/1757-899x/1292/1/012021

2023-11-12

IOP Conference Series Materials Science and Engineering

Abstract:For the goal of automatically evolving Embodied Intelligence (EI), we investigate an open software architecture inspired by the high surface area to volume ratio of animal lungs, which aims to avoid information theoretic limits on long term evolution experiments (LTEE) encountered with monolithic genetic programming trees. Instead individuals are teams composed of 1023 trees whose inputs and outputs are linked by a low entropy loss branching data (air) pathway. Most trees are shallow and software engineering's failed disruption propagation (FDP) is observed in the small fraction of deep trees. After initial search, most improvements are at intermediate depths and performance is still rising even after 100 000 generations. Despite the use of double precision for the bifurcating data interconnect, some information loss is seen, particularly in early generations. The static optimisation benchmark, appears to encourage early convergence, which locks the population into possibly sub-optimal phenotypes. Later thousands of small improvements, sometimes in large bloated ensemble members, appear to compensate for early overfitting. Using tournament fitness selection and subtree crossover, we target pure nested side-effect free floating point functions, which are known to have low FDP, and high fidelity data paths, in the hope of generating code which is not too robust so as to prevent on going improvement. However, we again find genetic changes deep within trees are silent. For single precision, we find a maximum evolvability sweet spot with trees of depth 10 to 100. Accordingly, we suggest to evolve very large very complex programs needed for Embodied Intelligence, an open structure with a high surface area permitting most mutation sites to be within 10-100 levels of the organism's environment, and many better placed test oracles to monitor the impact of mutated code, will be needed.
Emergent Dynamics in Heterogeneous Life-Like Cellular Automata

Aarati Shrestha,Felix Reimers,Sanyam Jain,Paolo Baldini,Michele Braccini,Andrea Roli,Stefano Nichele

2024-06-19

Abstract:The Game of Life (GoL), one well known 2D cellular automaton, does not typically ensure interesting long-term phenotypic dynamics. Therefore, while being Turing complete, GoL cannot be said to be open-ended. In this work, we extend GoL with the opportunity for local mutations, thus enabling a heterogeneous life-like cellular automaton guided by an evolutionary inner loop. Additionally, we introduce the concept of cell ageing to ensure that cell aliveness (activated by inheritance with variation, and controlled by ageing) and actual cell computation (governed by life-like rules on local neighborhoods) are kept conceptually separated. We conduct an experimental campaign to identify suitable parameters that produce long-term phenotypic dynamics and favor genotypic innovations.

Cellular Automata and Lattice Gases,Emerging Technologies
Transfer Dynamics in Emergent Evolutionary Curricula

Aaron Dharna,Amy K Hoover,Julian Togelius,L. B. Soros

DOI: https://doi.org/10.48550/arXiv.2203.10941

2022-03-04

Abstract:PINSKY is a system for open-ended learning through neuroevolution in game-based domains. It builds on the Paired Open-Ended Trailblazer (POET) system, which originally explored learning and environment generation for bipedal walkers, and adapts it to games in the General Video Game AI (GVGAI) system. Previous work showed that by co-evolving levels and neural network policies, levels could be found for which successful policies could not be created via optimization alone. Studied in the realm of Artificial Life as a potentially open-ended alternative to gradient-based fitness, minimal criteria (MC)-based selection helps foster diversity in evolutionary populations. The main question addressed by this paper is how the open-ended learning actually works, focusing in particular on the role of transfer of policies from one evolutionary branch ("species") to another. We analyze the dynamics of the system through creating phylogenetic trees, analyzing evolutionary trajectories of policies, and temporally breaking down transfers according to species type. Furthermore, we analyze the impact of the minimal criterion on generated level diversity and inter-species transfer. The most insightful finding is that inter-species transfer, while rare, is crucial to the system's success.

Artificial Intelligence,Machine Learning,Neural and Evolutionary Computing
Evolution-based Shape and Behavior Co-design of Virtual Agents

Zhiquan Wang,Bedrich Benes,Ahmed H. Qureshi,Christos Mousas

DOI: https://doi.org/10.1109/tvcg.2024.3355745

IF: 5.2

2024-01-01

IEEE Transactions on Visualization and Computer Graphics

Abstract:We introduce a novel co-design method for autonomous moving agents' shape attributes and locomotion by combining deep reinforcement learning and evolution with user control. Our main inspiration comes from evolution, which has led to wide variability and adaptation in Nature and has significantly improved design and behavior simultaneously. Our method takes an input agent with optional user-defined constraints, such as leg parts that should not evolve or are only within the allowed ranges of changes. It uses physics-based simulation to determine its locomotion and finds a behavior policy for the input design that is used as a baseline for comparison. The agent is randomly modified within the allowed ranges, creating a new generation of several hundred agents. The generation is trained by transferring the previous policy, which significantly speeds up the training. The best-performing agents are selected, and a new generation is formed using their crossover and mutations. The next generations are then trained until satisfactory results are reached. We show a wide variety of evolved agents, and our results show that even with only 10 the overall performance of the evolved agents improves by 50 experiments' performance will improve even more to 150 structures, and it does not require considerable computation resources as it works on a single GPU and provides results by training thousands of agents within 30 minutes.

computer science, software engineering
An evolutionary game with environmental feedback and players' opinions

E. M. Lorits,E. A. Gubar

2023-07-11

Abstract:Evolutionary games are a developing sub-field of game theory. This branch of game theory is used in the study of the adaptation of large, but finite, populations of agents to changes in the environment. It assumes that each agent has no significant influence on the system. Many scientific areas use the theory of evolutionary games. In particular, it is used in biology, medicine and the modelling of wireless networks. In this paper we study an evolutionary game with two levels of interaction between population agents. At the first level, changes in the population state depend on changes in the environment and on increasing or decreasing the resources available to the agents. At the second level, the populations state changes according to how the agents evaluate the state of the environment. These levels form a hierarchical structure. A change in one parameter of the system, which is responsible for the state of the environment, the population or the opinions of the agents, causes a change in the other elements of the system. The study involves the analysis of a modified evolutionary game taking into account the influence of the environment and the opinions of the agents. It also involves the development of computational methods in MATLAB and two sets of numerical experiments.

Computer Science and Game Theory
Meta-Learning an Evolvable Developmental Encoding

Milton L. Montero,Erwan Plantec,Eleni Nisioti,Joachim W. Pedersen,Sebastian Risi

2024-07-05

Abstract:Representations for black-box optimisation methods (such as evolutionary algorithms) are traditionally constructed using a delicate manual process. This is in contrast to the representation that maps DNAs to phenotypes in biological organisms, which is at the hear of biological complexity and evolvability. Additionally, the core of this process is fundamentally the same across nearly all forms of life, reflecting their shared evolutionary origin. Generative models have shown promise in being learnable representations for black-box optimisation but they are not per se designed to be easily searchable. Here we present a system that can meta-learn such representation by directly optimising for a representation's ability to generate quality-diversity. In more detail, we show our meta-learning approach can find one Neural Cellular Automata, in which cells can attend to different parts of a "DNA" string genome during development, enabling it to grow different solvable 2D maze structures. We show that the evolved genotype-to-phenotype mappings become more and more evolvable, not only resulting in a faster search but also increasing the quality and diversity of grown artefacts.

Neural and Evolutionary Computing
Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games

Stratis Skoulakis,Tanner Fiez,Ryann Sim,Georgios Piliouras,Lillian Ratliff

DOI: https://doi.org/10.1609/aaai.v35i13.17352

2021-05-18

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:The predominant paradigm in evolutionary game theory and more generally online learning in games is based on a clear distinction between a population of dynamic agents that interact given a fixed, static game. In this paper, we move away from the artificial divide between dynamic agents and static games, to introduce and analyze a large class of competitive settings where both the agents and the games they play evolve strategically over time. We focus on arguably the most archetypal game-theoretic setting---zero-sum games (as well as network generalizations)---and the most studied evolutionary learning dynamic---replicator, the continuous-time analogue of multiplicative weights. Populations of agents compete against each other in a zero-sum competition that itself evolves adversarially to the current population mixture. Remarkably, despite the chaotic coevolution of agents and games, we prove that the system exhibits a number of regularities. First, the system has conservation laws of an information-theoretic flavor that couple the behavior of all agents and games. Secondly, the system is Poincare recurrent, with effectively all possible initializations of agents and games lying on recurrent orbits that come arbitrarily close to their initial conditions infinitely often. Thirdly, the time-average agent behavior and utility converge to the Nash equilibrium values of the time-average game. Finally, we provide a polynomial time algorithm to efficiently predict this time-average behavior for any such coevolving network game.
Synergetic Learning Systems: Concept, Architecture, and Algorithms

Ping Guo,Qian Yin

DOI: https://doi.org/10.48550/arXiv.2006.06367

2020-05-31

Neural and Evolutionary Computing

Abstract:Drawing on the idea that brain development is a Darwinian process of ``evolution + selection'' and the idea that the current state is a local equilibrium state of many bodies with self-organization and evolution processes driven by the temperature and gravity in our universe, in this work, we describe an artificial intelligence system called the ``Synergetic Learning Systems''. The system is composed of two or more subsystems (models, agents or virtual bodies), and it is an open complex giant system. Inspired by natural intelligence, the system achieves intelligent information processing and decision-making in a given environment through cooperative/competitive synergetic learning. The intelligence evolved by the natural law of ``it is not the strongest of the species that survives, but the one most responsive to change,'' while an artificial intelligence system should adopt the law of ``human selection'' in the evolution process. Therefore, we expect that the proposed system architecture can also be adapted in human-machine synergy or multi-agent synergetic systems. It is also expected that under our design criteria, the proposed system will eventually achieve artificial general intelligence through long term coevolution.
Evolution and learning in differentiable robots

Luke Strgar,David Matthews,Tyler Hummer,Sam Kriegman

2024-05-23

Abstract:The automatic design of robots has existed for 30 years but has been constricted by serial non-differentiable design evaluations, premature convergence to simple bodies or clumsy behaviors, and a lack of sim2real transfer to physical machines. Thus, here we employ massively-parallel differentiable simulations to rapidly and simultaneously optimize individual neural control of behavior across a large population of candidate body plans and return a fitness score for each design based on the performance of its fully optimized behavior. Non-differentiable changes to the mechanical structure of each robot in the population -- mutations that rearrange, combine, add, or remove body parts -- were applied by a genetic algorithm in an outer loop of search, generating a continuous flow of novel morphologies with highly-coordinated and graceful behaviors honed by gradient descent. This enabled the exploration of several orders-of-magnitude more designs than all previous methods, despite the fact that robots here have the potential to be much more complex, in terms of number of independent motors, than those in prior studies. We found that evolution reliably produces ``increasingly differentiable'' robots: body plans that smooth the loss landscape in which learning operates and thereby provide better training paths toward performant behaviors. Finally, one of the highly differentiable morphologies discovered in simulation was realized as a physical robot and shown to retain its optimized behavior. This provides a cyberphysical platform to investigate the relationship between evolution and learning in biological systems and broadens our understanding of how a robot's physical structure can influence the ability to train policies for it. Videos and code at

Robotics,Artificial Intelligence
Flow-Lenia: Towards open-ended evolution in cellular automata through mass conservation and parameter localization

Erwan Plantec,Gautier Hamon,Mayalen Etcheverry,Pierre-Yves Oudeyer,Clément Moulin-Frier,Bert Wang-Chak Chan

DOI: https://doi.org/10.48550/arXiv.2212.07906

2023-03-24

Abstract:The design of complex self-organising systems producing life-like phenomena, such as the open-ended evolution of virtual creatures, is one of the main goals of artificial life. Lenia, a family of cellular automata (CA) generalizing Conway's Game of Life to continuous space, time and states, has attracted a lot of attention because of the wide diversity of self-organizing patterns it can generate. Among those, some spatially localized patterns (SLPs) resemble life-like artificial creatures and display complex behaviors. However, those creatures are found in only a small subspace of the Lenia parameter space and are not trivial to discover, necessitating advanced search algorithms. Furthermore, each of these creatures exist only in worlds governed by specific update rules and thus cannot interact in the same one. This paper proposes as mass-conservative extension of Lenia, called Flow Lenia, that solve both of these issues. We present experiments demonstrating its effectiveness in generating SLPs with complex behaviors and show that the update rule parameters can be optimized to generate SLPs showing behaviors of interest. Finally, we show that Flow Lenia enables the integration of the parameters of the CA update rules within the CA dynamics, making them dynamic and localized, allowing for multi-species simulations, with locally coherent update rules that define properties of the emerging creatures, and that can be mixed with neighbouring rules. We argue that this paves the way for the intrinsic evolution of self-organized artificial life forms within continuous CAs.

Neural and Evolutionary Computing,Artificial Intelligence,Cellular Automata and Lattice Gases
Self-Reproduction and Evolution in Cellular Automata: 25 Years after Evoloops

Hiroki Sayama,Chrystopher L. Nehaniv

2024-06-09

Abstract:The year of 2024 marks the 25th anniversary of the publication of evoloops, an evolutionary variant of Chris Langton's self-reproducing loops which proved constructively that Darwinian evolution of self-reproducing organisms by variation and natural selection is possible within deterministic cellular automata. Over the last few decades, this line of Artificial Life research has since undergone several important developments. Although it experienced a relative dormancy of activities for a while, the recent rise of interest in open-ended evolution and the success of continuous cellular automata models have brought researchers' attention back to how to make spatio-temporal patterns self-reproduce and evolve within spatially distributed computational media. This article provides a review of the relevant literature on this topic over the past 25 years and highlights the major accomplishments made so far, the challenges being faced, and promising future research directions.

Cellular Automata and Lattice Gases,Neural and Evolutionary Computing,Pattern Formation and Solitons,Populations and Evolution
Evolution with Opponent-Learning Awareness

Yann Bouteiller,Karthik Soma,Giovanni Beltrame

2024-10-29

Abstract:The universe involves many independent co-learning agents as an ever-evolving part of our observed environment. Yet, in practice, Multi-Agent Reinforcement Learning (MARL) applications are usually constrained to small, homogeneous populations and remain computationally intensive. In this paper, we study how large heterogeneous populations of learning agents evolve in normal-form games. We show how, under assumptions commonly made in the multi-armed bandit literature, Multi-Agent Policy Gradient closely resembles the Replicator Dynamic, and we further derive a fast, parallelizable implementation of Opponent-Learning Awareness tailored for evolutionary simulations. This enables us to simulate the evolution of very large populations made of heterogeneous co-learning agents, under both naive and advanced learning strategies. We demonstrate our approach in simulations of 200,000 agents, evolving in the classic games of Hawk-Dove, Stag-Hunt, and Rock-Paper-Scissors. Each game highlights distinct ways in which Opponent-Learning Awareness affects evolution.

Machine Learning,Computer Science and Game Theory,Multiagent Systems,Populations and Evolution,General Finance
Imitation of Life: Advanced system for native Artificial Evolution

Thomas Sperl

DOI: https://doi.org/10.48550/arXiv.1108.1589

2011-08-08

Neural and Evolutionary Computing

Abstract:A model for artificial evolution in native x86 Windows systems has been developed at the end of 2010. In this text, further improvements and additional analogies to natural microbiologic processes are presented. Several experiments indicate the capability of the system - and raise the question of possible countermeasures.
Mutation-Bias Learning in Games

Johann Bauer,Sheldon West,Eduardo Alonso,Mark Broom

2024-05-28

Abstract:We present two variants of a multi-agent reinforcement learning algorithm based on evolutionary game theoretic considerations. The intentional simplicity of one variant enables us to prove results on its relationship to a system of ordinary differential equations of replicator-mutator dynamics type, allowing us to present proofs on the algorithm's convergence conditions in various settings via its ODE counterpart. The more complicated variant enables comparisons to Q-learning based algorithms. We compare both variants experimentally to WoLF-PHC and frequency-adjusted Q-learning on a range of settings, illustrating cases of increasing dimensionality where our variants preserve convergence in contrast to more complicated algorithms. The availability of analytic results provides a degree of transferability of results as compared to purely empirical case studies, illustrating the general utility of a dynamical systems perspective on multi-agent reinforcement learning when addressing questions of convergence and reliable generalisation.

Machine Learning,Multiagent Systems,Dynamical Systems,Optimization and Control,Populations and Evolution

Measures of upper limb function for people with neck pain: a systematic review of measurement and practical properties (protocol)

Learning and Complexity in Genetic Auto-Adaptive Systems

Towards Large-Scale Simulations of Open-Ended Evolution in Continuous Cellular Automata

Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversity

Development of 2-t butyl-N-methyl pyrimidones as potent inhibitors of HIV integrase.

Adaptability and Homeostasis in the Game of Life interacting with the evolved Cellular Automata

Artificial Life using a Book and Bookmarker

Open to Evolve Embodied Intelligence

Emergent Dynamics in Heterogeneous Life-Like Cellular Automata

Transfer Dynamics in Emergent Evolutionary Curricula

Evolution-based Shape and Behavior Co-design of Virtual Agents

An evolutionary game with environmental feedback and players' opinions

Meta-Learning an Evolvable Developmental Encoding

Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum Games

Synergetic Learning Systems: Concept, Architecture, and Algorithms

Evolution and learning in differentiable robots

Flow-Lenia: Towards open-ended evolution in cellular automata through mass conservation and parameter localization

Self-Reproduction and Evolution in Cellular Automata: 25 Years after Evoloops

Evolution with Opponent-Learning Awareness

Imitation of Life: Advanced system for native Artificial Evolution

Mutation-Bias Learning in Games