Abstract:Networks are fundamental building blocks for representing data, and computations. Remarkable progress in learning in structurally defined (shallow or deep) networks has recently been achieved. Here we introduce evolutionary exploratory search and learning method of topologically flexible networks under the constraint of producing elementary computational steady-state input-output operations. Our results include; (1) the identification of networks, over four orders of magnitude, implementing computation of steady-state input-output functions, such as a band-pass filter, a threshold function, and an inverse band-pass function. Next, (2) the learned networks are technically controllable as only a small number of driver nodes are required to move the system to a new state. Furthermore, we find that the fraction of required driver nodes is constant during evolutionary learning, suggesting a stable system design. (3), our framework allows multiplexing of different computations using the same network. For example, using a binary representation of the inputs, the network can readily compute three different input-output functions. Finally, (4) the proposed evolutionary learning demonstrates transfer learning. If the system learns one function A, then learning B requires on average less number of steps as compared to learning B from tabula rasa. We conclude that the constrained evolutionary learning produces large robust controllable circuits, capable of multiplexing and transfer learning. Our study suggests that network-based computations of steady-state functions, representing either cellular modules of cell-to-cell communication networks or internal molecular circuits communicating within a cell, could be a powerful model for biologically inspired computing. This complements conceptualizations such as attractor based models, or reservoir computing.

Epistatic pathways in evolvable mechanical networks

Emergent Network Structure, evolvable Robustness and non-linear Effects of Point Mutations in an Artificial Genome Model

Reliability of genetic networks is evolvable

Evolution of complex modular biological networks

Evolving Connectivity Between Genetic Oscillators and Switches Using Evolutionary Algorithms

Modularity, criticality, and evolvability of a developmental gene regulatory network

Evolving complexity: how tinkering shapes cells, software and ecological networks

Gene network architecture, mutation and selection collectively drive developmental pattern evolvability and predictability

Environment-dependent epistasis increases phenotypic diversity in gene regulatory networks

Exploring the performance of volatile mutations on evolutionary game dynamics in complex networks

Innovation and robustness in complex regulatory gene networks

Evolution enhances mutational robustness and suppresses the emergence of a new phenotype: A new computational approach for studying evolution

Functional Resilience of Mutually Repressing Motifs Embedded in Larger Networks

Robustness as an Evolutionary Principle

Evolution beats random chance: Performance-dependent network evolution for enhanced computational capacity

Coupled Hebbian learning and evolutionary dynamics in a formal model for structural synaptic plasticity

Reliability of regulatory networks and its evolution

Highly Designable Phenotypes and Mutational Buffers Emerge from A Systematic Mapping Between Network Topology and Dynamic Output

Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning

Distribution of essential interactions in model gene regulatory networks under mutation-selection balance

Evolution and Analysis of Genetic Networks for Stable Cellular Growth and Regeneration