Controllability, Multiplexing, and Transfer Learning in Networks using Evolutionary Learning

Rise Ooi,Chao-Han Huck Yang,Pin-Yu Chen,Vìctor Eguìluz,Narsis Kiani,Hector Zenil,David Gomez-Cabrero,Jesper Tegnèr

DOI: https://doi.org/10.48550/arXiv.1811.05592

2019-11-04

Abstract:Networks are fundamental building blocks for representing data, and computations. Remarkable progress in learning in structurally defined (shallow or deep) networks has recently been achieved. Here we introduce evolutionary exploratory search and learning method of topologically flexible networks under the constraint of producing elementary computational steady-state input-output operations. Our results include; (1) the identification of networks, over four orders of magnitude, implementing computation of steady-state input-output functions, such as a band-pass filter, a threshold function, and an inverse band-pass function. Next, (2) the learned networks are technically controllable as only a small number of driver nodes are required to move the system to a new state. Furthermore, we find that the fraction of required driver nodes is constant during evolutionary learning, suggesting a stable system design. (3), our framework allows multiplexing of different computations using the same network. For example, using a binary representation of the inputs, the network can readily compute three different input-output functions. Finally, (4) the proposed evolutionary learning demonstrates transfer learning. If the system learns one function A, then learning B requires on average less number of steps as compared to learning B from tabula rasa. We conclude that the constrained evolutionary learning produces large robust controllable circuits, capable of multiplexing and transfer learning. Our study suggests that network-based computations of steady-state functions, representing either cellular modules of cell-to-cell communication networks or internal molecular circuits communicating within a cell, could be a powerful model for biologically inspired computing. This complements conceptualizations such as attractor based models, or reservoir computing.

Neural and Evolutionary Computing,Artificial Intelligence,Machine Learning,Molecular Networks

What problem does this paper attempt to address?

The problems this paper attempts to address include:

1. **Network Computing Capability**: Identifying networks capable of computing steady-state input-output functions (such as band-pass filters, threshold functions, and inverse band-pass functions) that vary over 4 orders of magnitude.

2. **Controllability**: Verifying whether the learned networks are technically controllable, i.e., whether the system can be transitioned to a new state with only a small number of driver nodes. The study found that the proportion of driver nodes required remains constant during the evolutionary learning process, indicating stable system design.

3. **Multiplexing**: Exploring whether the same network can perform different computational tasks. For example, by representing inputs in binary, the network can easily compute 3 different input-output functions.

4. **Transfer Learning**: Demonstrating whether the proposed evolutionary learning method supports transfer learning. If the system has already learned a function A, the steps required to learn another function B are on average fewer than learning B from scratch.

Overall, the paper generates large-scale, robust, and controllable circuits through an evolutionary learning method, capable of multiplexing and transfer learning. The results suggest that network-based and evolution-derived steady-state function computation can serve as a powerful model for bio-inspired computing, applicable to modeling cellular communication networks or intracellular molecular circuits.