On the control of recurrent neural networks using constant inputs

Cyprien Tamekue,Ruiqi Chen,ShiNung Ching
2024-10-23
Abstract:This paper investigates the controllability properties of a general class of recurrent neural networks that are widely used for hypothesis generation in theoretical neuroscience, including the modeling of large-scale human brain dynamics. Our study focuses on the control synthesis of such networks using constant and piecewise constant inputs, motivated by emerging applications in non-invasive neurostimulation such as transcranial direct current stimulation (tDCS). The neural network model considered is a continuous Hopfield-type system with nonlinear activation functions and arbitrary input matrices representing interactions among multiple brain regions. Our main contribution is the formulation and solution of a control synthesis problem for these nonlinear systems. We provide a proper generalization of the variation of the constants formula that constitutes a novel representation of the system's state trajectory. This representation admits a verifiable condition on the existence of the constant control input to solve a short-time two-point boundary value problem in the state space. This formulation admits a synthesis for the input in question, which can be realized using modern algorithmic optimization tools. In the case of linear activation functions, this analysis and synthesis reduces to the verification of algebraic conditions on the system matrices. Simulation results are presented to illustrate the theoretical findings and demonstrate the efficacy of the proposed control strategies. These results offer a novel control synthesis for an important class of neural network models that may, in turn, enable the design of brain stimulation protocols to modulate whole-brain activity in therapeutic and cognitive enhancement applications.
Optimization and Control,Dynamical Systems,Neurons and Cognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to control a broad class of Recurrent Neural Networks (RNNs) through constant inputs. Specifically, the research focuses on the control synthesis of these networks using constant and piece - wise constant inputs, which is mainly inspired by emerging applications of non - invasive neural stimulation techniques such as transcranial direct - current stimulation (tDCS). The neural network model considered in the paper is a continuous Hopfield - type system with a nonlinear activation function and arbitrary input matrices, which represent the interactions between multiple brain regions. The main contribution lies in proposing and solving the control synthesis problem of this type of nonlinear system, providing a new representation method of system state trajectories, which allows to verify the conditions for the existence of constant control inputs to solve the two - point boundary - value problem in a short time in the state space. In addition, the paper also provides a method to achieve piece - wise constant inputs over a long time and simplifies the analysis and synthesis in the case of a linear activation function under specific conditions. The effectiveness of the theoretical findings is demonstrated through numerical simulations, proving that the proposed control strategy can effectively regulate whole - brain activity and providing a new control synthesis method for designing brain - stimulation protocols for treatment and cognitive - enhancement applications.