Abstract:This paper investigates the controllability properties of a general class of recurrent neural networks that are widely used for hypothesis generation in theoretical neuroscience, including the modeling of large-scale human brain dynamics. Our study focuses on the control synthesis of such networks using constant and piecewise constant inputs, motivated by emerging applications in non-invasive neurostimulation such as transcranial direct current stimulation (tDCS). The neural network model considered is a continuous Hopfield-type system with nonlinear activation functions and arbitrary input matrices representing interactions among multiple brain regions. Our main contribution is the formulation and solution of a control synthesis problem for these nonlinear systems. We provide a proper generalization of the variation of the constants formula that constitutes a novel representation of the system's state trajectory. This representation admits a verifiable condition on the existence of the constant control input to solve a short-time two-point boundary value problem in the state space. This formulation admits a synthesis for the input in question, which can be realized using modern algorithmic optimization tools. In the case of linear activation functions, this analysis and synthesis reduces to the verification of algebraic conditions on the system matrices. Simulation results are presented to illustrate the theoretical findings and demonstrate the efficacy of the proposed control strategies. These results offer a novel control synthesis for an important class of neural network models that may, in turn, enable the design of brain stimulation protocols to modulate whole-brain activity in therapeutic and cognitive enhancement applications.

A Mixed Integer Linear Programming Formulation to Artificial Neural Networks

Neural Network Solution for General Nonlinear Optimization Problems

A Neural Network Model For General Minimax Problem

A Mixed-Integer Programming Approach to Training Dense Neural Networks

A discrete-time neural network for optimization problems with hybrid constraints.

MINLP Algorithms Mixed with Constraint Programming

Strong mixed-integer programming formulations for trained neural networks

Feed-Forward Neural Networks as a Mixed-Integer Program

Design of General Projection Neural Networks for Solving Monotone Linear Variational Inequalities and Linear and Quadratic Optimization Problems

A reformulation to Embedding a Neural Network in a linear program without integer variables

On the constrained feedback linearization control based on the MILP representation of a ReLU-ANN

Global Deterministic Optimization with Artificial Neural Networks Embedded

Modeling Design and Control Problems Involving Neural Network Surrogates

An Inverse QSAR Method Based on Linear Regression and Integer Programming

A Novel Neural Network for Nonlinear Convex Programming

A New Computationally Simple Approach for Implementing Neural Networks with Output Hard Constraints

Mixed-Integer Optimisation of Graph Neural Networks for Computer-Aided Molecular Design

Approximate Dynamic Programming with Neural Networks in Linear Discrete Action Spaces

On the control of recurrent neural networks using constant inputs