Inverse Boundary Value and Optimal Control Problems on Graphs: A Neural and Numerical Synthesis

Mehdi Garrousian,Amirhossein Nouranizadeh

2024-02-20

Abstract:A general setup for deterministic system identification problems on graphs with Dirichlet and Neumann boundary conditions is introduced. When control nodes are available along the boundary, we apply a discretize-then-optimize method to estimate an optimal control. A key piece in the present architecture is our boundary injected message passing neural network. This will produce more accurate predictions that are considerably more stable in proximity of the boundary. Also, a regularization technique based on graphical distance is introduced that helps with stabilizing the predictions at nodes far from the boundary.

Machine Learning,Numerical Analysis

What problem does this paper attempt to address?

The main problems that this paper attempts to solve include:

1. **Graphical System Identification Problem**: Learn the internal dynamics of unknown systems on graphs, which are affected by known external dynamics through boundary nodes/edges. This type of problem is also known as an inverse problem.

2. **Graphical Optimal Control Problem**: Under the condition of known dynamics on the given boundary, control the internal dynamics of the (identified) graph by controlling nodes/edges to achieve a certain goal and minimize the control cost.

Specifically, the author proposes two solutions:
- **Boundary Injected Graph Neural ODE (BigNode)**: Used to solve the system identification problem on the graph.
- **Boundary Injected Graphical Optimal Control (BigOC)**: Used to solve the optimal control problem on the graph.

The core of these problems lies in how to handle the influence of boundary values on internal nodes and how to optimize control strategies through neural networks and numerical methods. The author introduced a boundary - injected message passing neural network and applied a graph - distance - based regularization technique on nodes far from the boundary to improve the stability and accuracy of prediction.

### Formula Summary

1. **Graph Laplacian Operator**:
\[
\Delta=\text{grad}^*\text{grad}=-\text{div}\text{grad}
\]
Or more explicitly:
\[
\Delta = D - A
\]
where \(D\) is the degree matrix and \(A\) is the adjacency matrix.

2. **Diffusion Equation**:
Linear case:
\[
\dot{x}=-\kappa\Delta x
\]
Non - linear case:
\[
\dot{x}=\text{div}(k(x)(\text{grad}x))
\]

3. **Loss Function**:
\[
\text{Loss}(x_{\text{int}G},\hat{x}_{\text{int}G})=\sum_{i\in\text{int}G}w_i(x_i - \hat{x}_i)^2
\]
where the weight \(w_i\) depends on the distance \(d_i\) from node \(i\) to the nearest boundary node.

4. **Objective Function of Optimal Control**:
\[
J=\int_0^{t_N}\alpha\|x_{\text{int}G}(t)-\hat{x}_{\text{int}G}(t)\|^2+\beta\|u(t)\|^2dt+\gamma E_{\text{term}}(x_{\text{int}G}(t_N),\hat{x}_{\text{int}G}(t_N))
\]

Through these methods and techniques, the author aims to improve the accuracy and stability of system identification and optimal control problems on graphs.