Martina Vanelli,Julien M. Hendrickx
Abstract:We study the identifiability of nonlinear network systems with partial excitation and partial measurement when the network dynamics is linear on the edges and nonlinear on the nodes. We assume that the graph topology and the nonlinear functions at the node level are known, and we aim to identify the weight matrix of the graph. Our main result is to prove that fully-connected layered feed-forward networks are generically locally identifiable by exciting sources and measuring sinks in the class of analytic functions that cross the origin. This holds even when all other nodes remain unexcited and unmeasured and stands in sharp contrast to most findings on network identifiability requiring measurement and/or excitation of each node. The result applies in particular to feed-forward artificial neural networks with no offsets and generalizes previous literature by considering a broader class of functions and topologies.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in the case of partial - node excitation and partial - node measurement, how to identify the weight matrix \(W\) of a network system with nonlinear node dynamics, that is, to determine whether there are different weight matrices that lead to the same input - output behavior under a given set of excited nodes and measured nodes. If such a situation exists, the network is considered unidentifiable; conversely, if the weight matrix can be uniquely determined through experiments, the network is considered identifiable.
Specifically, the paper focuses on how to identify the weight matrix \(W\) by only exciting source nodes and measuring sink nodes when the network topology \(G=(N, E, W)\) is known and the nonlinear function \(f\) on the nodes is also known. The main contribution of the paper is to prove that for fully - connected feed - forward networks, under certain conditions, local identifiability can be achieved only by exciting source nodes and measuring sink nodes, even if other nodes are neither excited nor measured. This is in sharp contrast to the research results in most of the existing literature, which require excitation or measurement of each node.
### Main Problem Summary
1. **Research Background**:
- The research object is a dynamic network system with linear edges and nonlinear nodes.
- The goal is to determine whether the weight matrix \(W\) can be uniquely identified in the case of partial - node excitation and partial - node measurement.
2. **Research Objectives**:
- Prove that under specific conditions, network local identifiability can be achieved only by exciting source nodes and measuring sink nodes.
- Explore the applicability of this conclusion to a wider range of functions and network structures.
3. **Main Assumptions and Conditions**:
- The network topology \(G\) and the nonlinear function \(f\) on the nodes are known.
- The weight matrix \(W\) is unknown.
- The nonlinear function \(f\) belongs to the class of analytic functions and satisfies \(f(0) = 0\).
4. **Main Results**:
- It is proved that for fully - connected feed - forward networks, as long as the source nodes are excited and the sink nodes are measured, the network is almost everywhere locally identifiable in the analytic function class \(F_Z\).
- This result is applicable in the case without bias terms and generalizes previous research on artificial neural networks.
### Formula Presentation
The key formulas involved in the paper are as follows:
- Node output formula:
\[
y_i^k = f\left(\sum_{j} w_{ij} y_j^{k - 1}\right)+u_i^{k - 1}
\]
where \(y_i^k\) represents the output of node \(i\) at time \(k\), \(w_{ij}\) is an element of the weight matrix \(W\), and \(u_i^{k - 1}\) is an external excitation signal.
- Definition of the measurement function \(F\):
\[
F(x)=f(w_{43} f(w_{31}x + w_{32}u_2))
\]
- Measurement function obtained by exciting source nodes and measuring sink nodes:
\[
F(x)=f(w_{43} f(w_{31}x))
\]
These formulas show the dynamic relationships between nodes and how to infer the network weight matrix by measuring the outputs of specific nodes.