Identifying Influential and Vulnerable Nodes in Interaction Networks through Estimation of Transfer Entropy Between Univariate and Multivariate Time Series

Julian Lee

2024-10-01

Abstract:Transfer entropy (TE) is a powerful tool for measuring causal relationships within interaction networks. Traditionally, TE and its conditional variants are applied pairwise between dynamic variables to infer these causal relationships. However, identifying the most influential or vulnerable node in a system requires measuring the causal influence of each component on the entire system and vice versa. In this paper, I propose using outgoing and incoming transfer entropy-where outgoing TE quantifies the influence of a node on the rest of the system, and incoming TE measures the influence of the rest of the system on the node. The node with the highest outgoing TE is identified as the most influential, or "hub", while the node with the highest incoming TE is the most vulnerable, or "anti-hub". Since these measures involve transfer entropy between univariate and multivariate time series, naive estimation methods can result in significant errors, particularly when the number of variables is comparable to or exceeds the number of samples. To address this, I introduce a novel estimation scheme that computes outgoing and incoming TE only between significantly interacting partners. The feasibility of this approach is demonstrated by using synthetic data, and by applying it to real data of oral microbiota. The method successfully identifies the bacterial species known to be key players in the bacterial community, demonstrating the power of the new method.

Statistical Mechanics,Biological Physics

What problem does this paper attempt to address?

This paper aims to solve how to identify the most influential nodes (referred to as "hub nodes" or "hub") and the most vulnerable nodes (referred to as "anti - hub nodes" or "anti - hub") in an interaction network. Specifically, the paper proposes a new method to estimate the transfer entropy (Transfer Entropy, TE) from univariate time series to multivariate time series, in order to quantify the influence of each node on the entire system (outgoing transfer entropy, Outgoing TE, OutTE) and the influence of the entire system on each node (incoming transfer entropy, Incoming TE, InTE).

### Main problems
1. **Limitations of traditional methods**:
- Traditional transfer entropy and its conditional variants are usually applied in pairs between dynamic variables to infer causal relationships.
- But to identify the most influential or most vulnerable nodes in the system, it is necessary to measure the influence of each component on the entire system and vice versa.

2. **Problems of estimation errors**:
- When the number of variables approaches or exceeds the number of samples, direct estimation of OutTE and InTE may lead to significant estimation errors.
- Especially in the presence of a large number of uncorrelated nodes (i.e., "confounding nodes"), this error is particularly serious.

### Solutions
1. **Introducing a pruning step**:
- By constructing a binary network, only select nodes that have a causal relationship with the target node for OutTE and InTE estimation.
- This method can significantly reduce estimation errors, especially when the number of variables approaches or exceeds the number of samples.

2. **Specific methods**:
- Use existing tools (such as the JIDT toolkit) to calculate conditional transfer entropy, and determine which nodes have significant causal relationships through statistical tests.
- By gradually constructing the source node set, ensure that the source node set of each target node contains nodes with statistically significant causal influence.

### Application verification
1. **Synthetic data**:
- By simulating simple SR models and HSAR models, the effectiveness of the pruning - enhanced method in accurately estimating OutTE and InTE values is demonstrated.

2. **Actual data**:
- Applying this method to microbiome data in human saliva, bacteria species known to play a key role in the oral microbial community, such as *Corynebacterium durum* and *Fusobacterium*, are successfully identified.

### Conclusions
- This method can reliably highlight key nodes in the network and provide valuable insights into system dynamics.
- This method has potential application value in fields such as biology, neuroscience, and social science.
- Accurately reconstructing a meaningful causal relationship network is the key to the success of this method. Future development directions include faster and more accurate causal network reconstruction algorithms.