Abstract:We propose a new model for networks of time series that influence each other. Graph structures among time series are found in diverse domains, such as web traffic influenced by hyperlinks, product sales influenced by recommendation, or urban transport volume influenced by road networks and weather. There has been recent progress in graph modeling and in time series forecasting, respectively, but an expressive and scalable approach for a network of series does not yet exist. We introduce Radflow, a novel model that embodies three key ideas: a recurrent neural network to obtain node embeddings that depend on time, the aggregation of the flow of influence from neighboring nodes with multi-head attention, and the multi-layer decomposition of time series. Radflow naturally takes into account dynamic networks where nodes and edges change over time, and it can be used for prediction and data imputation tasks. On real-world datasets ranging from a few hundred to a few hundred thousand nodes, we observe that Radflow variants are the best performing model across a wide range of settings. The recurrent component in Radflow also outperforms N-BEATS, the state-of-the-art time series model. We show that Radflow can learn different trends and seasonal patterns, that it is robust to missing nodes and edges, and that correlated temporal patterns among network neighbors reflect influence strength. We curate WikiTraffic, the largest dynamic network of time series with 366K nodes and 22M time-dependent links spanning five years. This dataset provides an open benchmark for developing models in this area, with applications that include optimizing resources for the web. More broadly, Radflow has the potential to improve forecasts in correlated time series networks such as the stock market, and impute missing measurements in geographically dispersed networks of natural phenomena.

Maps of sparse Markov chains efficiently reveal community structure in network flows with memory

Flow-Based Community Detection in Hypergraphs

Maps of random walks on complex networks reveal community structure

Mapping biased higher-order walks reveals overlapping communities

Detecting Memory and Structure in Human Navigation Patterns Using Markov Chain Models of Varying Order

Identifying modular flows on multilayer networks reveals highly overlapping organization in social systems

Community Structure Analysis Using Label Propagation and Flow-Based Ensemble Learning

Robustness of journal rankings by network flows with different amounts of memory

Modeling information spread across networks with communities using a multitype branching process framework

Map Equation Centrality: Community-aware Centrality based on the Map Equation

Scalable Bayesian modeling, monitoring and analysis of dynamic network flow data

On multivariate Markov chains for common and non-common objects in multiple networks

Community Detection in Complex Networks Using Flow Simulation

Mapping change in higher-order networks with multilevel and overlapping communities

Modular decomposition of Markov chain: detecting hierarchical organization of pervasive communities

Generative Flow Networks: a Markov Chain Perspective

Scalable and Efficient Flow-Based Community Detection for Large-Scale Graph Analysis

Mapping change in large networks

Radflow: A Recurrent, Aggregated, and Decomposable Model for Networks of Time Series

State aggregations in Markov chains and block models of networks

How Ideas Flow Across Multiple Social Groups