Abstract:Continuous-time dynamic graph modeling is a crucial task for many real-world applications, such as financial risk management and fraud detection. Though existing dynamic graph modeling methods have achieved satisfactory results, they still suffer from three key limitations, hindering their scalability and further applicability. i) Indiscriminate updating. For incoming edges, existing methods would indiscriminately deal with them, which may lead to more time consumption and unexpected noisy information. ii) Ineffective node-wise long-term modeling. They heavily rely on recurrent neural networks (RNNs) as a backbone, which has been demonstrated to be incapable of fully capturing nodewise long-term dependencies in event sequences. iii) Neglect of re-occurrence patterns. Dynamic graphs involve the repeated occurrence of neighbors that indicates their importance, which is disappointedly neglected by existing methods. In this paper, we present iLoRE, a novel dynamic graph modeling method with instant node-wise Long-term modeling and Re-occurrence preservation. To overcome the indiscriminate updating issue, we introduce the Adaptive Short-term Updater module that will automatically discard the useless or noisy edges, ensuring iLoRE's effectiveness and instant ability. We further propose the Long-term Updater to realize more effective node-wise long-term modeling, where we innovatively propose the Identity Attention mechanism to empower a Transformer-based updater, bypassing the limited effectiveness of typical RNN-dominated designs. Finally, the crucial re-occurrence patterns are also encoded into a graph module for informative representation learning, which will further improve the expressiveness of our method. Our experimental results on real-world datasets demonstrate the effectiveness of our iLoRE for dynamic graph modeling.

Not Only Pairwise Relationships: Fine-Grained Relational Modeling for Multivariate Time Series Forecasting

Learning Decomposed Spatial Relations for Multi-Variate Time-Series Modeling.

ReCo: A Modular Neural Framework for Automatically Recommending Connections in Software Models

Functional Relation Field: A Model-Agnostic Framework for Multivariate Time Series Forecasting

Dynamic Hypergraph Structure Learning for Multivariate Time Series Forecasting

Learning the Evolutionary and Multi-scale Graph Structure for Multivariate Time Series Forecasting

Multiple Time Series Forecasting with Dynamic Graph Modeling

Revitalizing Multivariate Time Series Forecasting: Learnable Decomposition with Inter-Series Dependencies and Intra-Series Variations Modeling

Ilore: Dynamic Graph Representation with Instant Long-term Modeling and Re-occurrence Preservation

Connecting the Dots: Multivariate Time Series Forecasting with Graph Neural Networks

An Attentive Copula-based Spatio-Temporal Graph Model for Multivariate Time-Series Forecasting

Regularized Graph Structure Learning with Semantic Knowledge for Multi-variates Time-Series Forecasting

End-to-End Modeling Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow based Reconciliation

Enhancing Asynchronous Time Series Forecasting with Contrastive Relational Inference

Adapt to Small-Scale and Long-Term Time Series Forecasting with Enhanced Multidimensional Correlation

End-to-End Modeling of Hierarchical Time Series Using Autoregressive Transformer and Conditional Normalizing Flow-based Reconciliation

Graphical Models for Relations - Modeling Relational Context

Learning Dynamic Temporal Relations with Continuous Graph for Multivariate Time Series Forecasting (student Abstract).

Stochastic Relational Models for Large-scale Dyadic Data using MCMC

Representations and Ensemble Methods for Dynamic Relational Classification

Deep Coupling Network For Multivariate Time Series Forecasting