Abstract:Temporal hypergraphs provide a powerful paradigm for modeling time-dependent, higher-order interactions in complex systems. Representation learning for hypergraphs is essential for extracting patterns of the higher-order interactions that are critically important in real-world problems in social network analysis, neuroscience, finance, etc. However, existing methods are typically designed only for specific tasks or static hypergraphs. We present CAT-Walk, an inductive method that learns the underlying dynamic laws that govern the temporal and structural processes underlying a temporal hypergraph. CAT-Walk introduces a temporal, higher-order walk on hypergraphs, SetWalk, that extracts higher-order causal patterns. CAT-Walk uses a novel adaptive and permutation invariant pooling strategy, SetMixer, along with a set-based anonymization process that hides the identity of hyperedges. Finally, we present a simple yet effective neural network model to encode hyperedges. Our evaluation on 10 hypergraph benchmark datasets shows that CAT-Walk attains outstanding performance on temporal hyperedge prediction benchmarks in both inductive and transductive settings. It also shows competitive performance with state-of-the-art methods for node classification. (<a class="link-external link-https" href="https://github.com/ubc-systopia/CATWalk" rel="external noopener nofollow">this https URL</a>)

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the limitations of existing methods in handling representation learning of temporal hypergraphs. Specifically: 1. **Static Hypergraphs vs. Dynamic Hypergraphs**: Most existing hypergraph learning methods are mainly designed for static hypergraphs and do not consider temporal attributes, which limits their performance in handling dynamic data. 2. **Inductive Setting**: Existing methods mostly work in the transductive setting, that is, the nodes and patterns in the training set and the test set are the same, which limits their generalization ability on unseen patterns and data. 3. **Specific Tasks**: Many existing methods are only designed for specific tasks, such as node classification or hyper - edge prediction, and are difficult to be extended to other downstream tasks, limiting their application scope. To solve these problems, the paper proposes CAt - Walk, an inductive learning method for temporal hypergraphs. CAt - Walk overcomes the above limitations through the following innovations: - **SetWalk**: A new temporal, high - order random walk (SetWalk) is introduced, which can extract high - order causal patterns on hypergraphs. - **SetMixer**: A new adaptive and permutation - invariant pooling strategy (SetMixer) is proposed, as well as a set - based anonymization process to hide the identity information of hyper - edges. - **Neural Network Encoding**: A simple and effective neural network model is used to encode hyper - edges, which can better capture the dynamic and structural features of temporal hypergraphs. Through these innovations, the experimental results of CAt - Walk on multiple benchmark datasets show that it performs excellently in the temporal hyper - edge prediction task and also achieves the best or near - best performance in the dynamic node classification task.

CAT-Walk: Inductive Hypergraph Learning via Set Walks

Inductive Representation Learning in Temporal Networks via Causal Anonymous Walks

INCREASE: Inductive Graph Representation Learning for Spatio-Temporal Kriging

Towards Human-like Perception: Learning Structural Causal Model in Heterogeneous Graph

Temporal Graph Network Embedding with Causal Anonymous Walks Representations

Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Space

Understanding High-Order Network Structure using Permissible Walks on Attributed Hypergraphs

Inductive Representation Learning in Large Attributed Graphs

Hypernetwork Science via High-Order Hypergraph Walks

Higher-Order Graph Convolutional Embedding for Temporal Networks.

DeepWalk: Online Learning of Social Representations

Neural Predicting Higher-order Patterns in Temporal Networks

(HTNE)-T-2: Temporal Heterogeneous Information Network Embedding in Hyperbolic Spaces

Heuristic 3D Interactive Walks for Multilayer Network Embedding

HeteSpaceyWalk: A Heterogeneous Spacey Random Walk for Heterogeneous Information Network Embedding

Visual Analytics of Heterogeneous Data Using Hypergraph Learning.

Hyperbolic Attributed Network Embedding with Self-Adaptive Random Walks.

Distance-Aware Learning for Inductive Link Prediction on Temporal Networks

Tackling higher-order relations and heterogeneity: Dynamic heterogeneous hypergraph network for spatiotemporal activity prediction

NetWalk

A Time-Aware Inductive Representation Learning Strategy for Heterogeneous Graphs