Temporal Aggregation and Propagation Graph Neural Networks for Dynamic Representation
Tongya Zheng,Xinchao Wang,Zunlei Feng,Jie Song,Yunzhi Hao,Mingli Song,Xingen Wang,Xinyu Wang,Chun Chen
DOI: https://doi.org/10.1109/tkde.2023.3265271
IF: 9.235
2023-01-01
IEEE Transactions on Knowledge and Data Engineering
Abstract:Temporal graphs exhibit dynamic interactions between nodes over continuous time, whose topologies evolve with time elapsing. The whole temporal neighborhood of nodes reveals the varying preferences of nodes. However, previous works usually generate dynamic representation with limited neighbors for simplicity, which results in both inferior performance and high latency of online inference. Therefore, in this paper, we propose a novel method of temporal graph convolution with the whole neighborhood, namely Temporal Aggregation and Propagation Graph Neural Networks (TAP-GNN). Specifically, we first analyze the computational complexity of the dynamic representation problem by unfolding the temporal graph in a message-passing paradigm. The expensive complexity motivates us to design the AP (aggregation and propagation) block, which significantly reduces the repeated computation of historical neighbors. The final TAP-GNN supports online inference in the graph stream scenario, which incorporates the temporal information into node embeddings with a temporal activation function and a projection layer besides several AP blocks. Experimental results on various real-life temporal networks show that our proposed TAP-GNN outperforms existing temporal graph methods by a large margin in terms of both predictive performance and online inference latency.
computer science, information systems, artificial intelligence,engineering, electrical & electronic