Abstract:Many data in the real world can be abstracted into the format of dynamic graph, and predicting the connection relationship between nodes in graph is a problem that is often faced in the researching. With the development of deep learning techniques, Graph Neural Networks(GNNs) have been widely used to solve graph-related problems and achieved great results. However, most of the works focus on static graph, or applied the method of static graph to coarse grained discrete time graph after slice dynamic graph into snapshot. As a kind of data that incorporates all the time process information, temporal graph contains a variety of information that worth to be explored. Several works have been done for temporal graph data, but there are still shortcomings. We believe that when researching the evolution of dynamic graph, the influence of the surrounding environment on each node in local time and space is decisive for the properties of the node, which has not been considered in the previous works. Therefore, we propose a novel general model: Double Attention Temporal Graph Network(DATGN). Through an activity based sampling algorithm, the significant nodes in the local time-structure space that associated with each node are sampled and generated as sequence, then the global information of node is aggregated through a global attention network. After which the information of the sampled sequences is aggregated by a local attention network that does not depend on edge relations, and the final representation vector of the node is obtained to make the prediction. In the experiment, we selected three data sets from different knowledge domains and compared them with the current state-of-art models. In the transductive and inductive link prediction tasks, DATGN both achieved the best results in terms of accuracy and operational efficiency than other baseline models, and we discussed the reasons of this improvement. The experiment results demonstrate that the local spatial–temporal network layer can capture the evolutionary pattern of the time sequence and improve the accuracy of link prediction.

Deep Process Neural Network for Temporal Deep Learning

Probabilistic Sequential Network for Deep Learning of Complex Process Data and Soft Sensor Application

Deep Neural Network-Embedded Stochastic Nonlinear State-Space Models and Their Applications to Process Monitoring

Modeling Long- and Short-Term Temporal Patterns with Deep Neural Networks

An Empirical Study: Extensive Deep Temporal Point Process

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Soft-Sensor Development Through Deep Learning with Spatial and Temporal Feature Extraction of Complex Processes

Deep Temporal Convolution Network for Time Series Classification

Process Neural Network Modeling for Real Time Short-Term Traffic Flow Prediction

Fully Neural Network based Model for General Temporal Point Processes

Time Series Forecasting and Classification Models Based on Recurrent with Attention Mechanism and Generative Adversarial Networks

DeepTrend: A Deep Hierarchical Neural Network for Traffic Flow Prediction

Dynamic Prediction Model Based on Process Neural Networks and Its Application

Predicting Temporal Sets with Deep Neural Networks

Neural Point Process for Learning Spatiotemporal Event Dynamics

Urban Traffic Flow Prediction with Deep Neural Network

Design of Hierarchical Neural Networks Using Deep LSTM and Self-organizing Dynamical Fuzzy-Neural Network Architecture

Can deep neural networks learn process model structure? An assessment framework and analysis

A Double Attention Graph Network for Link Prediction on Temporal Graph.

Adaptive deep fusion neural network based soft sensor for industrial process

Spatio-temporal attention-based hybrid deep network for time series prediction of industrial process