[Establishment of cell lines (KH-39, KN-41, and KW-103) from human kidney and bladder cancer and their characteristics].

K. Naito,H. Hisazumi,M. Kanokogi,M. Katoh,K. Nakazima,K. Tsukahara,T. Kobayashi,K. Kuroda,F. Matsubara

DOI: https://doi.org/10.5980/JPNJUROL1928.73.8_1019

1982-08-01

Abstract:

What problem does this paper attempt to address?

Spatial–Temporal Deep Tensor Neural Networks for Large-Scale Urban Network Speed Prediction

Lingxiao Zhou,Shuaichao Zhang,Jingru Yu,Xiqun Chen

DOI: https://doi.org/10.1109/tits.2019.2932038

IF: 8.5

2019-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Real-time traffic speed prediction is an essential component of intelligent transportation systems applications on large-scale urban networks, e.g., proactive traffic management, advanced information provision, and prompt incident response. The family of traffic prediction models (e.g., convolutional neural networks) based on multi-detector speed diagrams in the time-space plane has been one of the most frequently used approaches for individual roads and the entire network. However, the predefined stacking sequence of traffic detectors along the spatial dimension of the speed diagram has a significant influence on the prediction performance, which makes network-wide speed prediction more challenging. To tackle the above challenge and better capture complicated traffic dynamics, we propose a novel speed prediction approach, named spatial-temporal deep tensor neural networks (ST-DTNN), for a large-scale urban network with mixed road types. Spatial and temporal dependencies of different road segments are simultaneously taken into account to improve the network-wide prediction accuracy. A scalable deep tensor is constructed for the ST-DTNN to eliminate the potentially negative impact caused by the manually stacking sequence of speed time series collected at different locations. Multi-step ahead traffic speeds can be simultaneously predicted based on probe data for a real-world large-scale urban network with hundreds of detectors installed on freeways, highways, and major/minor arterials. The results demonstrate the capability and effectiveness of the proposed ST-DTNN approach. Compared with the benchmark models, the ST-DTNN performs higher prediction accuracy during either peak or off-peak periods within an acceptable training time and has more stable prediction performance on the spatial scale. The proposed approach can be extended to develop network-wide traffic state monitoring, optimize routing in navigation services, and support congestion mitigation.
Dynamic Multi-Granularity Spatial-Temporal Graph Attention Network for Traffic Forecasting

Wei Sang,Huiliang Zhang,Xianchang Kang,Ping Nie,Xin Meng,Benoit Boulet,Pei Sun

DOI: https://doi.org/10.1016/j.ins.2024.120230

IF: 8.1

2024-01-31

Information Sciences

Abstract:Traffic forecasting, as the cornerstone of the development of intelligent transportation systems, plays a crucial role in facilitating accurate control and management of urban traffic. By treating sensors as nodes in a road network, recent research on modeling complex spatial-temporal graph structures has achieved notable advancements in traffic forecasting. However, limited by the increasing number of sensors and recorded data points, most of the recent studies on spatial-temporal graph neural network (STGNN) research concentrate on aggregating short-term (e.g. recent one-hour) traffic history to predict future data. Furthermore, almost all previous STGNNs neglect to incorporate the cyclical patterns that appear in the traffic historical data. For example, the cyclical patterns of traffic on the same day or hour of each week can help improve the accuracy of future traffic predictions. In this paper, we propose a novel Dynamic Multi-Granularity Spatial-Temporal Graph Attention Network (DmgSTGAT) framework for traffic forecasting, which leverages multi-granularity spatial-temporal correlations across different time-scales and variables to efficiently consider cyclical patterns in traffic data. We also design effective temporal encoding and transformer encoding layers to produce meaningful multi-granularity sensor-level, day-level, hour-level, and point-level representations. The multi-granularity spatial-temporal graph attention network can use the produced representations to extract useful but sparsely distributed patterns accurately, which also avoids the influence of extra noise from the long-term history. Experimental results on four real-world traffic datasets show that DmgSTGAT can achieve state-of-the-art performance with the help of multi-granularity cyclical patterns compared with various recent baselines.

computer science, information systems
Multistep traffic speed prediction from multiple time-scale spatiotemporal features using graph attention network

Wu, Zhichao,Xu, Mengyun,Chen, Hongting

DOI: https://doi.org/10.1007/s10489-024-05503-0

IF: 5.3

2024-06-08

Applied Intelligence

Abstract:Traffic forecasting using deep learning represents a crucial aspect of intelligent transportation systems, carrying substantial implications for congestion reduction and efficient route planning. Despite its significance, accurately predicting traffic states remains a challenge. Existing methodologies focus on capturing the temporal trends of traffic states and the spatial dependencies between roads to enhance prediction accuracy. However, two noteworthy limitations persist in these approaches: (1) Many models neglect the interaction between spatiotemporal features across varying time spans, hindering their ability to utilize traffic state information effectively for predicting future conditions. (2) Genuine correlations between roads are time-varying, making it inadequate to rely on static graphs or static pre-trained node embeddings to model dynamic correlations between roads. To address these challenges, we propose the Multiple Time-Scale Graph Attention Network (MTS-GATN), which comprises two key modules: the Multiple Time-Scale Spatiotemporal Features Extraction Module and the Feature Augmentation Module. The first module involves stacking multiple spatiotemporal extraction layers to discern traffic state information at different time scales. In the second module, we employ dynamic spatial semantic embedding for feature augmentation, providing nodes with dynamic representations over time. Subsequently, we leverage a multi-head spatiotemporal attention mechanism to comprehensively consider location information and real-time semantic data, facilitating the interaction of traffic state information across multiple time scales. Experimental results on two distinct traffic datasets validate the superior performance of MTS-GATN in medium-term and long-term forecasting scenarios.

computer science, artificial intelligence
Multi-scale feature enhanced spatio-temporal learning for traffic flow forecasting

Shengdong Du,Tao Yang,Fei Teng,Junbo Zhang,Tianrui Li,Yu Zheng

DOI: https://doi.org/10.1016/j.knosys.2024.111787

IF: 8.139

2024-04-11

Knowledge-Based Systems

Abstract:Traffic flow forecasting is a critical task within Intelligent Transportation Systems (ITS). It's main challenge lies in effectively modeling the complex traffic related big data, including intricate intra-channel and inter-channel correlations, as well as dynamic spatio-temporal dependencies. Furthermore, current methods continue to encounter bottlenecks in extracting and learning complex and dynamic spatio-temporal features from the original traffic data for long-term prediction, resulting in challenges related to model robustness and generalization. In response to these, we introduce a novel deep learning model with multi-scale feature enhancement for traffic flow forecasting, which is based on the attention mechanism and the graph convolution learning framework. We first introduce the integration design of the spatio-temporal dependency features enhancement module with the base attention learning block through a memory embedding layer. Then we propose a traffic network topology features enhancement module with the spatial attention layer, enabling dynamic enhanced learning of spatio-temporal dependency features. This comprehensive approach enables the model to effectively learn complex and dynamic spatio-temporal dependencies, capturing key patterns in traffic flow data. Through extensive experimental evaluations using traffic flow forecasting benchmarks, we have validated the superior performance of the proposed model over the state-of-the-art.

computer science, artificial intelligence
Learning Multiaspect Traffic Couplings by Multirelational Graph Attention Networks for Traffic Prediction

Jing Huang,Kun Luo,Longbing Cao,Yuanqiao Wen,Shuyuan Zhong

DOI: https://doi.org/10.1109/tits.2022.3173689

IF: 8.5

2022-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Temporal traffic prediction is critical for ITS yet remains challenging in handling complex spatio-temporal dynamics of traffic systems. The continuous traffic data (e.g., traffic flow, and speed) from various channels and nodes in a traffic network are coupled with each other over the time points of each channel, spatially between traffic nodes, and jointly in both spatial and temporal dimensions. Such multi-aspect traffic data couplings reflect the conditions of a real-life traffic system and evolve over traffic movement and network dynamics. The recent studies formulate traffic prediction by high-profile graph neural networks. However, they mainly focus on hidden relations captured by neural graph mechanisms while overlooking or simplifying the above multi-aspect traffic data couplings. By modeling a traffic system as a coupled traffic network, we learn the multi-aspect traffic data couplings by a Multi-relational Synchronous Graph Attention Network (MS-GAT). Specifically, MS-GAT learns three embeddings to respectively but synchronously represent the traffic data-based channel, temporal, and spatial relations between nodes by specific graph attention designs. The embeddings are further adaptively coupled according to their respective importance to prediction. Tested on five real-world datasets, MS-GAT outperforms six SOTA graph networks-based traffic predictors. MS-GAT captures not only spatial and temporal couplings but also traffic data-based channel interactions over traffic evolution.
Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting

Bing Yu,Haoteng Yin,Zhanxing Zhu

DOI: https://doi.org/10.24963/ijcai.2018/505

2018-07-12

Abstract:Timely accurate traffic forecast is crucial for urban traffic control and guidance. Due to the high nonlinearity and complexity of traffic flow, traditional methods cannot satisfy the requirements of mid-and-long term prediction tasks and often neglect spatial and temporal dependencies. In this paper, we propose a novel deep learning framework, Spatio-Temporal Graph Convolutional Networks (STGCN), to tackle the time series prediction problem in traffic domain. Instead of applying regular convolutional and recurrent units, we formulate the problem on graphs and build the model with complete convolutional structures, which enable much faster training speed with fewer parameters. Experiments show that our model STGCN effectively captures comprehensive spatio-temporal correlations through modeling multi-scale traffic networks and consistently outperforms state-of-the-art baselines on various real-world traffic datasets.

Machine Learning
Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting

Zhiyong Cui,Kristian Henrickson,Ruimin Ke,Ziyuan Pu,Yinhai Wang

DOI: https://doi.org/10.48550/arXiv.1802.07007

2019-11-05

Abstract:Traffic forecasting is a particularly challenging application of spatiotemporal forecasting, due to the time-varying traffic patterns and the complicated spatial dependencies on road networks. To address this challenge, we learn the traffic network as a graph and propose a novel deep learning framework, Traffic Graph Convolutional Long Short-Term Memory Neural Network (TGC-LSTM), to learn the interactions between roadways in the traffic network and forecast the network-wide traffic state. We define the traffic graph convolution based on the physical network topology. The relationship between the proposed traffic graph convolution and the spectral graph convolution is also discussed. An L1-norm on graph convolution weights and an L2-norm on graph convolution features are added to the model's loss function to enhance the interpretability of the proposed model. Experimental results show that the proposed model outperforms baseline methods on two real-world traffic state datasets. The visualization of the graph convolution weights indicates that the proposed framework can recognize the most influential road segments in real-world traffic networks.

Machine Learning
Spatial-Temporal Adaptive Graph Convolution with Attention Network for Traffic Forecasting

Chen Weikang,Li Yawen,Xue Zhe,Li Ang,Wu Guobin

DOI: https://doi.org/10.48550/arXiv.2206.03128

2022-06-07

Abstract:Traffic forecasting is one canonical example of spatial-temporal learning task in Intelligent Traffic System. Existing approaches capture spatial dependency with a pre-determined matrix in graph convolution neural operators. However, the explicit graph structure losses some hidden representations of relationships among nodes. Furthermore, traditional graph convolution neural operators cannot aggregate long-range nodes on the graph. To overcome these limits, we propose a novel network, Spatial-Temporal Adaptive graph convolution with Attention Network (STAAN) for traffic forecasting. Firstly, we adopt an adaptive dependency matrix instead of using a pre-defined matrix during GCN processing to infer the inter-dependencies among nodes. Secondly, we integrate PW-attention based on graph attention network which is designed for global dependency, and GCN as spatial block. What's more, a stacked dilated 1D convolution, with efficiency in long-term prediction, is adopted in our temporal block for capturing the different time series. We evaluate our STAAN on two real-world datasets, and experiments validate that our model outperforms state-of-the-art baselines.

Machine Learning,Graphics
STJLA: A Multi-Context Aware Spatio-Temporal Joint Linear Attention Network for Traffic Forecasting

Yuchen Fang,Yanjun Qin,Haiyong Luo,Fang Zhao,Chenxing Wang

DOI: https://doi.org/10.48550/arXiv.2112.02262

2021-12-04

Abstract:Traffic prediction has gradually attracted the attention of researchers because of the increase in traffic big data. Therefore, how to mine the complex spatio-temporal correlations in traffic data to predict traffic conditions more accurately become a difficult problem. Previous works combined graph convolution networks (GCNs) and self-attention mechanism with deep time series models (e.g. recurrent neural networks) to capture the spatio-temporal correlations separately, ignoring the relationships across time and space. Besides, GCNs are limited by over-smoothing issue and self-attention is limited by quadratic problem, result in GCNs lack global representation capabilities, and self-attention inefficiently capture the global spatial dependence. In this paper, we propose a novel deep learning model for traffic forecasting, named Multi-Context Aware Spatio-Temporal Joint Linear Attention (STJLA), which applies linear attention to the spatio-temporal joint graph to capture global dependence between all spatio-temporal nodes efficiently. More specifically, STJLA utilizes static structural context and dynamic semantic context to improve model performance. The static structure context based on node2vec and one-hot encoding enriches the spatio-temporal position information. Furthermore, the multi-head diffusion convolution network based dynamic spatial context enhances the local spatial perception ability, and the GRU based dynamic temporal context stabilizes sequence position information of the linear attention, respectively. Experiments on two real-world traffic datasets, England and PEMSD7, demonstrate that our STJLA can achieve up to 9.83% and 3.08% accuracy improvement in MAE measure over state-of-the-art baselines.

Machine Learning
Attention-based Spatial-Temporal Graph Convolutional Recurrent Networks for Traffic Forecasting

Haiyang Liu,Chunjiang Zhu,Detian Zhang,Qing Li

DOI: https://doi.org/10.48550/arXiv.2302.12973

IF: 5.414

2023-02-25

Machine Learning

Abstract:Traffic forecasting is one of the most fundamental problems in transportation science and artificial intelligence. The key challenge is to effectively model complex spatial-temporal dependencies and correlations in modern traffic data. Existing methods, however, cannot accurately model both long-term and short-term temporal correlations simultaneously, limiting their expressive power on complex spatial-temporal patterns. In this paper, we propose a novel spatial-temporal neural network framework: Attention-based Spatial-Temporal Graph Convolutional Recurrent Network (ASTGCRN), which consists of a graph convolutional recurrent module (GCRN) and a global attention module. In particular, GCRN integrates gated recurrent units and adaptive graph convolutional networks for dynamically learning graph structures and capturing spatial dependencies and local temporal relationships. To effectively extract global temporal dependencies, we design a temporal attention layer and implement it as three independent modules based on multi-head self-attention, transformer, and informer respectively. Extensive experiments on five real traffic datasets have demonstrated the excellent predictive performance of all our three models with all their average MAE, RMSE and MAPE across the test datasets lower than the baseline methods.
STGIN: A Spatial Temporal Graph-Informer Network for Long Sequence Traffic Speed Forecasting

Ruikang Luo,Yaofeng Song,Liping Huang,Yicheng Zhang,Rong Su

DOI: https://doi.org/10.48550/arXiv.2210.01799

2022-10-01

Abstract:Accurate long series forecasting of traffic information is critical for the development of intelligent traffic systems. We may benefit from the rapid growth of neural network analysis technology to better understand the underlying functioning patterns of traffic networks as a result of this progress. Due to the fact that traffic data and facility utilization circumstances are sequentially dependent on past and present situations, several related neural network techniques based on temporal dependency extraction models have been developed to solve the problem. The complicated topological road structure, on the other hand, amplifies the effect of spatial interdependence, which cannot be captured by pure temporal extraction approaches. Additionally, the typical Deep Recurrent Neural Network (RNN) topology has a constraint on global information extraction, which is required for comprehensive long-term prediction. This study proposes a new spatial-temporal neural network architecture, called Spatial-Temporal Graph-Informer (STGIN), to handle the long-term traffic parameters forecasting issue by merging the Informer and Graph Attention Network (GAT) layers for spatial and temporal relationships extraction. The attention mechanism potentially guarantees long-term prediction performance without significant information loss from distant inputs. On two real-world traffic datasets with varying horizons, experimental findings validate the long sequence prediction abilities, and further interpretation is provided.

Machine Learning,Artificial Intelligence
Graph attention temporal convolutional network for traffic speed forecasting on road networks

Ke Zhang,Fang He,Zhengchao Zhang,Xi Lin,Meng Li

DOI: https://doi.org/10.1080/21680566.2020.1822765

2020-09-23

Abstract:Traffic speed forecasting plays an increasingly essential role in successful intelligent transportation systems. However, this still remains a challenging task when the accuracy requirement is demanding. To improve the prediction accuracy and achieve a timely performance, the capture of the intrinsically spatio-temporal dependencies and the creation of a parallel model architecture are required. Accordingly, we propose a novel end-to-end deep learning framework named Graph Attention Temporal Convolutional Network (GATCN). The proposed model employs the graph attention network to mine the complex spatial correlations within the traffic network and temporal convolution operation to capture temporal dependencies. In addition, the multi-head self-attention mechanism is incorporated into the model to extract the spatio-temporal coupling effects. Experiments show that the proposed model consistently outperforms other state-of-the-art baselines for various prediction intervals on two real-world datasets. Moreover, we reveal that the proposed model can effectively distinguish the sophisticated traffic patterns of ramps on expressways by analyzing the graph attention heatmap.
A Graph-Based Temporal Attention Framework for Multi-Sensor Traffic Flow Forecasting

Shaokun Zhang,Yao Guo,Peize Zhao,Chuanpan Zheng,Xiangqun Chen

DOI: https://doi.org/10.1109/tits.2021.3072118

IF: 8.5

2021-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Accurate spatio-temporal traffic forecasting serves as the basis of dynamic strategy and applications for intelligent transportation systems, which is of great practical significance for improving traffic safety and mitigating road congestion. Recently, deep learning methods such as convolutional neural networks (CNN) have been applied to traffic flow forecasting, which exhibits better performance than conventional methods. However, these CNN-based methods typically learn traffic as images to model spatial correlation, which is only applicable to Euclidean grid map data rather than non-Euclidean multi-sensor data. To address this problem, we propose a graph-based temporal attention framework GTA, which considers both spatial and temporal correlation, to forecast traffic flow based on data collected from multiple sensors. More specifically, GTA can better capture spatial dependencies leveraging graph embedding techniques on sensor networks because it preserves more details in the algorithms. We also introduce an attention mechanism to adaptively identify the relations among temporal submodules. Spatio-temporal dependencies are more effectively and comprehensively integrated due to the full use of the topological properties of transportation networks. We evaluate GTA with a large-scale traffic dataset from England and enhance it with topology information. The experimental results show that our approach outperforms several state-of-the-art baselines.
Adaptive Spatio-temporal Graph Neural Network for traffic forecasting

Xuxiang Ta,Zihan Liu,Xiao Hu,Le Yu,Leilei Sun,Bowen Du

DOI: https://doi.org/10.1016/j.knosys.2022.108199

2022-04-01

Abstract:Accurate traffic forecasting is of vital importance for the management and decision in intelligent transportation systems. Indeed, it is a nontrivial endeavor to predict future traffic conditions due to the complexity of spatial relationships and temporal dependencies. Recent research developed Spatio-Temporal Graph Neural Networks (ST-GNNs) to capture the spatio-temporal correlations and achieved superior performance. However, the graph adjacency matrices that most ST-GNNs use are either pre-defined by heuristic rules or directly learned with trainable parameters. While node attributes, which record valuable information of traffic conditions, have not been fully exploited to guide the learning of better graph structure. In this paper, we propose an Adaptive Spatio-Temporal graph neural Network, namely Ada-STNet, to first derive optimal graph structure with the guidance of node attributes and then capture the complicated spatio-temporal correlations via a dedicated spatio-temporal convolution architecture for multi-step traffic condition forecasting. Specifically, we first propose a graph structure learning component to obtain an optimal graph adjacency matrix from both macro and micro perspectives. Next, we design a dedicated spatio-temporal convolution architecture to learn spatial relationships and temporal dependencies. Moreover, we present a two-stage training strategy to improve the model performance. Extensive experimental results on real-world datasets demonstrate the effectiveness and interpretability of our approach.

computer science, artificial intelligence
Adaptive Multi-receptive Field Spatial-Temporal Graph Convolutional Network for Traffic Forecasting

Xing Wang,Juan Zhao,Lin Zhu,Xu Zhou,Zhao Li,Junlan Feng,Chao Deng,Yong Zhang

DOI: https://doi.org/10.48550/arXiv.2111.00724

2021-11-01

Abstract:Mobile network traffic forecasting is one of the key functions in daily network operation. A commercial mobile network is large, heterogeneous, complex and dynamic. These intrinsic features make mobile network traffic forecasting far from being solved even with recent advanced algorithms such as graph convolutional network-based prediction approaches and various attention mechanisms, which have been proved successful in vehicle traffic forecasting. In this paper, we cast the problem as a spatial-temporal sequence prediction task. We propose a novel deep learning network architecture, Adaptive Multi-receptive Field Spatial-Temporal Graph Convolutional Networks (AMF-STGCN), to model the traffic dynamics of mobile base stations. AMF-STGCN extends GCN by (1) jointly modeling the complex spatial-temporal dependencies in mobile networks, (2) applying attention mechanisms to capture various Receptive Fields of heterogeneous base stations, and (3) introducing an extra decoder based on a fully connected deep network to conquer the error propagation challenge with multi-step forecasting. Experiments on four real-world datasets from two different domains consistently show AMF-STGCN outperforms the state-of-the-art methods.

Machine Learning,Artificial Intelligence
Spatio-Temporal Graph Neural Network for Traffic Prediction Based on Adaptive Neighborhood Selection

HuanZhong Sun,XiangHong Tang,JianGuang Lu,FangJie Liu

DOI: https://doi.org/10.1177/03611981231198851

IF: 1.7

2023-10-02

Transportation Research Record

Abstract:Transportation Research Record, Ahead of Print. Traffic prediction is critical to intelligent transportation and smart cities. The prediction performance of many existing traffic prediction models is limited by the fixed original graph structure and inappropriate spatio-temporal dependency extraction. For this situation, this paper proposes a spatio-temporal graph neural network based on adaptive neighborhood selection (STGNN-ANS). To obtain more flexible graph structures, STGNN-ANS designs a neighbor selection mechanism to generate a new graph structure by filtering inappropriate neighbors. To further capture the spatio-temporal dependence of traffic data, a spatio-temporal serial module of STGNN-ANS adopts the bidirectional learning manner of bidirectional long short-term memory (BiLSTM) and the graph convolution network (GCN) enhanced by self-attention mechanism to reach excellent prediction accuracy in both short-range and long-range scenarios. In this paper, a new baseline comprehensive comparison metric (BCCM) is invented to cope with the complexity in the comparative analysis of large numbers of experimental results. Many experiments have been performed on four real-world traffic datasets, and the results show that the comprehensive prediction performance of STGNN-ANS is better than previous models.
Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency

Xinglei Wang,Xuefeng Guan,Jun Cao,Na Zhang,Huayi Wu

DOI: https://doi.org/10.1016/j.trc.2020.102763

2020-04-06

Abstract:Obtaining accurate information about future traffic flows of all links in a traffic network is of great importance for traffic management and control applications. This research studies two particular problems in traffic forecasting: (1) capture the dynamic and non-local spatial correlation between traffic links and (2) model the dynamics of temporal dependency for accurate multiple steps ahead predictions. To address these issues, we propose a deep learning framework named Spatial-Temporal Sequence to Sequence model (STSeq2Seq). This model builds on sequence to sequence (seq2seq) architecture to capture temporal feature and relies on graph convolution for aggregating spatial information. Moreover, STSeq2Seq defines and constructs pattern-aware adjacency matrices (PAMs) based on pair-wise similarity of the recent traffic patterns on traffic links and integrate it into graph convolution operation. It also deploys a novel seq2sesq architecture which couples a convolutional encoder and a recurrent decoder with attention mechanism for dynamic modeling of long-range dependence between different time steps. We conduct extensive experiments using two publicly-available large-scale traffic datasets and compare STSeq2Seq with other baseline models. The numerical results demonstrate that the proposed model achieves state-of-the-art forecasting performance in terms of various error measures. The ablation study verifies the effectiveness of PAMs in capturing dynamic non-local spatial correlation and the superiority of proposed seq2seq architecture in modeling non-stationary temporal dependency for multiple steps ahead prediction. Furthermore, qualitative analysis is conducted on PAMs as well as the attention weights for model interpretation.

Machine Learning,Signal Processing
MSSTN: a multi-scale spatio-temporal network for traffic flow prediction

Yun Song,Xinke Bai,Wendong Fan,Zelin Deng,Cong Jiang

DOI: https://doi.org/10.1007/s13042-023-02067-2

2024-02-10

International Journal of Machine Learning and Cybernetics

Abstract:Spatio-temporal feature extraction and fusion are crucial to traffic prediction accuracy. However, the complicated spatio-temporal correlations and dependencies between traffic nodes make the problem quite challenging. In this paper, a multi-scale spatio-temporal network (MSSTN) is proposed to exploit complicated local and nonlocal correlations in traffic flow for traffic prediction. In the proposed method, a convolutional neural network, a self-attention module, and a graph convolution network (GCN) are integrated to extract and fuse multi-scale temporal and spatial features to make predictions. Specifically, a self-adaption temporal convolutional neural network (SATCN) is first employed to extract local temporal correlations between adjacent time slices. Furthermore, a self-attention module is applied to capture the long-range nonlocal traffic dependence in the temporal dimension and fuse it with the local features. Then, a graph convolutional network module is utilized to learn spatio-temporal features of the traffic flow to exploit the mutual dependencies between traffic nodes. Experimental results on public traffic datasets demonstrate the superiority of our method over compared state-of-the-art methods. The ablation experiments confirm the effectiveness of each component of the proposed model. Our implementation on Pytorch is publicly available at https://github.com/csust-sonie/MSSTN.

computer science, artificial intelligence
Forecasting traffic flow with spatial–temporal convolutional graph attention networks

Zhang, Xiyue,Xu, Yong,Shao, Yizhen

DOI: https://doi.org/10.1007/s00521-022-07235-z

2022-04-23

Neural Computing and Applications

Abstract:Traffic flow prediction is crucial for intelligent transportation system, such as traffic management, congestion alleviation and public risk assessment. Recently, attention mechanism and deep neural networks are utilized to capture traffic dependencies. However, two challenges have yet to be well addressed: (i) previous works overlook the global dependencies across different regions; (ii) how to integrate spatial and temporal information aggregation with latent channel-aware semantics. To tackle these issues, we propose a deep spatial–temporal convolutional graph attention network for citywide traffic flow prediction. We first apply the multi-resolution transformer network to capture traffic dependencies among different regions with the encoding of multi-level periodicity. Spatial dependencies are captured by the attentive graph neural networks followed by convolutional networks from local view to global view. We further propose to inject spatial contextual signals into our framework with the designed channel-aware recalibration residual network, which effectively endows model with the capability of mapping spatial–temporal data patterns into different representation subspaces of latent semantics. The extensive experiments on four real-world datasets demonstrate at least 5% performance gain of our framework by comparing with 19 state-of-the-art traffic prediction methods.

computer science, artificial intelligence
Make More Connections: Urban Traffic Flow Forecasting with Spatiotemporal Adaptive Gated Graph Convolution Network

Bin Lu,Xiaoying Gan,Haiming Jin,Luoyi Fu,Xinbing Wang,Haisong Zhang

DOI: https://doi.org/10.1145/3488902

IF: 5

2022-04-30

ACM Transactions on Intelligent Systems and Technology

Abstract:Urban traffic flow forecasting is a critical issue in intelligent transportation systems. Due to the complexity and uncertainty of urban road conditions, how to capture the dynamic spatiotemporal correlation and make accurate predictions is very challenging. In most of existing works, urban road network is often modeled as a fixed graph based on local proximity. However, such modeling is not sufficient to describe the dynamics of the road network and capture the global contextual information. In this paper, we consider constructing the road network as a dynamic weighted graph through attention mechanism. Furthermore, we propose to seek both spatial neighbors and semantic neighbors to make more connections between road nodes. We propose a novel Spatiotemporal Adaptive Gated Graph Convolution Network ( STAG-GCN ) to predict traffic conditions for several time steps ahead. STAG-GCN mainly consists of two major components: (1) multivariate self-attention Temporal Convolution Network ( TCN ) is utilized to capture local and long-range temporal dependencies across recent, daily-periodic and weekly-periodic observations; (2) mix-hop AG-GCN extracts selective spatial and semantic dependencies within multi-layer stacking through adaptive graph gating mechanism and mix-hop propagation mechanism. The output of different components are weighted fused to generate the final prediction results. Extensive experiments on two real-world large scale urban traffic dataset have verified the effectiveness, and the multi-step forecasting performance of our proposed models outperforms the state-of-the-art baselines.

computer science, information systems, artificial intelligence

[Establishment of cell lines (KH-39, KN-41, and KW-103) from human kidney and bladder cancer and their characteristics].

Spatial–Temporal Deep Tensor Neural Networks for Large-Scale Urban Network Speed Prediction

Dynamic Multi-Granularity Spatial-Temporal Graph Attention Network for Traffic Forecasting

Multistep traffic speed prediction from multiple time-scale spatiotemporal features using graph attention network

Multi-scale feature enhanced spatio-temporal learning for traffic flow forecasting

Learning Multiaspect Traffic Couplings by Multirelational Graph Attention Networks for Traffic Prediction

Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting

Traffic Graph Convolutional Recurrent Neural Network: A Deep Learning Framework for Network-Scale Traffic Learning and Forecasting

Spatial-Temporal Adaptive Graph Convolution with Attention Network for Traffic Forecasting

STJLA: A Multi-Context Aware Spatio-Temporal Joint Linear Attention Network for Traffic Forecasting

Attention-based Spatial-Temporal Graph Convolutional Recurrent Networks for Traffic Forecasting

STGIN: A Spatial Temporal Graph-Informer Network for Long Sequence Traffic Speed Forecasting

Graph attention temporal convolutional network for traffic speed forecasting on road networks

A Graph-Based Temporal Attention Framework for Multi-Sensor Traffic Flow Forecasting

Adaptive Spatio-temporal Graph Neural Network for traffic forecasting

Adaptive Multi-receptive Field Spatial-Temporal Graph Convolutional Network for Traffic Forecasting

Spatio-Temporal Graph Neural Network for Traffic Prediction Based on Adaptive Neighborhood Selection

Forecast Network-Wide Traffic States for Multiple Steps Ahead: A Deep Learning Approach Considering Dynamic Non-Local Spatial Correlation and Non-Stationary Temporal Dependency

MSSTN: a multi-scale spatio-temporal network for traffic flow prediction

Forecasting traffic flow with spatial–temporal convolutional graph attention networks

Make More Connections: Urban Traffic Flow Forecasting with Spatiotemporal Adaptive Gated Graph Convolution Network