Abstract:Accurate and real-time prediction of network traffic can not only help system operators allocate resources rationally according to their actual business needs but also help them assess the performance of a network and analyze its health status. In recent years, neural networks have been proved suitable to predict time series data, represented by the model of a long short-term memory (LSTM) neural network and a temporal convolutional network (TCN). This article proposes a novel hybrid prediction method named SG and TCN-based LSTM (ST-LSTM) for such network traffic prediction, which synergistically combines the power of the Savitzky–Golay (SG) filter, the TCN, as well as the LSTM. ST-LSTM employs a three-phase end-to-end methodology serving time series prediction. It first eliminates noise in raw data using the SG filter, then extracts short-term features from sequences applying the TCN, and then captures the long-term dependence in the data exploiting the LSTM. Experimental results over real-world datasets demonstrate that the proposed ST-LSTM outperforms state-of-the-art algorithms in terms of prediction accuracy. Note to Practitioners—This work considers real-time and high-accuracy prediction of network traffic. It is highly important to well predict network traffic by capturing long-term dependence and effectively extracting high- and low-frequency information from time series data. Yet, it is a big challenge to achieve it because there are unstable characteristics and strong nonlinear features in the network traffic due to continuous expansion of network scale and fast emergence of new services. Current prediction methods usually have oversimplified theoretical assumptions, need significant time and memory, or suffer problems of gradient disappearance or early convergence. Thus, they fail to effectively capture the nonlinear characteristics of large-scale network sequences. This work proposes a hybrid predic-ion method named SG and TCN-based LSTM (ST-LSTM), which integrates the merits of the Savitzky–Golay filter, the temporal convolutional network (TCN), and the long short-term memory (LSTM), serving as smoothing time series, capturing short-term local features, and capturing long-term dependence, respectively. Experimental results based on the real-life dataset demonstrate that it achieves better prediction accuracy than its state-of-the-art peers, including the TCN and the LSTM. It can be readily implemented and deployed in many real-life industrial areas including smart city, edge computing, cloud computing, and data centers.

Online Prediction for Streaming Tensor Time Series

Efficient Online Prediction for High-Dimensional Time Series via Joint Tensor Tucker Decomposition

Spatial–Temporal Deep Tensor Neural Networks for Large-Scale Urban Network Speed Prediction

Traffic Flow Prediction Based on Stream Tensor Analysis

Fast Autoregressive Tensor Decomposition for Online Real-time Traffic Flow Prediction

Online Anomaly Prediction for Real-Time Stream Processing.

Online Internet Anomaly Detection with High Accuracy: A Fast Tensor Factorization Solution

Act Now: A Novel Online Forecasting Framework for Large-Scale Streaming Data

Robust Online Time Series Prediction with Recurrent Neural Networks

Deep Learning for Knowledge-Driven Ontology Stream Prediction.

Long-Short Term Spatiotemporal Tensor Prediction for Passenger Flow Profile

Tensor-Based Temporal Control for Partially Observed High-Dimensional Streaming Data

An algorithm for online tensor prediction

Streaming Probabilistic Deep Tensor Factorization

Short-term Traffic Flow Prediction Based on Adaptive Rank Dynamic Tensor Analysis

NonSTOP: A NonSTationary Online Prediction Method for Time Series

Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perception

A Hybrid Prediction Method for Realistic Network Traffic With Temporal Convolutional Network and LSTM

ESPSA: A prediction-based algorithm for streaming time series segmentation.

Tensor Train Factorization with Spatio-temporal Smoothness for Streaming Low-rank Tensor Completion

Online Tensor Inference