Abstract:This study proposes an efficient method for computing State Vectors in Sequence-to-Sequence (SVSeq2Seq) architecture to improve the performance of sequence data forecasting, which associates each element with other elements instead of relying only on nearby elements. First, the dependency between two elements is adaptively captured by calculating the relative importance between hidden layers. Second, tensor train decomposition is used to address the issue of dimensionality catastrophe. Third, we further select seven instantiated baseline models for data prediction and compare them with our proposed model on six real-world datasets. The results show that the Mean Square Error (MSE) and Mean Absolute Error (MAE) of our SVSeq2Seq model exhibit significant advantages over the other seven baseline models in predicting the three datasets, i.e., weather, electricity, and PEMS, with MSE/MAE values as low as 0.259/0.260, 0.186/0.285 and 0.113/0.222, respectively. Furthermore, the ablation study demonstrates that the SVSeq2Seq model possesses distinct advantages in sequential forecasting tasks. It is observed that replacing SVSeq2Seq with LPRcode and NMTcode resulted in an increase under an MSE of 18.05 and 10.11 times, and an increase under an MAE of 16.54 and 9.8 times, respectively. In comparative experiments with support vector machines (SVM) and random forest (RF), the performance of the SVSeq2Seq model is improved by 56.88 times in the weather dataset and 73.78 times in the electricity dataset under the MSE metric, respectively. The above experimental results demonstrate both the exceptional rationality and versatility of the SVSeq2Seq model for data forecasting.

Foundations of Sequence-to-Sequence Modeling for Time Series

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

A Survey of Time Series Foundation Models: Generalizing Time Series Representation with Large Language Model

ViTime: A Visual Intelligence-Based Foundation Model for Time Series Forecasting

A Survey of Deep Learning and Foundation Models for Time Series Forecasting

Theory and Algorithms for Forecasting Time Series

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Learning Deep Time-index Models for Time Series Forecasting

Deep probabilistic time series forecasting using augmented recurrent input for dynamic systems

A decoder-only foundation model for time-series forecasting

Text2TimeSeries: Enhancing Financial Forecasting through Time Series Prediction Updates with Event-Driven Insights from Large Language Models

Deep Time Series Models for Scarce Data

Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecasting

A Review of Deep Learning Models for Time Series Prediction

Time-SSM: Simplifying and Unifying State Space Models for Time Series Forecasting

Deep Time Series Models: A Comprehensive Survey and Benchmark

FoundTS: Comprehensive and Unified Benchmarking of Foundation Models for Time Series Forecasting

ExoTST: Exogenous-Aware Temporal Sequence Transformer for Time Series Prediction

SVSeq2Seq: An Efficient Computational Method for State Vectors in Sequence-to-Sequence Architecture Forecasting

A Survey and Formal Analyses on Sequence Learning Methodologies and Deep Neural Networks