Abstract:Multi-variable time series (MTS) information is a typical type of data inference in the real world. Every instance of MTS is produced via a hybrid dynamical scheme, the dynamics of which are often unknown. The hybrid species of this dynamical service are the outcome of high-frequency and low-frequency external impacts, as well as global and local spatial impacts. These influences impact MTS's future growth; hence, they must be incorporated into time series forecasts. Two types of normalization modules, temporal and spatial normalization, are recommended to accomplish this. Each boosts the original data's local and high-frequency processes distinctly. In addition, all components are easily incorporated into well-known deep learning techniques, such as Wavenet and Transformer. However, existing methodologies have inherent limitations when it comes to isolating the variables produced by each sort of influence from the real data. Consequently, the study encompasses conventional neural networks, such as the multi-layer perceptron (MLP), complex deep learning methods such as LSTM, two recurrent neural networks, support vector machines (SVM), and their application for regression, XGBoost, and others. Extensive experimental work on three datasets shows that the effectiveness of canonical frameworks could be greatly improved by adding more normalization components to how the MTS is used. This would make it as effective as the best MTS designs are currently available. Recurrent models, such as LSTM and RNN, attempt to recognize the temporal variability in the data; however, as a result, their effectiveness might soon decline. Last but not least, it is claimed that training a temporal framework that utilizes recurrence-based methods such as RNN and LSTM approaches is challenging and expensive, while the MLP network structure outperformed other models in terms of time series predictive performance.

TTS-Norm: Forecasting Tensor Time Series via Multi-way Normalization

Learning Gaussian Mixture Representations for Tensor Time Series Forecasting

Spatial and Temporal Normalization for Multi-Variate Time Series Prediction Using Machine Learning Algorithms

Robust Multi-Dimensional Time Series Forecasting

Low-Rank Autoregressive Tensor Completion for Multivariate Time Series Forecasting

Tensor-Train Recurrent Neural Networks for Interpretable Multi-Way Financial Forecasting

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

NTDformer: A Multi-Scale Forecasting Model for Non-Stationary Multilevel Time Series

Learnable Spatial-Spectral Transform-Based Tensor Nuclear Norm for Multi-Dimensional Visual Data Recovery

TCLN: A Transformer-based Conv-LSTM Network for Multivariate Time Series Forecasting

Nonstationary Temporal Matrix Factorization for Multivariate Time Series Forecasting

TLNets: Transformation Learning Networks for long-range time-series prediction

Tensor-to-Vector Regression for Multi-channel Speech Enhancement based on Tensor-Train Network

DDTCN: Decomposed dimension time-domain convolutional neural network along spatial dimensions for multiple long-term series forecasting

TwinS: Revisiting Non-Stationarity in Multivariate Time Series Forecasting

Disentangling Structured Components: Towards Adaptive, Interpretable and Scalable Time Series Forecasting

SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters

FredNormer: Frequency Domain Normalization for Non-stationary Time Series Forecasting

Evolving Multi-Scale Normalization for Time Series Forecasting under Distribution Shifts

FlexTSF: A Universal Forecasting Model for Time Series with Variable Regularities

Improving long-term multivariate time series forecasting with a seasonal-trend decomposition-based 2-dimensional temporal convolution dense network