Abstract:Time-series forecasting is an important problem across a wide range of domains. Designing accurate and prompt forecasting algorithms is a non-trivial task, as temporal data that arise in real applications often involve both non-linear dynamics and linear dependencies, and always have some mixtures of sequential and periodic patterns, such as daily, weekly repetitions, and so on. At this point, however, most recent deep models often use Recurrent Neural Networks (RNNs) to capture these temporal patterns, which is hard to parallelize and not fast enough for real-world applications especially when a huge amount of user requests are coming. Recently, CNNs have demonstrated significant advantages for sequence modeling tasks over the de-facto RNNs, while providing high computational efficiency due to the inherent parallelism. In this work, we propose HyDCNN, a novel hybrid framework based on fully Dilated CNN for time-series forecasting tasks. The core component in HyDCNN is a proposed hybrid module, in which our proposed position-aware dilated CNNs are utilized to capture the sequential non-linear dynamics and an autoregressive model is leveraged to capture the sequential linear dependencies. To further capture the periodic temporal patterns, a novel hop scheme is introduced in the hybrid module. HyDCNN is then composed of multiple hybrid modules to capture the sequential and periodic patterns. Each of these hybrid modules targets on either the sequential pattern or one kind of periodic patterns. Extensive experiments on five real-world datasets have shown that the proposed HyDCNN is better compared with state-of-the-art baselines and is at least 200% better than RNN baselines. The datasets and source code will be published in Github to facilitate more future work.

Multi-Horizon Time Series Forecasting with Temporal Attention Learning

Multiplicative Attention Mechanism for Multi-horizon Time Series Forecasting

Hidformer: Hierarchical Dual-Tower Transformer Using Multi-Scale Mergence for Long-Term Time Series Forecasting

Multi-Task Time Series Forecasting With Shared Attention

A Multi-Hierarchical Attention-Based Prediction Method on Time Series with Spatio-Temporal Context among Variables

Multi-scale adaptive attention-based time-variant neural networks for multi-step time series forecasting

Probabilistic Forecasting with Temporal Convolutional Neural Network

Sequence Attention for Multivariate Time Series Forecasting

A novel hybrid deep learning time series forecasting model based on long-short-term patterns

Synergetic Learning of Heterogeneous Temporal Sequences for Multi-Horizon Probabilistic Forecasting

Temporal pattern attention for multivariate time series forecasting

Multi-scale Attention Flow for Probabilistic Time Series Forecasting

Multi-task Learning Method for Hierarchical Time Series Forecasting

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism

Reliable multi-horizon water demand forecasting model: A temporal deep learning approach

HiMTM: Hierarchical Multi-Scale Masked Time Series Modeling with Self-Distillation for Long-Term Forecasting

Long-term Spatio-temporal Forecasting Via Dynamic Multiple-Graph Attention

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting

Masked Multi-Step Multivariate Time Series Forecasting with Future Information

A hybrid framework for multivariate long-sequence time series forecasting

Modeling Temporal Patterns with Dilated Convolutions for Time-Series Forecasting.