Abstract:Time series forecasting (TSF) is a challenging problem in various real-world scenarios, such as industry, energy, weather, traffic, economics, and earthquake warning. TSF demands the model to have a high prediction accuracy. Despite the promising performance of deep learning-based methods in TSF tasks, mainstream forecasting models may sometimes produce results that deviate from the actual ground truth. Our analysis suggests that this may be attributed to the models’ limited ability to capture the frequency information that is abundantly present in real-world datasets. Currently, the Fourier Transform (FT) is the most widely used method for extracting frequency information, but it has some issues that lead to poor model performance, such as high-frequency noise caused by the Gibbs phenomenon and computational overhead of the inverse transformation in the FT-IFT process. To address these issues, we propose a novel frequency enhanced channel attention mechanism (FECAM) that models frequency interdependencies between channels based on Discrete Cosine Transform (DCT), which inherently mitigates the high-frequency noise caused by problematic periodicity during Fourier Transform. This approach improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations. Our contributions are threefold: (1) We propose a novel frequency enhanced channel attention mechanism that models frequency interdependencies between channels based on DCT, which improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations; (2) We theoretically prove that our method mitigates the Gibbs phenomenon, which introduces high frequency noise during Fourier Transform. We demonstrate that the result of 1D GAP linearly varies with the lowest frequency component of 1D DCT; (3) We demonstrate the generalization ability of the proposed method FECAM by embedding it into other networks, resulting in significant performance improvements when compared to the original model, with only a minor increase in parameters. Furthermore, we conduct extensive experiments on six different real-world TSF datasets to validate the effectiveness of our proposed model and compare it with several existing state-of-the-art models. Our findings indicate that the FECAM model is superior to these models in terms of accuracy, making it a promising solution for TSF in diverse real-world scenarios. Our codes and data are available at https://github.com/Zero-coder/FECAM.

TF4TF: Multi-semantic Modeling Within the Time-Frequency Domain for Long-Term Time-Series Forecasting

TFEformer: Temporal Feature Enhanced Transformer for Multivariate Time Series Forecasting

Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series

How Much Can Time-related Features Enhance Time Series Forecasting?

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

Time-FFM: Towards LM-Empowered Federated Foundation Model for Time Series Forecasting

Is Single Enough? A Joint Spatiotemporal Feature Learning Framework for Multivariate Time Series Prediction

Generalizable Memory-driven Transformer for Multivariate Long Sequence Time-series Forecasting

Long Time Series Deep Forecasting with Multiscale Feature Extraction and Seq2seq Attention Mechanism

FECAM: Frequency enhanced channel attention mechanism for time series forecasting

Deep Time Series Forecasting Models: A Comprehensive Survey

Time Series Prediction Based on LSTM and High-Order Fuzzy Cognitive Map with Attention Mechanism

MMFNet: Multi-Scale Frequency Masking Neural Network for Multivariate Time Series Forecasting

Semantic Complete Scene Forecasting from a 4D Dynamic Point Cloud Sequence

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting

Towards Long-Term Time-Series Forecasting: Feature, Pattern, and Distribution

Bi-Mamba4TS: Bidirectional Mamba for Time Series Forecasting

Time Series Forecasting with Multi-scale Decomposition and Fourier Neural Operators

SALSTM: Segmented Self-Attention Long Short-Term Memory for Long-Term Forecasting

LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters

SparseTSF: Modeling Long-term Time Series Forecasting with 1k Parameters