Abstract:Time series forecasting (TSF) is a challenging problem in various real-world scenarios, such as industry, energy, weather, traffic, economics, and earthquake warning. TSF demands the model to have a high prediction accuracy. Despite the promising performance of deep learning-based methods in TSF tasks, mainstream forecasting models may sometimes produce results that deviate from the actual ground truth. Our analysis suggests that this may be attributed to the models’ limited ability to capture the frequency information that is abundantly present in real-world datasets. Currently, the Fourier Transform (FT) is the most widely used method for extracting frequency information, but it has some issues that lead to poor model performance, such as high-frequency noise caused by the Gibbs phenomenon and computational overhead of the inverse transformation in the FT-IFT process. To address these issues, we propose a novel frequency enhanced channel attention mechanism (FECAM) that models frequency interdependencies between channels based on Discrete Cosine Transform (DCT), which inherently mitigates the high-frequency noise caused by problematic periodicity during Fourier Transform. This approach improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations. Our contributions are threefold: (1) We propose a novel frequency enhanced channel attention mechanism that models frequency interdependencies between channels based on DCT, which improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations; (2) We theoretically prove that our method mitigates the Gibbs phenomenon, which introduces high frequency noise during Fourier Transform. We demonstrate that the result of 1D GAP linearly varies with the lowest frequency component of 1D DCT; (3) We demonstrate the generalization ability of the proposed method FECAM by embedding it into other networks, resulting in significant performance improvements when compared to the original model, with only a minor increase in parameters. Furthermore, we conduct extensive experiments on six different real-world TSF datasets to validate the effectiveness of our proposed model and compare it with several existing state-of-the-art models. Our findings indicate that the FECAM model is superior to these models in terms of accuracy, making it a promising solution for TSF in diverse real-world scenarios. Our codes and data are available at https://github.com/Zero-coder/FECAM.

Frequency Ensemble Based on Multi-Band Checkpoint Saving Mechanism for Time Series Forecasting

HiFNet: rethinking time series forecasting models from a perspective of error power spectrum

A novel ensemble deep learning model with dynamic error correction and multi-objective ensemble pruning for time series forecasting

Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecasting

Ensemble Modeling for Time Series Forecasting: an Adaptive Robust Optimization Approach

Variable-Weighted Ensemble Forecasting of Short-Term Power Load Based on Factor Space Theory

Wind Speed Multi-Step Forecasting Using High-Resolution and Multi-Objective Ensemble Model with Error Correction

pTSE: A Multi-model Ensemble Method for Probabilistic Time Series Forecasting

FECAM: Frequency enhanced channel attention mechanism for time series forecasting

D-PAD: Deep-Shallow Multi-Frequency Patterns Disentangling for Time Series Forecasting

DisenTS: Disentangled Channel Evolving Pattern Modeling for Multivariate Time Series Forecasting

DoubleEnsemble: A New Ensemble Method Based on Sample Reweighting and Feature Selection for Financial Data Analysis

Parallel Extraction of Long-term Trends and Short-term Fluctuation Framework for Multivariate Time Series Forecasting

Multi-output Ensembles for Multi-step Forecasting

Research on Short-term Time Series Forecasting Method Based on Feature Fusion of Electric Power

Introducing Spectral Attention for Long-Range Dependency in Time Series Forecasting

Optimizing Time-Series forecasting using stacked deep learning framework with enhanced adaptive moment estimation and error correction

Bayesian optimization based dynamic ensemble for time series forecasting

W-FENet: Wavelet-based Fourier-Enhanced Network Model Decomposition for Multivariate Long-Term Time-Series Forecasting

Infinite forecast combinations based on Dirichlet process

Research on a Deep Ensemble Learning Model for the Ultra-Short-Term Probabilistic Prediction of Wind Power