Abstract:Time series forecasting (TSF) is a challenging problem in various real-world scenarios, such as industry, energy, weather, traffic, economics, and earthquake warning. TSF demands the model to have a high prediction accuracy. Despite the promising performance of deep learning-based methods in TSF tasks, mainstream forecasting models may sometimes produce results that deviate from the actual ground truth. Our analysis suggests that this may be attributed to the models’ limited ability to capture the frequency information that is abundantly present in real-world datasets. Currently, the Fourier Transform (FT) is the most widely used method for extracting frequency information, but it has some issues that lead to poor model performance, such as high-frequency noise caused by the Gibbs phenomenon and computational overhead of the inverse transformation in the FT-IFT process. To address these issues, we propose a novel frequency enhanced channel attention mechanism (FECAM) that models frequency interdependencies between channels based on Discrete Cosine Transform (DCT), which inherently mitigates the high-frequency noise caused by problematic periodicity during Fourier Transform. This approach improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations. Our contributions are threefold: (1) We propose a novel frequency enhanced channel attention mechanism that models frequency interdependencies between channels based on DCT, which improves the model’s capability to extract frequency features and resolves computational overhead concerns that arise from inverse transformations; (2) We theoretically prove that our method mitigates the Gibbs phenomenon, which introduces high frequency noise during Fourier Transform. We demonstrate that the result of 1D GAP linearly varies with the lowest frequency component of 1D DCT; (3) We demonstrate the generalization ability of the proposed method FECAM by embedding it into other networks, resulting in significant performance improvements when compared to the original model, with only a minor increase in parameters. Furthermore, we conduct extensive experiments on six different real-world TSF datasets to validate the effectiveness of our proposed model and compare it with several existing state-of-the-art models. Our findings indicate that the FECAM model is superior to these models in terms of accuracy, making it a promising solution for TSF in diverse real-world scenarios. Our codes and data are available at https://github.com/Zero-coder/FECAM.

Adaptive Multi-Scale TF-net for High-Resolution Time-Frequency Representations

QTFN: A General End-to-End Time-Frequency Network to Reveal the Time-Varying Signatures of the Time Series

TFEformer: Temporal Feature Enhanced Transformer for Multivariate Time Series Forecasting

Multi-Scale Cross-Attention Fusion Network Based on Image Super-Resolution

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

TF(2)AN: A Temporal-Frequency Fusion Attention Network for Spectrum Energy Level Prediction

Boost Spectrum Prediction with Temporal-Frequency Fusion Network Via Transfer Learning

Adaptive Temporal-Frequency Network for Time-Series Forecasting

A time-frequency fusion model for multi-channel speech enhancement

ATFNet: Adaptive Time-Frequency Ensembled Network for Long-term Time Series Forecasting

TFDMNet: A Novel Network Structure Combines the Time Domain and Frequency Domain Features

MFF-FTNet: Multi-scale Feature Fusion across Frequency and Temporal Domains for Time Series Forecasting

TFDNet: Time-Frequency Enhanced Decomposed Network for Long-term Time Series Forecasting

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

Temporal Convolutional Network with Frequency Dimension Adaptive Attention for Speech Enhancement.

Adaptive Convolutional Forecasting Network Based on Time Series Feature-Driven

Remote Sensing Imagery Super Resolution Based on Adaptive Multi-Scale Feature Fusion Network

FECAM: Frequency enhanced channel attention mechanism for time series forecasting

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

RTFN: A robust temporal feature network for time series classification

AdaFSNet: Time Series Classification Based on Convolutional Network with a Adaptive and Effective Kernel Size Configuration