Abstract:While numerous forecasters have been proposed using different network architectures, the Transformer-based models have state-of-the-art performance in time series forecasting. However, forecasters based on Transformers are still suffering from vulnerability to high-frequency signals, efficiency in computation, and bottleneck in full-spectrum utilization, which essentially are the cornerstones for accurately predicting time series with thousands of points. In this paper, we explore a novel perspective of enlightening signal processing for deep time series forecasting. Inspired by the filtering process, we introduce one simple yet effective network, namely FilterNet, built upon our proposed learnable frequency filters to extract key informative temporal patterns by selectively passing or attenuating certain components of time series signals. Concretely, we propose two kinds of learnable filters in the FilterNet: (i) Plain shaping filter, that adopts a universal frequency kernel for signal filtering and temporal modeling; (ii) Contextual shaping filter, that utilizes filtered frequencies examined in terms of its compatibility with input signals for dependency learning. Equipped with the two filters, FilterNet can approximately surrogate the linear and attention mappings widely adopted in time series literature, while enjoying superb abilities in handling high-frequency noises and utilizing the whole frequency spectrum that is beneficial for forecasting. Finally, we conduct extensive experiments on eight time series forecasting benchmarks, and experimental results have demonstrated our superior performance in terms of both effectiveness and efficiency compared with state-of-the-art methods. Code is available at this repository: $\href{<a class="link-external link-https" href="https://github.com/aikunyi/FilterNet" rel="external noopener nofollow">this https URL</a>}{\small\text{this https URL.}}$

GLFNet: Global and Local Frequency-domain Network for Long-term Time Series Forecasting

FL-Net: A multi-scale cross-decomposition network with frequency external attention for long-term time series forecasting

FilterNet: Harnessing Frequency Filters for Time Series Forecasting

GFNet: Global Filter Networks for Visual Recognition

TFDNet: Time-Frequency Enhanced Decomposed Network for Long-term Time Series Forecasting

MFF-FTNet: Multi-scale Feature Fusion across Frequency and Temporal Domains for Time Series Forecasting

Global Filter Networks for Image Classification

FDNet: Focal Decomposed Network for Efficient, Robust and Practical Time Series Forecasting

WFTNet: Exploiting Global and Local Periodicity in Long-term Time Series Forecasting

GLFNET: Global-Local (frequency) Filter Networks for efficient medical image segmentation

Transformer Based Spatial-Temporal Fusion Network for Metro Passenger Flow Forecasting.

TLNets: Transformation Learning Networks for long-range time-series prediction

CrossWaveNet: A dual-channel network with deep cross-decomposition for Long-term Time Series Forecasting

Temporal Chain Network with Intuitive Attention Mechanism for Long-Term Series Forecasting.

Global-Local Temporal Convolutional Network for Traffic Flow Prediction

Local-Global Spatial-Temporal Graph Convolutional Network for Traffic Flow Forecasting

Adaptive Convolutional Forecasting Network Based on Time Series Feature-Driven

Enhancing Short-Term Wind Speed Forecasting using Graph Attention and Frequency-Enhanced Mechanisms

MFGFNet: A Multi-Scale Remote Sensing Change Detection Network Using the Global Filter in the Frequency Domain

CycleNet: Enhancing Time Series Forecasting through Modeling Periodic Patterns

Not All Frequencies Are Created Equal:Towards a Dynamic Fusion of Frequencies in Time-Series Forecasting