Abstract:Transformers have gained popularity in time series forecasting for their ability to capture long-sequence interactions. However, their high memory and computing requirements pose a critical bottleneck for long-term forecasting. To address this, we propose TSMixer, a lightweight neural architecture exclusively composed of multi-layer perceptron (MLP) modules for multivariate forecasting and representation learning on patched time series. Inspired by MLP-Mixer's success in computer vision, we adapt it for time series, addressing challenges and introducing validated components for enhanced accuracy. This includes a novel design paradigm of attaching online reconciliation heads to the MLP-Mixer backbone, for explicitly modeling the time-series properties such as hierarchy and channel-correlations. We also propose a novel Hybrid channel modeling and infusion of a simple gating approach to effectively handle noisy channel interactions and generalization across diverse datasets. By incorporating these lightweight components, we significantly enhance the learning capability of simple MLP structures, outperforming complex Transformer models with minimal computing usage. Moreover, TSMixer's modular design enables compatibility with both supervised and masked self-supervised learning methods, making it a promising building block for time-series Foundation Models. TSMixer outperforms state-of-the-art MLP and Transformer models in forecasting by a considerable margin of 8-60%. It also outperforms the latest strong benchmarks of Patch-Transformer models (by 1-2%) with a significant reduction in memory and runtime (2-3X). The source code of our model is officially released as PatchTSMixer in the HuggingFace. Model: <a class="link-external link-https" href="https://huggingface.co/docs/transformers/main/en/model_doc/patchtsmixer" rel="external noopener nofollow">this https URL</a> Examples: <a class="link-external link-https" href="https://github.com/ibm/tsfm/#notebooks-links" rel="external noopener nofollow">this https URL</a>

U-Mixer: An Unet-Mixer Architecture with Stationarity Correction for Time Series Forecasting

MTS-UNMixers: Multivariate Time Series Forecasting via Channel-Time Dual Unmixing

TimeMixer: Decomposable Multiscale Mixing for Time Series Forecasting

WindowMixer: Intra-Window and Inter-Window Modeling for Time Series Forecasting

xLSTM-Mixer: Multivariate Time Series Forecasting by Mixing via Scalar Memories

TSMixer: An all-MLP Architecture for Time Series Forecasting

PatchMixer: A Patch-Mixing Architecture for Long-Term Time Series Forecasting

A Multi-scale Patch Mixer Network for Time Series Anomaly Detection

LLM-Mixer: Multiscale Mixing in LLMs for Time Series Forecasting

FTMixer: Frequency and Time Domain Representations Fusion for Time Series Modeling

Volatility Forecasting in Global Financial Markets Using TimeMixer

A frequency domain-based machine learning architecture for short-term wave height forecasting

StockMixer: A Simple Yet Strong MLP-Based Architecture for Stock Price Forecasting

TSMixer: Lightweight MLP-Mixer Model for Multivariate Time Series Forecasting

RPMixer: Shaking Up Time Series Forecasting with Random Projections for Large Spatial-Temporal Data

A Multi-Scale Decomposition MLP-Mixer for Time Series Analysis

AutoMixer for Improved Multivariate Time-Series Forecasting on Business and IT Observability Data

Contextualizing MLP-Mixers Spatiotemporally for Urban Data Forecast at Scale

HDMixer: Hierarchical Dependency with Extendable Patch for Multivariate Time Series Forecasting

Mixer is more than just a model