Abstract:In the burgeoning domain of Large Language Models (LLMs), there is a growing interest in applying LLM to time series forecasting, with multiple studies focused on leveraging textual prompts to further enhance the predictive prowess. This study aims to understand how and why the integration of textual prompts into LLM can effectively improve the prediction accuracy of time series, which is not obvious at the glance, given the significant domain gap between texts and time series. Our extensive examination leads us to believe that (a) adding text prompts is roughly equivalent to introducing additional adapters, and (b) It is the introduction of learnable parameters rather than textual information that aligns the LLM with the time series forecasting task, ultimately enhancing prediction accuracy. Inspired by this discovery, we developed four adapters that explicitly address the gap between LLM and time series, and further improve the prediction accuracy. Overall,our work highlights how textual prompts enhance LLM accuracy in time series forecasting and suggests new avenues for continually improving LLM-based time series analysis.

What problem does this paper attempt to address?

### What problems does this paper attempt to solve? This paper aims to explore the mechanism of integrating textual prompts into large language models (LLMs) to improve the performance of time - series prediction. Specifically, the paper attempts to answer the following key questions: 1. **The role of textual prompts in time - series prediction**: - Does the textual prompt improve the accuracy of time - series prediction through its semantic information? - If not semantic information, what is the mechanism of the textual prompt? 2. **The relationship between textual prompts and adapters**: - Is the role of textual prompts similar to introducing additional adapters? - Is the introduction of learnable parameters the main reason for improving prediction accuracy? 3. **How to design specialized time - series adapters**: - Can the prediction performance be further improved by designing adapters specifically for time - series data? - Can these specialized adapters effectively bridge the domain gap between language models and time - series data? ### Main findings of the paper - **The effect of random textual prompts**: Experiments show that randomly generated textual prompts and random word embeddings can achieve a performance improvement similar to that of carefully designed textual prompts. This indicates that the semantic information of textual prompts is not the key factor in improving the performance of time - series prediction. - **The role of textual prompts is similar to that of adapters**: The study found that textual prompts actually increase the capacity of the model and play a role similar to that of adapters. These adapters improve the performance of time - series prediction tasks by introducing learnable parameters. - **Specially designed adapters**: In order to better bridge the domain gap between language models and time - series data, the author developed four specialized time - series adapters, including time adapters, channel adapters, frequency adapters, and anomaly adapters. These adapters significantly improve the performance of time - series prediction. ### Conclusion The main contribution of this paper lies in revealing the mechanism of the role of textual prompts in time - series prediction and proposing a new method to improve the performance of time - series prediction by designing specialized adapters. These findings provide a new direction for future research, especially in how to use language models more effectively for time - series analysis.

Understanding the Role of Textual Prompts in LLM for Time Series Forecasting: an Adapter View

Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities

Time-LLM: Time Series Forecasting by Reprogramming Large Language Models

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

Rethinking Time Series Forecasting with LLMs via Nearest Neighbor Contrastive Learning

TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignment

An Evaluation of Standard Statistical Models and LLMs on Time Series Forecasting

Taming Pre-trained LLMs for Generalised Time Series Forecasting via Cross-modal Knowledge Distillation

From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection

TEST: Text Prototype Aligned Embedding to Activate LLM's Ability for Time Series

$\textbf{S}^2$IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting

LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters

Improve Temporal Awareness of LLMs for Sequential Recommendation

A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting

Prompt-Aware Adapter: Towards Learning Adaptive Visual Tokens for Multimodal Large Language Models

GPT4MTS: Prompt-based Large Language Model for Multimodal Time-series Forecasting

LLM-TS Integrator: Integrating LLM for Enhanced Time Series Modeling

LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting

LLMForecaster: Improving Seasonal Event Forecasts with Unstructured Textual Data

Understanding Different Design Choices in Training Large Time Series Models