Abstract:As the demand for precise predictions grows across various industries due to advancements in sensor technology and computer hardware, multi-feature time series prediction shows significant promise in fields such as information fusion, finance, energy, and meteorology. However, traditional machine learning methods often struggle to forecast future events given the increasing complexity of the data. To address this challenge, the paper introduces an innovative approach that combines an improved k -means clustering with a multi-head self-attention mechanism. This method utilizes long and short-term memory (LSTM) neural networks to filter and identify the most effective feature subset for prediction. In the enhanced k -means clustering algorithm, a novel similarity formula named Feature Vector Similarity (FVS) and a method for automatically determining the number of clustering centers are proposed. This advancement improves the rationality of cluster center selection and enhances overall clustering performance. The multi-head self-attention mechanism calculates the clustering centers and attention weights of objects within the cluster partitions, optimizing feature selection and enhancing computational efficiency. The fusion of k -means clustering, the multi-head self-attention mechanism, and LSTM networks results in a new feature selection method, referred to as KMAL. To further refine the prediction process, we integrate KMAL with LSTM, known for its strong performance in predicting long-term time series, to develop a novel prediction model: KMAL-LSTM. In the subsequent comparative experiments, the prediction performance of the models is assessed using mean absolute error (MAE), mean bias error (MBE), and root mean square error (RMSE). The proposed KMAL-LSTM model consistently exhibits superior validity, stability, and performance when compared to seven other prediction models across six distinct datasets.

TimeCMA: Towards LLM-Empowered Multivariate Time Series Forecasting via Cross-Modality Alignment

CALF: Aligning LLMs for Time Series Forecasting via Cross-modal Fine-Tuning

Hierarchical Multimodal LLMs with Semantic Space Alignment for Enhanced Time Series Classification

TS-TCD: Triplet-Level Cross-Modal Distillation for Time-Series Forecasting Using Large Language Models

Time-LLM: Time Series Forecasting by Reprogramming Large Language Models

A Hybrid Method with Adaptive Sub-Series Clustering and Attention-Based Stacked Residual LSTMs for Multivariate Time Series Forecasting

GPT4MTS: Prompt-based Large Language Model for Multimodal Time-series Forecasting

LLM4TS: Aligning Pre-Trained LLMs as Data-Efficient Time-Series Forecasters

MM-Forecast: A Multimodal Approach to Temporal Event Forecasting with Large Language Models

Adapt to Small-Scale and Long-Term Time Series Forecasting with Enhanced Multidimensional Correlation

LeMoLE: LLM-Enhanced Mixture of Linear Experts for Time Series Forecasting

DualTime: A Dual-Adapter Multimodal Language Model for Time Series Representation

A Deep Multi-Task Representation Learning Method for Time Series Classification and Retrieval.

Multi-view Self-Supervised Contrastive Learning for Multivariate Time Series

AutoTimes: Autoregressive Time Series Forecasters via Large Language Models

ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning

Time Series Forecasting with LLMs: Understanding and Enhancing Model Capabilities

$\textbf{S}^2$IP-LLM: Semantic Space Informed Prompt Learning with LLM for Time Series Forecasting

Taming Pre-trained LLMs for Generalised Time Series Forecasting via Cross-modal Knowledge Distillation

Fusion k-means clustering and multi-head self-attention mechanism for a multivariate time prediction model with feature selection

Advancing Time Series Classification with Multimodal Language Modeling