Abstract:As financial markets grow increasingly complex in the big data era, accurate stock prediction has become more critical. Traditional time series models, such as GRUs, have been widely used but often struggle to capture the intricate nonlinear dynamics of markets, particularly in the flexible selection and effective utilization of key historical information. Recently, methods like Graph Neural Networks and Reinforcement Learning have shown promise in stock prediction but require high data quality and quantity, and they tend to exhibit instability when dealing with data sparsity and noise. Moreover, the training and inference processes for these models are typically complex and computationally expensive, limiting their broad deployment in practical applications. Existing approaches also generally struggle to capture unobservable latent market states effectively, such as market sentiment and expectations, microstructural factors, and participant behavior patterns, leading to an inadequate understanding of market dynamics and subsequently impact prediction accuracy. To address these challenges, this paper proposes a stock prediction model, MCI-GRU, based on a multi-head cross-attention mechanism and an improved GRU. First, we enhance the GRU model by replacing the reset gate with an attention mechanism, thereby increasing the model's flexibility in selecting and utilizing historical information. Second, we design a multi-head cross-attention mechanism for learning unobservable latent market state representations, which are further enriched through interactions with both temporal features and cross-sectional features. Finally, extensive experiments on four main stock markets show that the proposed method outperforms SOTA techniques across multiple metrics. Additionally, its successful application in real-world fund management operations confirms its effectiveness and practicality.

An Accurate GRU-Based Power Time-Series Prediction Approach With Selective State Updating and Stochastic Optimization

SGRU: A High-Performance Structured Gated Recurrent Unit for Traffic Flow Prediction

Effective LSTMs with Seasonal-Trend Decomposition and Adaptive Learning and Niching-Based Backtracking Search Algorithm for Time Series Forecasting

GRU-ES: Resource Usage Prediction of Cloud Workloads Using a Novel Hybrid Method.

A multi-factor driven spatiotemporal wind power prediction model based on ensemble deep graph attention reinforcement learning networks

NGCU: A New RNN Model for Time-Series Data Prediction

Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularization

Short-term power load forecasting based on PSO-GRU

A Stacked GRU-RNN-Based Approach for Predicting Renewable Energy and Electricity Load for Smart Grid Operation

An attention-based recurrent learning model for short-term travel time prediction

A hybrid deep learning architecture for wind power prediction based on bi-attention mechanism and crisscross optimization

GRU-corr Neural Network Optimized by Improved PSO Algorithm for Time Series Prediction

SE-GRU: Structure Embedded Gated Recurrent Unit Neural Networks for Temporal Link Prediction

A Short-Term Traffic Flow Prediction Model Based on an Improved Gate Recurrent Unit Neural Network

CNN-GRU model based on attention mechanism for large-scale energy storage optimization in smart grid

A Two-stage Sparse Optimization Algorithm for Gated Recurrent Units Estimators

Wireless Channel Prediction of GRU Based on Experience Replay and Snake Optimizer

Short‐term power load forecasting based on multi‐layer bidirectional recurrent neural network

A novel general-purpose hybrid model for time series forecasting

MCI-GRU: Stock Prediction Model Based on Multi-Head Cross-Attention and Improved GRU

A Short-Term Load Forecasting Model Based on Crisscross Grey Wolf Optimizer and Dual-Stage Attention Mechanism