Stock Market Price Prediction: A Hybrid LSTM and Sequential Self-Attention based Approach

Karan Pardeshi,Sukhpal Singh Gill,Ahmed M. Abdelmoniem
2023-08-07
Abstract:One of the most enticing research areas is the stock market, and projecting stock prices may help investors profit by making the best decisions at the correct time. Deep learning strategies have emerged as a critical technique in the field of the financial market. The stock market is impacted due to two aspects, one is the geo-political, social and global events on the bases of which the price trends could be affected. Meanwhile, the second aspect purely focuses on historical price trends and seasonality, allowing us to forecast stock prices. In this paper, our aim is to focus on the second aspect and build a model that predicts future prices with minimal errors. In order to provide better prediction results of stock price, we propose a new model named Long Short-Term Memory (LSTM) with Sequential Self-Attention Mechanism (LSTM-SSAM). Finally, we conduct extensive experiments on the three stock datasets: SBIN, HDFCBANK, and BANKBARODA. The experimental results prove the effectiveness and feasibility of the proposed model compared to existing models. The experimental findings demonstrate that the root-mean-squared error (RMSE), and R-square (R2) evaluation indicators are giving the best results.
Artificial Intelligence,Machine Learning
What problem does this paper attempt to address?
The paper primarily focuses on addressing the issue of stock price prediction, particularly in utilizing historical price trends to forecast future prices. The authors propose a new hybrid model—Long Short-Term Memory network with Sequential Self-Attention Mechanism (LSTM-SSAM), aimed at improving the accuracy of stock price predictions. The core contributions of the paper can be summarized as follows: 1. **Research and Analysis**: A review of existing stock prediction methods was conducted, analyzing their strengths and limitations. 2. **Proposing a New Model**: A new model combining LSTM and sequential self-attention mechanism was designed to capture long-term dependencies and key features in time series data. 3. **Experimental Validation**: Extensive experiments were conducted on three real stock datasets (SBIN, HDFCBANK, and BANKBARODA) to validate the effectiveness and feasibility of the proposed model. 4. **Performance Evaluation**: By comparing the performance of the proposed LSTM-SSAM model with existing models (such as BiLSTM, CNN, Facebook Prophet, ARIMA, etc.), its superiority in prediction accuracy was demonstrated. Some key technical points mentioned in the paper include: - **LSTM**: Used for handling time series data, particularly capturing long-term dependencies. - **Self-Attention Mechanism**: Enhances the model's ability to focus on critical information in the input sequence, aiding in better understanding and predicting stock price trends. - **Data Preprocessing and Feature Engineering**: By normalizing the raw data and calculating simple moving averages (SMA), the prediction accuracy of the model was improved. - **Evaluation Metrics**: Root Mean Square Error (RMSE) and Coefficient of Determination (R² score) were used to assess the predictive performance of the model. According to the experimental results, the LSTM-SSAM model performs excellently in predicting stock prices, demonstrating high prediction accuracy and effectively capturing the dynamic changes in stock prices.