Abstract:Correctly predicting the stock price movement direction is of immense importance in the financial market. In recent years, with the expansion of dimension and volume in data, the nonstationary and nonlinear characters in finance data make it difficult to predict stock movement accurately. In this article, we propose a methodology that combines technical analysis and sentiment analysis to construct predictor variables and then apply the improved LASSO-LASSO to forecast stock direction. First, the financial textual content and stock historical transaction data are crawled from websites. Then transfer learning Finbert is used to recognize the emotion of textual data and the TTR package is taken to calculate the technical indicators based on historical price data. To eliminate the multi-collinearity of predictor variables after combination, we improve the long short-term memory neural network (LSTM) model with the Absolute Shrinkage and Selection Operator (LASSO). In predict phase, we apply the variables screened as the input vector to train the LASSO-LSTM model. To evaluate the model performance, we compare the LASSO-LSTM and baseline models on accuracy and robustness metrics. In addition, we introduce the Wilcoxon signed rank test to evaluate the difference in results. The experiment result proves that the LASSO-LSTM with technical and sentiment indicators has an average 8.53% accuracy improvement than standard LSTM. Consequently, this study proves that utilizing historical transactions and financial sentiment data can capture critical information affecting stock movement. Also, effective variable selection can retain the key variables and improve the model prediction performance.

Stock closing price prediction based on sentiment analysis and LSTM

LSTM Neural Network with Emotional Analysis for Prediction of Stock Price

A Stock Price Prediction Model Based on Investor Sentiment and Optimized Deep Learning

Sentiment-Aware Stock Market Prediction: A Deep Learning Method

Sentiment to Stocks: Rule-Based and Deep Learning Sentiment Analysis for LSTM-Driven Stock Prediction

Stock Price Prediction Based on LSTM Deep Learning Model

Stock Price Prediction Based on Optimized LSTM Model

Prediction of stock price direction using the LASSO-LSTM model combines technical indicators and financial sentiment analysis

Stock Prediction Using Sentiment Analysis and LSTM

The role of text-extracted investor sentiment in Chinese stock price prediction with the enhancement of deep learning

S_I_LSTM: stock price prediction based on multiple data sources and sentiment analysis

Stock Market Price Prediction: A Hybrid LSTM and Sequential Self-Attention based Approach

Explainable stock prices prediction from financial news articles using sentiment analysis

Prediction of stock return by LSTM neural network

An Economic Forecasting Method Based on the LightGBM-Optimized LSTM and Time-Series Model

A new attention-based LSTM model for closing stock price prediction

Stock Market Prediction Model using LSTM

Effective Stock Market Pricing Prediction Using Long Short Term Memory-Upgraded Model (LSTM-UP) on Evolving Data Sets

Stock price prediction based on LSTM and LightGBM hybrid model

Modeling and Analysis of Stock Price Forecast Based on LSTM

Stock Price Prediction using Multi-Layered Sequential LSTM