Abstract:Correctly predicting the stock price movement direction is of immense importance in the financial market. In recent years, with the expansion of dimension and volume in data, the nonstationary and nonlinear characters in finance data make it difficult to predict stock movement accurately. In this article, we propose a methodology that combines technical analysis and sentiment analysis to construct predictor variables and then apply the improved LASSO-LASSO to forecast stock direction. First, the financial textual content and stock historical transaction data are crawled from websites. Then transfer learning Finbert is used to recognize the emotion of textual data and the TTR package is taken to calculate the technical indicators based on historical price data. To eliminate the multi-collinearity of predictor variables after combination, we improve the long short-term memory neural network (LSTM) model with the Absolute Shrinkage and Selection Operator (LASSO). In predict phase, we apply the variables screened as the input vector to train the LASSO-LSTM model. To evaluate the model performance, we compare the LASSO-LSTM and baseline models on accuracy and robustness metrics. In addition, we introduce the Wilcoxon signed rank test to evaluate the difference in results. The experiment result proves that the LASSO-LSTM with technical and sentiment indicators has an average 8.53% accuracy improvement than standard LSTM. Consequently, this study proves that utilizing historical transactions and financial sentiment data can capture critical information affecting stock movement. Also, effective variable selection can retain the key variables and improve the model prediction performance.

Application of an ANN and LSTM-based Ensemble Model for Stock Market Prediction

Stock Market Analysis and Prediction Using LSTM: A Case Study on Technology Stocks

Financial market trend prediction model based on LSTM neural network algorithm

Stock Prediction Based on Optimized LSTM and GRU Models

Prediction of stock return by LSTM neural network

Data Analysis on the Computer Intelligent Stock Prediction Model Based on LSTM RNN and Algorithm Optimization

Application of Market Cycle Analysis and LSTM in Prediction of Stock Price Movements

An innovative neural network approach for stock market prediction

Stock prediction and analysis based on machine learning algorithms

Case-Based Teaching for Stock Prediction System Based on Deep Learning

Modeling and Analysis of Stock Price Forecast Based on LSTM

Stock Market Prediction Model using LSTM

Automated Stock Trading System using Technical Analysis and Deep Learning Models

Prediction of stock price direction using the LASSO-LSTM model combines technical indicators and financial sentiment analysis

Research on Stock Prediction Based on Simulated Annealing Algorithm and Ensemble Neural Learning

Application of LSTM and CONV1D LSTM Network in Stock Forecasting Model

Stock Market Price Prediction: A Hybrid LSTM and Sequential Self-Attention based Approach

Stock Price Prediction Based on Optimized LSTM Model

Stock Market Prediction on High-Frequency Data Using Generative Adversarial Nets

High-performance stock index trading: making effective use of a deep LSTM neural network

Stock closing price prediction based on sentiment analysis and LSTM