Abstract:Although machine learning (ML) algorithms have been widely used in forecasting the trend of stock market indices, they failed to consider the following crucial aspects for market forecasting: (1) that investors’ emotions and attitudes toward future market trends have material impacts on market trend forecasting (2) the length of past market data should be dynamically adjusted according to the market status and (3) the transition of market statutes should be considered when forecasting market trends. In this study, we proposed an innovative ML method to forecast China's stock market trends by addressing the three issues above. Specifically, sentimental factors (see Appendix [1] for full trans) were first collected to measure investors’ emotions and attitudes. Then, a non-stationary Markov chain (NMC) model was used to capture dynamic transitions of market statutes. We choose the state-of-the-art (SOTA) method, namely, Bidirectional Encoder Representations from Transformers ( BERT ), to predict the state of the market at time t , and a long short-term memory ( LSTM ) model was used to estimate the varying length of past market data in market trend prediction, where the input of LSTM (the state of the market at time t ) was the output of BERT and probabilities for opening and closing of the gates in the LSTM model were based on outputs of the NMC model. Finally, the optimum parameters of the proposed algorithm were calculated using a reinforced learning-based deep Q-Network. Compared to existing forecasting methods, the proposed algorithm achieves better results with a forecasting accuracy of 61.77%, annualized return of 29.25%, and maximum losses of −8.29%. Furthermore, the proposed model achieved the lowest forecasting error: mean square error (0.095), root mean square error (0.0739), mean absolute error (0.104), and mean absolute percent error (15.1%). As a result, the proposed market forecasting model can help investors obtain more accurate market forecast information.

A Novel Recurrent Neural Network Algorithm with Long Short-Term Memory Model for Futures Trading.

Trade Filtering Method for Trend Following Strategy Based on LSTM-extracted Feature and Machine Learning

Empirical Research on Futures Trading Strategy Based on Time Series Algorithm

Stock Price Prediction based on Recurrent Neural Network with Long Short-Term Memory Units

Application of Improved LSTM Algorithm in Macroeconomic Forecasting

Exploring Different Dynamics of Recurrent Neural Network Methods for Stock Market Prediction - A Comparative Study

Stock Price Prediction Using a Frequency Decomposition Based GRU Transformer Neural Network

Applying Long Short Term Momory Neural Networks for Predicting Stock Closing Price

Long Short-Term Memory Neural Network for Financial Time Series

Stock market forecasting using deep learning with long short-term memory and gated recurrent unit

A novel hybrid model based on recurrent neural networks for stock market timing

Research on financial assets transaction prediction model based on LSTM neural network

Forecasting the Market with Machine Learning Algorithms: An Application of NMC-BERT-LSTM-DQN-X Algorithm in Quantitative Trading

Financial market trend prediction model based on LSTM neural network algorithm

Neural Networks for Financial Time Series Forecasting

Enhancing Stock Market Predictability: A Comparative Analysis of RNN And LSTM Models for Retail Investors

Machine learning to predict grains futures prices

ResNLS: An Improved Model for Stock Price Forecasting

Forecasting stock prices with long-short term memory neural network based on attention mechanism

A novel stock trading utilizing long short term memory prediction and evolutionary operating-weights strategy

A Novel Bitcoin and Gold Prices Prediction Method Using an LSTM-P Neural Network Model