TM-vector: A Novel Forecasting Approach for Market stock movement with a Rich Representation of Twitter and Market data

Faraz Sasani,Ramin Mousa,Ali Karkehabadi,Samin Dehbashi,Ali Mohammadi

2023-03-14

Abstract:Stock market forecasting has been a challenging part for many analysts and researchers. Trend analysis, statistical techniques, and movement indicators have traditionally been used to predict stock price movements, but text extraction has emerged as a promising method in recent years. The use of neural networks, especially recurrent neural networks, is abundant in the literature. In most studies, the impact of different users was considered equal or ignored, whereas users can have other effects. In the current study, we will introduce TM-vector and then use this vector to train an IndRNN and ultimately model the market users' behaviour. In the proposed model, TM-vector is simultaneously trained with both the extracted Twitter features and market information. Various factors have been used for the effectiveness of the proposed forecasting approach, including the characteristics of each individual user, their impact on each other, and their impact on the market, to predict market direction more accurately. Dow Jones 30 index has been used in current work. The accuracy obtained for predicting daily stock changes of Apple is based on various models, closed to over 95\% and for the other stocks is significant. Our results indicate the effectiveness of TM-vector in predicting stock market direction.

Statistical Finance,Artificial Intelligence,Machine Learning,Numerical Analysis

What problem does this paper attempt to address?

### Problems the Paper Aims to Solve

The main purpose of this paper is to propose a new method to improve the accuracy of stock market predictions. Specifically, the paper attempts to predict stock market trends by combining social media (especially Twitter) user behavior data with market data.

#### Main Contributions
1. **Introduction of TM-vector**:
- A new method called "TM-vector" is proposed, which integrates user characteristics and market information into a single vector for input into a deep neural network for training.
- This method considers the behavior of each user and extracts relationships between users through independent recurrent neural networks (IndRNN).

2. **Integration of Multiple Features**:
- The paper utilizes multiple features, including tweet text, social network analysis, sentiment analysis, user history, and market data, to construct a comprehensive representation of user behavior.
- These features are used to train the model to improve the accuracy of predicting stock market trends.

3. **Experimental Results**:
- Experiments were conducted on the Dow Jones 30 index, and the results showed that this method achieved an accuracy of nearly 95% in predicting the daily changes of Apple Inc.'s stock, with significant effects on other stocks as well.
- The experimental results indicate that the TM-vector method is effective in predicting stock market trends.

#### Methodology Overview
- **Data Sources**: The paper uses market data from Dow30, including opening price, highest price, lowest price, closing price, and adjusted closing price.
- **Feature Extraction**: The paper details how to extract features from tweet text, social network analysis, sentiment analysis, user history, and market data.
- **Model Training**: IndRNN is used to train these features and ultimately predict market trends.

In summary, this paper aims to propose a new method for predicting stock market trends by combining social media user behavior and market data, and demonstrates its effectiveness through experiments.