Abstract:The ability to accurately predict the stock market is a crucial financial topic. The basic assumption is that future stock returns can be somewhat predicted based on publicly available data from the past. Economic variables like interest rates and currency rates, information related to political influences, and company-specific data like statements of income and dividends are some examples of this information. Yet, attempting to forecast stock returns goes against the idea that markets are generally efficient. A prediction model has been created that leverages machine learning, big data analytics, and social media analytics to predict stock market trends regularly. The main objective of this work is to propose a novel approach for stock market prediction for handling big data. This research develops a new SP-PDA (Stock Price Prediction with Political Data Analysis) which includes preprocessing, feature extraction, and prediction. In this work, we employed three types of data (Stock data, News data and Political data). For the stock data, preprocessing was done using Z-score normalization, while tokenization and lemmatization were used for the news and political data. Next, to handle the big data, we used a Map-Reduce architecture. Here, feature extraction from preprocessed stock, news, and political data occurs in the mapper function. The reduction face yields the final extracted feature set. Commodity channel index (CCI), Chaikin Volatility (CV), and Donchian Channel (DC) are examples of technical indicator-based features that are extracted for stock data during the feature extraction phase. Mutual Information (MI), Improved Pointwise mutual information (IPMI), Term Frequency-Inverse Document Frequency (TF-IDF), and correlation features are retrieved for news and political data. Stock market prediction is based on the features extracted. To predict stock prices, we employed an ensemble classification model that incorporates classifiers such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Bidirectional Gated Recurrent Unit (Bi-GRU), Long-short term memory (LSTM), and Deep Maxout. An improved score level fusion is carried out to define the final prediction outcome from the obtained intermediate prediction results. The suggested Dwarf Mongoose Updated War Strategy-based Generalized Normal Distribution (DMUWS-based GND) Optimization Algorithm is used to optimizing the weights of ensemble classifiers. Finally, the performance of the proposed model is evaluated over existing models in terms of error measures like Mean Absolute Error (MAE), Mean Squared Error (MSE), Mean Absolute Percentage Error (MAPE) and Mean Squared Log Error (MSLE). The SP-PDA achieved the desired MAE of 0.012, which is low when compared to the other traditional systems for accurate prediction of the stock market.

S&P 500 Stock Price Prediction Using Technical, Fundamental and Text Data

How to Make Machine Select Stocks Like Fund Managers? Use Scoring and Screening Model

Forecasting relative returns for S&P 500 stocks using machine learning

Predict financial text sentiment: an empirical examination

Forecasting with Deep Learning: S&P 500 index

A Real Data-Driven Analytical Model to Predict Information Technology Sector Index Price of S&P 500

Forecasting Stock Market Trends of S&P 500 based on Fractal Theory and Polynomial Regression Model

Stock market index prediction based on market trend using LSTM

Evaluating and understanding text-based stock price prediction models

Stock price movement prediction based on Stocktwits investor sentiment using FinBERT and ensemble SVM

Stock Price Prediction using Technical Indicators: A Predictive Model using Optimal Deep Learning

Optimized long short-term memory-based stock price prediction with sentiment score

A stock price prediction method based on deep learning technology

Deep-learning-based stock market prediction incorporating ESG sentiment and technical indicators

Stock Market Prediction from Sentiment and Financial Stock Data Using Machine Learning

Feature Learning for Stock Price Prediction Shows a Significant Role of Analyst Rating

A Robust Predictive Model for Stock Price Prediction Using Deep Learning and Natural Language Processing

Prediction of stock price direction using the LASSO-LSTM model combines technical indicators and financial sentiment analysis

Stock Price Prediction Research—Machine Learning Model Evaluation

Incorporating Multi-Source Market Sentiment and Price Data for Stock Price Prediction

Stock market prediction with political data Analysis (SP-PDA) model for handling big data