Abstract:The ability to accurately predict the stock market is a crucial financial topic. The basic assumption is that future stock returns can be somewhat predicted based on publicly available data from the past. Economic variables like interest rates and currency rates, information related to political influences, and company-specific data like statements of income and dividends are some examples of this information. Yet, attempting to forecast stock returns goes against the idea that markets are generally efficient. A prediction model has been created that leverages machine learning, big data analytics, and social media analytics to predict stock market trends regularly. The main objective of this work is to propose a novel approach for stock market prediction for handling big data. This research develops a new SP-PDA (Stock Price Prediction with Political Data Analysis) which includes preprocessing, feature extraction, and prediction. In this work, we employed three types of data (Stock data, News data and Political data). For the stock data, preprocessing was done using Z-score normalization, while tokenization and lemmatization were used for the news and political data. Next, to handle the big data, we used a Map-Reduce architecture. Here, feature extraction from preprocessed stock, news, and political data occurs in the mapper function. The reduction face yields the final extracted feature set. Commodity channel index (CCI), Chaikin Volatility (CV), and Donchian Channel (DC) are examples of technical indicator-based features that are extracted for stock data during the feature extraction phase. Mutual Information (MI), Improved Pointwise mutual information (IPMI), Term Frequency-Inverse Document Frequency (TF-IDF), and correlation features are retrieved for news and political data. Stock market prediction is based on the features extracted. To predict stock prices, we employed an ensemble classification model that incorporates classifiers such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Bidirectional Gated Recurrent Unit (Bi-GRU), Long-short term memory (LSTM), and Deep Maxout. An improved score level fusion is carried out to define the final prediction outcome from the obtained intermediate prediction results. The suggested Dwarf Mongoose Updated War Strategy-based Generalized Normal Distribution (DMUWS-based GND) Optimization Algorithm is used to optimizing the weights of ensemble classifiers. Finally, the performance of the proposed model is evaluated over existing models in terms of error measures like Mean Absolute Error (MAE), Mean Squared Error (MSE), Mean Absolute Percentage Error (MAPE) and Mean Squared Log Error (MSLE). The SP-PDA achieved the desired MAE of 0.012, which is low when compared to the other traditional systems for accurate prediction of the stock market.

Discrete Wavelet Transform-based feature engineering for stock market prediction

Wavelet decomposition-based multi-stage feature engineering and optimized ensemble classifier for stock market prediction

Discrete Wavelet Transform-Based Prediction of Stock Index: A Study on National Stock Exchange Fifty Index

A Business Intelligence Expert System for Predicting Market Price in Stock Trading using Data Analysis: Deep Learning Model With Feature Selection Mechanism

Enhanced stock market forecasting using dandelion optimization-driven 3D-CNN-GRU classification

A Hybrid Method Based on Extreme Learning Machine and Wavelet Transform Denoising for Stock Prediction

Prediction of Stock Market Price using Hybrid of Wavelet Transform and Artificial Neural Network

Stock market prediction with political data Analysis (SP-PDA) model for handling big data

Optimized Deep Learning Model Architecture for the Feature Extraction to Predict Trend in Stock Market

Stock Prediction Based on Technical Indicators Using Deep Learning Model

A deep learning integrated framework for predicting stock index price and fluctuation via singular spectrum analysis and particle swarm optimization

Stock Trend Prediction Using Candlestick Charting and Ensemble Machine Learning Techniques with a Novelty Feature Engineering Scheme

A Robust Predictive Model for Stock Price Prediction Using Deep Learning and Natural Language Processing

Deep Learning-Based Stock Market Prediction and Investment Model for Financial Management

Adaptive wavelet transform model for time series data prediction

Forecasting Directional Movement of Stock Prices using Deep Learning

Developing Hybrid Deep Learning Models for Stock Price Prediction Using Enhanced Twitter Sentiment Score and Technical Indicators

Stock Price Prediction using Technical Indicators: A Predictive Model using Optimal Deep Learning

Stock Market Prediction Using Deep Attention Bi-directional Long Short-Term Memory

A Time Series Analysis-Based Stock Price Prediction Using Machine Learning and Deep Learning Models

An Evaluation of Deep Learning Models for Stock Market Trend Prediction