Abstract:Abstract This study tries to unravel the stock market prediction puzzle using the textual analytic with the help of natural language processing (NLP) techniques and Deep-learning recurrent model called long short term memory (LSTM). Instead of using count-based traditional sentiment index methods, the study uses its own sum and relevance based sentiment index mechanism. Hourly price data has been used in this research as daily data is too late and minutes data is too early for getting the exclusive effect of sentiments. Normally, hourly data is extremely costly and difficult to manage and analyze. Hourly data has been rarely used in similar kinds of researches. To built sentiment index, text analytic information has been parsed and analyzed, textual information that is relevant to selected stocks has been collected, aggregated, categorized, and refined with NLP and eventually converted scientifically into hourly sentiment index. News analytic sources include mainstream media, print media, social media, news feeds, blogs, investors’ advisory portals, experts’ opinions, brokers updates, web-based information, company’ internal news and public announcements regarding policies and reforms. The results of the study indicate that sentiments significantly influence the direction of stocks, on average after 3–4 h. Top ten companies from High-tech, financial, medical, automobile sectors are selected, and six LSTM models, three for using text-analytic and other without analytic are used. Every model includes 1, 3, and 6 h steps back. For all sectors, a 6-hour steps based model outperforms the other models due to LSTM specialty of keeping long term memory. Collective accuracy of textual analytic models is way higher relative to non-textual analytic models.

Forecasting Macroeconomic Tail Risk in Real Time: Do Textual Data Add Value?

Developing Spatio-Temporal Approach to Predict Economic Dynamics Based on Online News

Macroeconomic forecasting through news, emotions and narrative

Words or Numbers? Macroeconomic Nowcasting with Textual and Macroeconomic Data

Forecasting Inflation Using Economic Narratives

Forecasting with Economic News

News-based forecasts of macroeconomic indicators: A semantic path model for interpretable predictions

Exploiting News Analytics for Volatility Forecasting

Forecasting Inflation with Economic Narratives and Machine Learning

Macroeconomic Uncertainty and Quantitative versus Qualitative Inputs to Analyst Risk Forecasts

Exploring the Predictive Power of News and Neural Machine Learning Models for Economic Forecasting

Assessing machine learning for forecasting economic risk: Evidence from an expanded Chinese financial information set

Long-term stock index forecasting based on text mining of regulatory disclosures

Forecasting cryptocurrencies returns: Do macroeconomic and financial variables improve tail expectation predictions?

How is Machine Learning Useful for Macroeconomic Forecasting?

Social media sentiment, model uncertainty, and volatility forecasting

Forecasting GDP in Europe with Textual Data

Weak Supervision in Analysis of News: Application to Economic Policy Uncertainty

Forecasting inflation using sentiment

Is Deep-Learning and Natural Language Processing Transcending the Financial Forecasting? Investigation Through Lens of News Analytic Process