Abstract:Financial analyses of stock markets rely heavily on quantitative approaches in an attempt to predict subsequent or market movements based on historical prices and other measurable metrics. These quantitative analyses might have missed out on un-quantifiable aspects like sentiment and speculation that also impact the market. Analyzing vast amounts of qualitative text data to understand public opinion on social media platform is one approach to address this gap. This work carried out topic analysis on 28264 financial tweets [1] via clustering to discover emerging events in the stock market. Three main topics were discovered to be discussed frequently within the period. First, the financial ratio EPS is a measure that has been discussed frequently by investors. Secondly, short selling of shares were discussed heavily, it was often mentioned together with Morgan Stanley. Thirdly, oil and energy sectors were often discussed together with policy. These tweets were semantically clustered by a method consisting of word2vec algorithm to obtain word embeddings that map words to vectors. Semantic word clusters were then formed. Each tweet was then vectorized using the Term Frequency-Inverse Document Frequency (TF-IDF) values of the words it consisted of and based on which clusters its words were in. Tweet vectors were then converted to compressed representations by training a deep-autoencoder. K-means clusters were then formed. This method reduces dimensionality and produces dense vectors, in contrast to the usual Vector Space Model. Topic modelling with Latent Dirichlet Allocation (LDA) and top frequent words were used to analyze clusters and reveal emerging events.

Content Analysis and Topic Correlation of Financial News Related to Big Data Concept

Correlated industries mining for Chinese financial news based on LDA trained with research reports

Deep Learning based Topic Analysis on Financial Emerging Event Tweets

Text Content Analysis for Web Big Data

Big Social Data Analytics in Journalism and Mass Communication

Research on Methodology of Correlation Analysis of Sci-Tech Literature Based on Deep Learning Technology in the Big Data

Visualization research and analysis of academic articles on big data

Financial Big Data Analysis and Early Warning Platform: A Case Study

Content Analysis Using Specific Natural Language Processing Methods for Big Data

Bibliometric Study on Big Data Research: an Integration of Topic Model and Citation Network Analysis.

Visualization Analysis of the Achievements in International Big Data Domain

Financial Topic Modeling Based on the BERT-LDA Embedding

Bank Financial Risk Prediction Model Based on Big Data

Quantitative analysis of large amounts of journalistic texts using topic modelling

Internet Popular Topics Extraction of Traffic Content Words Correlation

Visual Content Correlation Analysis

A Survey on News Text Visualization via Probabilistic Topic Modeling

Short text classification based on LDA topic model

Topic Correlation Analysis for Cross-Domain Text Classification

LDA-Based Topic Strength Analysis

Online topic detection and tracking of financial news based on hierarchical clustering