Abstract:Predicting the directions of financial markets has been performed using a variety of approaches, and the large volume of unstructured data generated by traders and other stakeholders on social media microblog platforms provides unique opportunities for analyzing financial markets using additional perspectives. Pretrained large language models (LLMs) have demonstrated very good performance on a variety of sentiment analysis tasks in different domains. However, it is known that sentiment analysis is a very domain-dependent NLP task that requires knowledge of the domain ontology, and this is particularly the case with the financial domain, which uses its own unique vocabulary. Recent developments in NLP and deep learning including LLMs have made it possible to generate actionable financial sentiments using multiple sources including financial news, company fundamentals, technical indicators, as well social media microblogs posted on platforms such as StockTwits and X (formerly Twitter). We developed a financial social media sentiment analyzer (FinSoSent), which is a domain-specific large language model for the financial domain that was pretrained on financial news articles and fine-tuned and tested using several financial social media corpora. We conducted a large number of experiments using different learning rates, epochs, and batch sizes to yield the best performing model. Our model outperforms current state-of-the-art FSA models based on over 860 experiments, demonstrating the efficacy and effectiveness of FinSoSent. We also conducted experiments using ensemble models comprising FinSoSent and the other current state-of-the-art FSA models used in this research, and a slight performance improvement was obtained based on majority voting. Based on the results obtained across all models in these experiments, the significance of this study is that it highlights the fact that, despite the recent advances of LLMs, sentiment analysis even in domain-specific contexts remains a difficult research problem.

FANAL -- Financial Activity News Alerting Language Modeling Framework

Financial Sentiment Analysis on News and Reports Using Large Language Models and FinBERT

WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domain

FinBERT: A Pre-trained Financial Language Representation Model for Financial Text Mining

FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Models

Stock Movement Prediction with Financial News using Contextualized Embedding from BERT

FinLlama: Financial Sentiment Classification for Algorithmic Trading Applications

Extracting Structured Insights from Financial News: An Augmented LLM Driven Approach

Enhancing Financial Sentiment Analysis via Retrieval Augmented Large Language Models

Data-Centric Financial Large Language Models

FinSoSent: Advancing Financial Market Sentiment Analysis through Pretrained Large Language Models

FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models

Hybrid Learning to Rank for Financial Event Ranking.

Pre-trained Large Language Models for Financial Sentiment Analysis

Model-Agnostic Meta-Learning for Natural Language Understanding Tasks in Finance

CANAL -- Cyber Activity News Alerting Language Model: Empirical Approach vs. Expensive LLM

Financial News Analytics Using Fine-Tuned Llama 2 GPT Model

Fine-Tuning Gemma-7B for Enhanced Sentiment Analysis of Financial News Headlines

FETILDA: An Evaluation Framework for Effective Representations of Long Financial Documents

SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Models