Fine-Tuning Gemma-7B for Enhanced Sentiment Analysis of Financial News Headlines

Kangtong Mo,Wenyan Liu,Xuanzhen Xu,Chang Yu,Yuelin Zou,Fangqing Xia

2024-06-19

Abstract:In this study, we explore the application of sentiment analysis on financial news headlines to understand investor sentiment. By leveraging Natural Language Processing (NLP) and Large Language Models (LLM), we analyze sentiment from the perspective of retail investors. The FinancialPhraseBank dataset, which contains categorized sentiments of financial news headlines, serves as the basis for our analysis. We fine-tuned several models, including distilbert-base-uncased, Llama, and gemma-7b, to evaluate their effectiveness in sentiment classification. Our experiments demonstrate that the fine-tuned gemma-7b model outperforms others, achieving the highest precision, recall, and F1 score. Specifically, the gemma-7b model showed significant improvements in accuracy after fine-tuning, indicating its robustness in capturing the nuances of financial sentiment. This model can be instrumental in providing market insights, risk management, and aiding investment decisions by accurately predicting the sentiment of financial news. The results highlight the potential of advanced LLMs in transforming how we analyze and interpret financial information, offering a powerful tool for stakeholders in the financial industry.

Computation and Language,Artificial Intelligence

What problem does this paper attempt to address?

This paper aims to address the issue of sentiment analysis of financial news headlines to understand investor sentiment. Specifically, the researchers analyze sentiment from the perspective of retail investors by leveraging Natural Language Processing (NLP) techniques and Large Language Models (LLM). They used the FinancialPhraseBank dataset, which contains categorized sentiment labels of financial news headlines. The researchers fine-tuned multiple models, including distilbert-base-uncased, Llama, and gemma-7b, to evaluate their performance on sentiment classification tasks. Experimental results indicate that the fine-tuned gemma-7b model performs best in terms of precision, recall, and F1 score, demonstrating its robustness in capturing the nuances of financial sentiment. This model can provide strong support for financial market insights, risk management, and investment decision-making by accurately predicting the sentiment of financial news. The findings highlight the potential of advanced LLMs in analyzing and interpreting financial information, offering powerful tools for the financial industry.