Abstract:Sentiment analysis is one of the crucial tasks of natural language processing, which includes recognizing emotions expressed in textual data from various fields of activity. Automated tonality detection impacts businesses and helps increase profits by analyzing customer sentiment and responding quickly to their level of satisfaction with products or services. Therefore, the development of tools that will allow qualitative classification of text sentiment is significant, considering that users leave many reviews on various social networks, platforms, and websites in today's world. The study examines the fine-tuning of BERT, DistilBERT, XLM-RoBERTa, and Ukr-RoBERTa models for sentiment analysis of reviews in the Ukrainian language, as transformer models demonstrate a better understanding of the context and show high efficiency in solving natural language processing tasks. The dataset used in this study comprised about 11,000 user comments in Ukrainian, covering a range of topics such as shops, restaurants, hotels, medical facilities, fitness clubs, and the provision of various services. The textual data was categorized into two classes: positive and negative. Following text preprocessing, the dataset was divided into training and test samples in an 80:20 ratio. The hyperparameters were selected to optimize the performance of the pre-trained models for comment sentiment classification, and their effectiveness was evaluated using metrics such as accuracy, recall, precision, and F1-score. The results show that DistilBERT requires significantly fewer computing resources and is faster than other models. The XLM-RoBERTa model achieved the highest accuracy of 91.32%. However, considering the time needed to train the model and all the classification metrics, Ukr-RoBERTa is the optimal choice.

RuSentNE-2023: Evaluating Entity-Oriented Sentiment Analysis on Russian News Texts

Attention-Based Neural Networks for Sentiment Attitude Extraction using Distant Supervision

RuSentiTweet: a sentiment analysis dataset of general domain tweets in Russian

Improving Results on Russian Sentiment Datasets

Sentiment Analysis in the News

HAlf-MAsked Model for Named Entity Sentiment analysis

SEntFiN 1.0: Entity-Aware Sentiment Analysis for Financial News

Large Language Models in Targeted Sentiment Analysis

Sentiment Frames for Attitude Extraction in Russian

Entity-Level Sentiment: More than the Sum of Its Parts

RuArg-2022: Argument Mining Evaluation

SemEval-2013 Task 2: Sentiment Analysis in Twitter

Quantum Criticism: A Tagged News Corpus Analysed for Sentiment and Named Entities

Does BERT look at sentiment lexicon?

Is ChatGPT a Good Sentiment Analyzer? A Preliminary Study

Sentiment analysis is not solved! Assessing and probing sentiment classification

Performance evaluation of Reddit Comments using Machine Learning and Natural Language Processing methods in Sentiment Analysis

Sentiment Analysis on Financial News Headlines using Training Dataset Augmentation

CroSentiNews 2.0: A Sentence-Level News Sentiment Corpus

RUSSE: The First Workshop on Russian Semantic Similarity

Fine-tuning BERT, DistilBERT, XLM-RoBERTa and Ukr-RoBERTa models for sentiment analysis of ukrainian language reviews