Abstract:Recent advances in language modelling has significantly decreased the need of labelled data in text classification tasks. Transformer-based models, pre-trained on unlabeled data, can outmatch the performance of models trained from scratch for each task. However, the amount of labelled data need to fine-tune such type of model is still considerably high for domains requiring expert-level annotators, like the legal domain. This paper investigates the best strategies for optimizing the use of a small labeled dataset and large amounts of unlabeled data and perform a classification task in the legal area with 50 predefined topics. More specifically, we use the records of demands to a Brazilian Public Prosecutor's Office aiming to assign the descriptions in one of the subjects, which currently demands deep legal knowledge for manual filling. The task of optimizing the performance of classifiers in this scenario is especially challenging, given the low amount of resources available regarding the Portuguese language, especially in the legal domain. Our results demonstrate that classic supervised models such as logistic regression and SVM and the ensembles random forest and gradient boosting achieve better performance along with embeddings extracted with word2vec when compared to BERT language model. The latter demonstrates superior performance in association with the architecture of the model itself as a classifier, having surpassed all previous models in that regard. The best result was obtained with Unsupervised Data Augmentation (UDA), which jointly uses BERT, data augmentation, and strategies of semi-supervised learning, with an accuracy of 80.7% in the aforementioned task.

Performance evaluation of Latent Dirichlet Allocation on legal documents

Optimizing Text Clustering Efficiency through Flexible Latent Dirichlet Allocation Method: Exploring the Impact of Data Features and Threshold Modification

Search and classify topics in a corpus of text using the latent dirichlet allocation model

Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey

Latent Dirichlet allocation (LDA) for topic modeling of the CFPB consumer complaints

LDAExplore: Visualizing Topic Models Generated Using Latent Dirichlet Allocation

Unveiling Themes in Judicial Proceedings: A Cross-Country Study Using Topic Modeling on Legal Documents from India and the UK

A Spectral Algorithm for Latent Dirichlet Allocation

A Small Claims Court for the NLP: Judging Legal Text Classification Strategies With Small Datasets

Content analysis of e-petitions with topic modeling: How to train and evaluate LDA models?

Dirichlet Mixture Allocation for Multiclass Document Collections Modeling

SAP-sLDA: An Interpretable Interface for Exploring Unstructured Text

An analysis of Disaster Risk Suggestions using Latent Dirichlet Allocation and Hierarchical Dirichlet Process (Nonparametric LDA)

Web Text Classification based on LDA Model

LSA & LDA topic modeling classification: comparison study on e-books

Prior-Based Dual Additive Latent Dirichlet Allocation for User-Item Connected Documents.

Topic Modeling based Consumer behavior analysis using Latent Dirichlet Allocation

Expansive data, extensive model: Investigating discussion topics around LLM through unsupervised machine learning in academic papers and news

Hybrid Deep Learning for Legal Text Analysis: Predicting Punishment Durations in Indonesian Court Rulings

Probabilistic Word Selection Via Topic Modeling

Topic Modeling on Online News.Portal Using Latent Dirichlet Allocation (LDA)