A neural network to identify requests, decisions, and arguments in court rulings on custody

José Félix Muñoz-Soro,Rafael del Hoyo Alonso,Rosa Montañes,Francisco Lacueva
DOI: https://doi.org/10.1007/s10506-023-09380-9
IF: 4.1
2024-01-11
Artificial Intelligence and Law
Abstract:Court rulings are among the most important documents in all legal systems. This article describes a study in which natural language processing is used for the automatic characterization of Spanish judgments that deal with the physical custody (joint or individual) of minors. The model was trained to identify a set of elements: the type of custody requested by the plaintiff, the type of custody decided on by the court, and eight of the most commonly used arguments in this type of judgment. Two jurists independently annotated more than 3000 judgments, which were used to train a model based on transformers. The main difficulties encountered in this task were the complexity of the judicial language and the need to work with appellate court rulings that have a more complicated structure than decisions at first instance. For the complete court rulings, the F1 score of the inter-annotator agreement ranged from 0.60 to 0.86 and the Kappa index from 0.33 to 0.73. The F1 score of the agreement between the model and the annotators ranged from 0.66 to 0.93 and the Kappa index from 0.57 to 0.80. These results in which the model performance exceeds even the inter-annotator agreement show the high ability of transformers to identify abstract entities in legal texts.
computer science, artificial intelligence, interdisciplinary applications,law
What problem does this paper attempt to address?
The paper attempts to address the problem of automatic identification of requests, decisions, and arguments in court judgments in divorce or separation cases. Specifically, the authors utilize natural language processing techniques to develop a neural network-based model aimed at automatically extracting the following information from Spanish court judgments regarding child custody (sole or joint): 1. **Type of custody requested by the plaintiff**: Whether the plaintiff is requesting sole custody or joint custody. 2. **Type of custody decided by the court**: Whether the court ultimately rules for sole custody or joint custody. 3. **Eight common arguments used in the judgments**: These arguments include the best interests of the child principle, the child's situation, the child's rootedness in a particular area, the child's opinion on custody, the relationship between the parents, the time and material conditions parents dedicate to the child, the parents' prior involvement with the child, and expert opinions in psychosocial reports. By automatically identifying this information, the researchers hope to answer questions such as "What is the frequency with which the court agrees with the plaintiff's requested custody arrangement?", "Is there a difference in this agreement rate when sole custody is requested versus joint custody?", and "What is the frequency with which specific arguments are used to support sole custody or joint custody?" This not only aids in the research of legal sociology but also provides data support for policymakers, helping them monitor the effectiveness of the law.