Evaluation of Judicial Imprisonment Term Prediction Model Based on Text Mutation

Shu Zhang,Ge Yan,Yu Li,Jia Liu
DOI: https://doi.org/10.1109/QRS-C.2019.00025
2019-01-01
Abstract:In recent years, artificial intelligence has witnessed great advancement, and its application in the legal field has experienced more than 60 years. The use of "machine learning" technology to aid the decision-making of legal intelligence systems is no longer far away. However, no comprehensive evaluation methods for predictive models of judicial cases can be found. The performance of the machine learning prediction model not only related to the accuracy but also should be measured in many different aspects. Mutation is a common means of traditional software testing, which can be borrowed in the evaluating of prediction models. This paper introduces the text mutation method, to evaluate the robustness of the judicial case prediction model. The following three evaluation methods are adopted: Classification preference test, Word order variation test and Noise variation test. This paper applies the proposed evaluation method to the judicial imprisonment term prediction model. We use the fastText, TextCNN, and Multi-layer LSTM models. Using the proposed evaluation method to test the above prediction model, and evaluate the robustness of the judicial case prediction model in different aspects.
What problem does this paper attempt to address?