Abstract: Legal Judgment Prediction (LJP), aiming to predict a judgment based on fact descriptions according to rule of law, serves as legal assistance to mitigate the great work burden of limited legal practitioners. Most existing methods apply various large-scale pre-trained language models (PLMs) finetuned in LJP tasks to obtain consistent improvements. However, we discover the fact that the state-of-the-art (SOTA) model makes judgment predictions according to irrelevant (or non-casual) information. The violation of rule of law not only weakens the robustness and generalization ability of models but also results in severe social problems like discrimination. In this paper, we use causal structural models (SCMs) to theoretically analyze how LJP models learn to make decisions and why they can succeed in passing the traditional testing paradigm without learning causality. According to our analysis, we provide two solutions intervening on data and model by causality, respectively. In detail, we first distinguish non-causal information by applying the open information extraction (OIE) technique. Then, we propose a method named the Causal Information Enhanced SAmpling Method (CIESAM) to eliminate the non-causal information from data. To validate our theoretical analysis, we further propose another method using our proposed Causality-Aware Self-Attention Mechanism (CASAM) to guide the model to learn the underlying causality knowledge in legal texts. The confidence of CASAM in learning causal information is higher than that of CIESAM. The extensive experimental results show that both our proposed methods achieve state-of-the-art (SOTA) performance on three commonly used legal-specific datasets. The stronger performance of CASAM further demonstrates that causality is the key to the robustness and generalization ability of models.

Problems and Effective Countermeasures in Joint and Several Liability of Civil and Commercial Law Based on Deep Learning Assessment

Risk assessment for commercial crime and legal protection based on modularity-optimized LM and SCA-optimized CNN

Automatically Classify Chinese Judgment Documents Utilizing Machine Learning Algorithms

Optimizing Numerical Estimation and Operational Efficiency in the Legal Domain through Large Language Models

Legal Judgment Prediction with Multiple Perspectives on Civil Cases

A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction

Research on a Decision Prediction Method Based on Causal Inference and a Multi-Expert FTOPJUDGE Mechanism

Exploiting Contrastive Learning and Numerical Evidence for Confusing Legal Judgment Prediction

Study on Judicial Data Classification Method Based on Natural Language Processing Technologies

Enhancing Criminal Case Matching through Diverse Legal Factors

Legal judgment prediction via optimized multi-task learning fusing similarity correlation

LexEval: A Comprehensive Chinese Legal Benchmark for Evaluating Large Language Models

MVE-FLK: A multi-task legal judgment prediction via multi-view encoder fusing legal keywords

Automatically Classifying Chinese Judgment Documents Using Character-Level Convolutional Neural Networks

Topology-aware Multi-task Learning Framework for Civil Case Judgment Prediction

MANN: A Multichannel Attentive Neural Network for Legal Judgment Prediction

AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation

Exploration of Deep-Learning-Based Approaches for False Fact Identification in Social Judicial Systems

HD-LJP: A Hierarchical Dependency-based Legal Judgment Prediction Framework for multi-task learning

LawLLM: Law Large Language Model for the US Legal System

Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust