Abstract: Legal Judgment Prediction (LJP), aiming to predict a judgment based on fact descriptions according to rule of law, serves as legal assistance to mitigate the great work burden of limited legal practitioners. Most existing methods apply various large-scale pre-trained language models (PLMs) finetuned in LJP tasks to obtain consistent improvements. However, we discover the fact that the state-of-the-art (SOTA) model makes judgment predictions according to irrelevant (or non-casual) information. The violation of rule of law not only weakens the robustness and generalization ability of models but also results in severe social problems like discrimination. In this paper, we use causal structural models (SCMs) to theoretically analyze how LJP models learn to make decisions and why they can succeed in passing the traditional testing paradigm without learning causality. According to our analysis, we provide two solutions intervening on data and model by causality, respectively. In detail, we first distinguish non-causal information by applying the open information extraction (OIE) technique. Then, we propose a method named the Causal Information Enhanced SAmpling Method (CIESAM) to eliminate the non-causal information from data. To validate our theoretical analysis, we further propose another method using our proposed Causality-Aware Self-Attention Mechanism (CASAM) to guide the model to learn the underlying causality knowledge in legal texts. The confidence of CASAM in learning causal information is higher than that of CIESAM. The extensive experimental results show that both our proposed methods achieve state-of-the-art (SOTA) performance on three commonly used legal-specific datasets. The stronger performance of CASAM further demonstrates that causality is the key to the robustness and generalization ability of models.

Everything Has a Cause: Leveraging Causal Inference in Legal Text Analysis

Knowledge is Power: Understanding Causality Makes Legal judgment Prediction Models More Generalizable and Robust

Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond

Learning Entangled Interactions of Complex Causality Via Self-Paced Contrastive Learning

Rethinking the Development of Large Language Models from the Causal Perspective: A Legal Text Prediction Case Study

From Query Tools to Causal Architects: Harnessing Large Language Models for Advanced Causal Discovery from Data

Causality is all you need

Legal Cause Prediction With Inner Descriptions And Outer Hierarchies

A Framework to Construct Financial Causality Knowledge Graph from Text

Event Causality Extraction Based on Connectives Analysis

Causal Inference Using LLM-Guided Discovery

FAIR: A Causal Framework for Accurately Inferring Judgments Reversals

LLM4Causal: Democratized Causal Tools for Everyone via Large Language Model

Document-level event causality identification via graph inference mechanism

Cause and Effect: Can Large Language Models Truly Understand Causality?

DeepCausality: A general AI-powered causal inference framework for free text: A case study of LiverTox

Counterfactual Causal Inference in Natural Language with Large Language Models

Causal Inference with Latent Variables: Recent Advances and Future Prospectives

CauseKG: A Framework Enhancing Causal Inference With Implicit Knowledge Deduced From Knowledge Graphs

Guided Generation of Cause and Effect

Uncovering Main Causalities for Long-tailed Information Extraction.