Toward a new language of legal drafting

Matthew Roach

DOI: https://doi.org/10.48550/arXiv.1507.05081

2015-07-01

Computers and Society

Abstract:Lawyers should write in document markup language just like web developers, digital publishers, scientists, and almost everyone else

What problem does this paper attempt to address?

Even laypeople use legalese

Eric Martínez,Francis Mollica,Edward Gibson

DOI: https://doi.org/10.1073/pnas.2405564121

2024-08-27

Abstract:Whereas principles of communicative efficiency and legal doctrine dictate that laws be comprehensible to the common world, empirical evidence suggests legal documents are largely incomprehensible to lawyers and laypeople alike. Here, a corpus analysis (n = 59) million words) first replicated and extended prior work revealing laws to contain strikingly higher rates of complex syntactic structures relative to six baseline genres of English. Next, two preregistered text generation experiments (n = 286) tested two leading hypotheses regarding how these complex structures enter into legal documents in the first place. In line with the magic spell hypothesis, we found people tasked with writing official laws wrote in a more convoluted manner than when tasked with writing unofficial legal texts of equivalent conceptual complexity. Contrary to the copy-and-edit hypothesis, we did not find evidence that people editing a legal document wrote in a more convoluted manner than when writing the same document from scratch. From a cognitive perspective, these results suggest law to be a rare exception to the general tendency in human language toward communicative efficiency. In particular, these findings indicate law's complexity to be derived from its performativity, whereby low-frequency structures may be inserted to signal law's authoritative, world-state-altering nature, at the cost of increased processing demands on readers. From a law and policy perspective, these results suggest that the tension between the ubiquity and impenetrability of the law is not an inherent one, and that laws can be simplified without a loss or distortion of communicative content.
A Software Tool for Legal Drafting

Daniel Gorín,Sergio Mera,Fernando Schapachnik

DOI: https://doi.org/10.48550/arXiv.1109.2658

2011-09-13

Computers and Society

Abstract:Although many attempts at automated aids for legal drafting have been made, they were based on the construction of a new tool, completely from scratch. This is at least curious, considering that a strong parallelism can be established between a normative document and a software specification: both describe what an entity should or should not do, can or cannot do. In this article we compare normative documents and software specifications to find out their similarities and differences. The comparison shows that there are distinctive particularities, but they are restricted to a very specific subclass of normative propositions. The rest, we postulate, can be dealt with software tools. For such an enterprise the \FormaLex tool set was devised: an LTL-based language and companion tools that utilize model checking to find out normative incoherences in regulations, contracts and other legal documents. A feature-rich case study is analyzed with the presented tools.
It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human

Jakub Harasta,Tereza Novotná,Jaromir Savelka

2024-10-10

Abstract:Large Language Models (LLMs) enable a future in which certain types of legal documents may be generated automatically. This has a great potential to streamline legal processes, lower the cost of legal services, and dramatically increase access to justice. While many researchers focus on proposing and evaluating LLM-based applications supporting tasks in the legal domain, there is a notable lack of investigations into how legal professionals perceive content if they believe an LLM has generated it. Yet, this is a critical point as over-reliance or unfounded scepticism may influence whether such documents bring about appropriate legal consequences. This study is the necessary analysis of the ongoing transition towards mature generative AI systems. Specifically, we examined whether the perception of legal documents' by lawyers and law students (n=75) varies based on their assumed origin (human-crafted vs AI-generated). The participants evaluated the documents, focusing on their correctness and language quality. Our analysis revealed a clear preference for documents perceived as crafted by a human over those believed to be generated by AI. At the same time, most participants expect the future in which documents will be generated automatically. These findings could be leveraged by legal practitioners, policymakers, and legislators to implement and adopt legal document generation technology responsibly and to fuel the necessary discussions on how legal processes should be updated to reflect recent technological developments.

Human-Computer Interaction,Artificial Intelligence,Computers and Society
Functional Approach to Training Translators for Legal Academic Writings

Le Cheng,Mingyu Gong

2014-01-01

Abstract:The paper explores problems in translated legal academic writings and discusses solutions for a better quality of translation in legal academic writings by taking translated legal academic papers published on China Legal Science (English Edition) as subjects. There are two fundamental reasons which may account for most problems identified in this study: 1) there are some different linguistic features of English and Chinese that make literal translation unsatisfactory; and 2) there are some personal language habits that result in substandard wordings in terms of academic writing and legal language. This article, while offering suggestions for unified standards of Chinese-to-English translation in legal academic writings, aims to provide a training framework for translators from the perspective of functional approach on the basis of the identified problems. The paper also argues that functional approaches can merit legal translation and has pedagogical implications for translation training.
Words or code first? Is the legacy document or a code statement the better starting point for complexity-reducing legal automation?

Oliver R. Goodenough,Preston J. Carlson

DOI: https://doi.org/10.1098/rsta.2023.0160

2024-02-26

Abstract:Law is a critical tool that humans have created to assist them in managing complex social interactions. Computational Law holds the potential to significantly enhance our capacity to express and manage legal complexity, and a number of advantages can result from restating public and private legal rules in computable form. Capturing that potential depends in part on the approaches taken to automation. One set of choices involves whether to translate directly into code from existing natural language statements of laws, regulations and contracts or whether to step back, envision the basic structure underlying those statements and build a software approach that reflects that structure in a code-native manner. We argue that many advantages can flow from the second approach, and we present a specific use case of a simplified insurance policy as an example of this approach. Large language models may assist in this process, but are not yet a replacement for a code-native utility. This article is part of the theme issue ‘A complexity science approach to law and governance’.

multidisciplinary sciences
Magic Markup: Maintaining Document-External Markup with an LLM

Edward Misback,Zachary Tatlock,Steven L. Tanimoto

2024-03-06

Abstract:Text documents, including programs, typically have human-readable semantic structure. Historically, programmatic access to these semantics has required explicit in-document tagging. Especially in systems where the text has an execution semantics, this means it is an opt-in feature that is hard to support properly. Today, language models offer a new method: metadata can be bound to entities in changing text using a model's human-like understanding of semantics, with no requirements on the document structure. This method expands the applications of document annotation, a fundamental operation in program writing, debugging, maintenance, and presentation. We contribute a system that employs an intelligent agent to re-tag modified programs, enabling rich annotations to automatically follow code as it evolves. We also contribute a formal problem definition, an empirical synthetic benchmark suite, and our benchmark generator. Our system achieves an accuracy of 90% on our benchmarks and can replace a document's tags in parallel at a rate of 5 seconds per tag. While there remains significant room for improvement, we find performance reliable enough to justify further exploration of applications.

Computation and Language
Programming Languages and Law: A Research Agenda

James Grimmelmann

DOI: https://doi.org/10.48550/arXiv.2206.14879

2022-06-30

Abstract:If code is law, then the language of law is a programming language. Lawyers and legal scholars can learn about law by studying programming-language theory, and programming-language tools can be usefully applied to legal problems. This article surveys the history of research on programming languages and law and presents ten promising avenues for future efforts. Its goals are to explain how the combination of programming languages and law is distinctive within the broader field of computer science and law, and to demonstrate with concrete examples the remarkable power of programming-language concepts in this new domain.

Programming Languages
A View of How Language Models Will Transform Law

Frank Fagan

DOI: https://doi.org/10.48550/arXiv.2405.07826

2024-05-13

Abstract:While most commentators have focused exclusively on how LLMs will transform day-to-day law practice, a substantial structural change could be afoot within the legal sector as a whole. Large increases in productivity and attendant cost savings could encourage law firms and corporate legal departments to develop large language models in-house. A ten percent increase in attorney productivity would encourage an average sized 'Big Law' firm to reduce its associate headcount by 300 to 400 lawyers. This represents cost savings of 60 to 120 million dollars - more than enough to pay for the development of a specialized LLM. Eventually, LLMs will push lawyers into highly specialized and nuanced roles. After fully mature LLMs arrive, the lawyer will continue to play a central role in legal practice, but only in non-routine legal tasks. These tasks will primarily involve value judgments, such as the development of precedent or its reversal, or the allocation of property and other scarce resources. This new mix of lawyer-machine labor, where machines primarily carry out routine legal tasks, and lawyers handle the non-routine, will give rise to a growing demand for lawyers who can exercise good judgment and empathize with the winners and losers of social change. Overall, the Article suggests a possible future where there are fewer lawyers and greater consolidation of the legal sector.

Computers and Society
Mediating Modes of Thought: LLM's for design scripting

Moritz Rietschel,Fang Guo,Kyle Steinfeld

2024-11-20

Abstract:Here is an updated version of your abstract, cleaned for submission to arXiv with potential "bad characters" corrected to conform to ASCII standards: Architects adopt visual scripting and parametric design tools to explore more expansive design spaces (Coates, 2010), refine their thinking about the geometric logic of their design (Woodbury, 2010), and overcome conventional software limitations (Burry, 2011). Despite two decades of effort to make design scripting more accessible, a disconnect between a designer's free ways of thinking and the rigidity of algorithms remains (Burry, 2011). Recent developments in Large Language Models (LLMs) suggest this might soon change, as LLMs encode a general understanding of human context and exhibit the capacity to produce geometric logic. This project speculates that if LLMs can effectively mediate between user intent and algorithms, they become a powerful tool to make scripting in design more widespread and fun. We explore if such systems can interpret natural language prompts to assemble geometric operations relevant to computational design scripting. In the system, multiple layers of LLM agents are configured with specific context to infer the user intent and construct a sequential logic. Given a user's high-level text prompt, a geometric description is created, distilled into a sequence of logic operations, and mapped to software-specific commands. The completed script is constructed in the user's visual programming interface. The system succeeds in generating complete visual scripts up to a certain complexity but fails beyond this complexity threshold. It shows how LLMs can make design scripting much more aligned with human creativity and thought. Future research should explore conversational interactions, expand to multimodal inputs and outputs, and assess the performance of these tools.

Computation and Language,Artificial Intelligence,Human-Computer Interaction
Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

Chun-Hsien Lin,Pu-Jen Cheng

2024-06-07

Abstract:With the development of large-scale Language Models (LLM), fine-tuning pre-trained LLM has become a mainstream paradigm for solving downstream tasks of natural language processing. However, training a language model in the legal field requires a large number of legal documents so that the language model can learn legal terminology and the particularity of the format of legal documents. The typical NLP approaches usually rely on many manually annotated data sets for training. However, in the legal field application, it is difficult to obtain a large number of manually annotated data sets, which restricts the typical method applied to the task of drafting legal documents. The experimental results of this paper show that not only can we leverage a large number of annotation-free legal documents without Chinese word segmentation to fine-tune a large-scale language model, but more importantly, it can fine-tune a pre-trained LLM on the local computer to achieve the generating legal document drafts task, and at the same time achieve the protection of information privacy and to improve information security issues.

Computation and Language,Artificial Intelligence
Weaving Pathways for Justice with GPT: LLM-driven automated drafting of interactive legal applications

Quinten Steenhuis,David Colarusso,Bryce Willey

2023-12-15

Abstract:Can generative AI help us speed up the authoring of tools to help self-represented litigants? In this paper, we describe 3 approaches to automating the completion of court forms: a generative AI approach that uses GPT-3 to iteratively prompt the user to answer questions, a constrained template-driven approach that uses GPT-4-turbo to generate a draft of questions that are subject to human review, and a hybrid method. We use the open source Docassemble platform in all 3 experiments, together with a tool created at Suffolk University Law School called the Assembly Line Weaver. We conclude that the hybrid model of constrained automated drafting with human review is best suited to the task of authoring guided interviews.

Artificial Intelligence,Computer Vision and Pattern Recognition,Computers and Society,Human-Computer Interaction,Social and Information Networks
The Law and NLP: Bridging Disciplinary Disconnects

Robert Mahari,Dominik Stammbach,Elliott Ash,Alex 'Sandy' Pentland

DOI: https://doi.org/10.48550/arXiv.2310.14346

2023-10-22

Computation and Language

Abstract:Legal practice is intrinsically rooted in the fabric of language, yet legal practitioners and scholars have been slow to adopt tools from natural language processing (NLP). At the same time, the legal system is experiencing an access to justice crisis, which could be partially alleviated with NLP. In this position paper, we argue that the slow uptake of NLP in legal practice is exacerbated by a disconnect between the needs of the legal community and the focus of NLP researchers. In a review of recent trends in the legal NLP literature, we find limited overlap between the legal NLP community and legal academia. Our interpretation is that some of the most popular legal NLP tasks fail to address the needs of legal practitioners. We discuss examples of legal NLP tasks that promise to bridge disciplinary disconnects and highlight interesting areas for legal NLP research that remain underexplored.
Large-Scale Collaborative Writing: Technical Challenges and Recommendations

Markus Hofbauer,Christoph Bachhuber,Christopher Kuhn,Sebastian Schwarz,Bart Kroon,Eckehard Steinbach

2023-03-17

Abstract:Collaborative writing is essential for teams that create documents together. Creating documents in large-scale collaborations is a challenging task that requires an efficient workflow. The design of such a workflow has received comparatively little attention. Conventional solutions such as working on a single Microsoft Word document or a shared online document are still widely used. In this paper, we propose a new workflow consisting of a combination of the lightweight markup language AsciiDoc together with the state-of-the-art version control system Git. The proposed process makes use of well-established workflows in the field of software development that have grown over decades. We present a detailed comparison of the proposed markup + Git workflow to Word and Word for the Web as the most prominent examples for conventional approaches.We argue that the proposed approach provides significant benefits regarding scalability, flexibility, and structuring of most collaborative writing tasks, both in academia and industry.

Human-Computer Interaction
Deconstructing Legal Text_Object Oriented Design in Legal Adjudication

Megan Ma,Dmitriy Podkopaev,Avalon Campbell-Cousins,Adam Nicholas

DOI: https://doi.org/10.48550/arXiv.2009.06054

2020-09-13

Information Retrieval

Abstract:Rules are pervasive in the law. In the context of computer engineering, the translation of legal text to algorithmic form is seemingly direct. In large part, law may be a ripe field for expert systems and machine learning. For engineers, existing law appears formulaic and logically reducible to "if, then" statements. The underlying assumption is that the legal language is both self-referential and universal. Moreover, description is considered distinct from interpretation; that in describing the law, the language is seen as quantitative and objectifiable. Nevertheless, is descriptive formal language purely dissociative? From the logic machine of the 1970s to the modern fervor for artificial intelligence (AI), governance by numbers is making a persuasive return. Could translation be possible? The project follows a fundamentally semantic conundrum: what is the significance of "meaning" in legal language? The project, therefore, tests translation by deconstructing sentences from existing legal judgments to their constituent factors. Definitions are then extracted in accordance with the interpretations of the judges. The intent is to build an expert system predicated on alleged rules of legal reasoning. The authors apply both linguistic modelling and natural language processing technology to parse the legal judgments. The project extends beyond prior research in the area, combining a broadly statistical model of context with the relative precision of syntactic structure. The preliminary hypothesis is that, by analyzing the components of legal language with a variety of techniques, we can begin to translate law to numerical form.
Language and the Law Revisited: An Intellectual History of Contractual Interpretation

Gerard McMeel

DOI: https://doi.org/10.1350/clwr.2005.34.3.256

2005-07-01

Common Law World Review

Abstract:Lawyers, like other human beings, are users of language. A facility with words is a desirable attribute for a good lawyer. On the negative side, lawyers attract both distrust and derision for their supposed abuses of ordinary language, such as the deployment of arcane terms, over-elaborate syntax and gobbledegook. The areas in which issues arising from the drafting and interpretation of legal language have attracted most attention to date are the fields of constitutional and statutory law. This is unsurprising given that such documents govern the exercise of significant social and political power. In contrast, this paper addresses issues of construction in private law, and in particular, contractual interpretation. Ascertaining the meaning of the language deployed by contracting parties constitutes a large proportion of the business of courts and tribunals dealing with commercial disputes. It is tempting to see this as a problem inherent to language due to its flexibility and vagueness, or else to detect a link with the supposed nit-picking mentality of lawyers, always keen to identify an unintended ambiguity in words or loophole in documentation. In practice though, most disputes which have to be resolved by resorting to interpretation are not problems about the meanings of words or ones which require familiarity with grammatical niceties. Rather, they are problems about the application of the language of a contract to the (perhaps unexpected) events which have subsequently transpired. As such they represent an unavoidable source of potential dispute.

English Else
Aperture synthesis for gravitational-wave data analysis: Deterministic Sources

Lee Samuel Finn

DOI: https://doi.org/10.1103/PhysRevD.63.102001

2000-10-10

Abstract:Gravitational wave detectors now under construction are sensitive to the phase of the incident gravitational waves. Correspondingly, the signals from the different detectors can be combined, in the analysis, to simulate a single detector of greater amplitude and directional sensitivity: in short, aperture synthesis. Here we consider the problem of aperture synthesis in the special case of a search for a source whose waveform is known in detail: \textit{e.g.,} compact binary inspiral. We derive the likelihood function for joint output of several detectors as a function of the parameters that describe the signal and find the optimal matched filter for the detection of the known signal. Our results allow for the presence of noise that is correlated between the several detectors. While their derivation is specialized to the case of Gaussian noise we show that the results obtained are, in fact, appropriate in a well-defined, information-theoretic sense even when the noise is non-Gaussian in character. The analysis described here stands in distinction to ``coincidence analyses'', wherein the data from each of several detectors is studied in isolation to produce a list of candidate events, which are then compared to search for coincidences that might indicate common origin in a gravitational wave signal. We compare these two analyses --- optimal filtering and coincidence --- in a series of numerical examples, showing that the optimal filtering analysis always yields a greater detection efficiency for given false alarm rate, even when the detector noise is strongly non-Gaussian.

General Relativity and Quantum Cosmology
Teaching Transformed

Chris Edwards

DOI: https://doi.org/10.1145/3637208

IF: 22.7

2024-01-25

Communications of the ACM

Abstract:The apparent ability of LLMs to write functioning source code has caused celebration over the potential for massive increases in programmer productivity and consternation among teachers.

computer science, theory & methods, software engineering, hardware & architecture
Caveat Lector: Large Language Models in Legal Practice

Eliza Mik

2024-03-14

Abstract:The current fascination with large language models, or LLMs, derives from the fact that many users lack the expertise to evaluate the quality of the generated text. LLMs may therefore appear more capable than they actually are. The dangerous combination of fluency and superficial plausibility leads to the temptation to trust the generated text and creates the risk of overreliance. Who would not trust perfect legalese? Relying recent findings in both technical and legal scholarship, this Article counterbalances the overly optimistic predictions as to the role of LLMs in legal practice. Integrating LLMs into legal workstreams without a better comprehension of their limitations, will create inefficiencies if not outright risks. Notwithstanding their unprecedented ability to generate text, LLMs do not understand text. Without the ability to understand meaning, LLMs will remain unable to use language, to acquire knowledge and to perform complex reasoning tasks. Trained to model language on the basis of stochastic word predictions, LLMs cannot distinguish fact from fiction. Their knowledge of the law is limited to word strings memorized in their parameters. It is also incomplete and largely incorrect. LLMs operate at the level of word distributions, not at the level of verified facts. The resulting propensity to hallucinate, to produce statements that are incorrect but appear helpful and relevant, is alarming in high-risk areas like legal services. At present, lawyers should beware of relying on text generated by LLMs.

Computation and Language,Computers and Society
So much for plain language: An analysis of the accessibility of U.S. federal laws over time.

Eric Martínez,Francis Mollica,Edward Gibson

DOI: https://doi.org/10.1037/xge0001572

2024-04-24

Journal of Experimental Psychology General

Abstract:Over the last 50 years, there have been efforts on behalf of the U.S. government to simplify legal documents for society at large. However, there has been no systematic evaluation of how effective these efforts—collectively referred to as the "plain-language movement"—have been. Here we report the results of a large-scale longitudinal corpus analysis (n ≈ 225 million words), in which we compared every law passed by congress with a comparably sized sample of English texts from four different baseline genres published during approximately the same time period. We also compared the entirety of the U.S. Code (the official compilation of all federal legislation currently in force) with a large sample of recently published texts from six baseline genres of English. We found that laws remain laden with features associated with psycholinguistic complexity—including center-embedding, passive voice, low-frequency jargon, capitalization, and sentence length—relative to the baseline genres of English, and that the prevalence of most of these features has not meaningfully declined since the initial onset of the plain-language efforts. These findings suggest top-down efforts to simplify legal texts have thus far remained largely ineffectual, despite the apparent tractability of these changes, and call into question the coherence and legitimacy of legal doctrines whose validity rests on the notion of laws being easily interpretable by laypeople. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, experimental
Compiler Design for Legal Document Translation in Digital Government

Youssef Bassil

DOI: https://doi.org/10.48550/arXiv.1907.05873

2019-05-24

Programming Languages

Abstract:One of the main purposes of a computer is automation. In fact, automation is the technology by which a manual task is performed with minimum or zero human assistance. Over the years, automation has proved to reduce operation cost and maintenance time in addition to increase system productivity, reliability, and performance. Today, most computerized automation are done by a computer program which is a set of instructions executed from within the computer memory by the computer central processing unit to control the computers various operations. This paper proposes a compiler program that automates the validation and translation of input documents written in the Arabic language into XML output files that can be read by a computer. The input document is by nature unstructured and in plain-text as it is written by people manually; while, the generated output is a structured machine-readable XML file. The proposed compiler program is actually a part of a bigger project related to digital government and is meant to automate the processing and archiving of juridical data and documents. In essence, the proposed compiler program is composed of a scanner, a parser, and a code generator. Experiments showed that such automation practices could prove to be a starting point for a future digital government platform for the Lebanese government. As further research, other types of juridical documents are to be investigated, mainly those that require error detection and correction.

Toward a new language of legal drafting

Even laypeople use legalese

A Software Tool for Legal Drafting

It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human

Functional Approach to Training Translators for Legal Academic Writings

Words or code first? Is the legacy document or a code statement the better starting point for complexity-reducing legal automation?

Magic Markup: Maintaining Document-External Markup with an LLM

Programming Languages and Law: A Research Agenda

A View of How Language Models Will Transform Law

Mediating Modes of Thought: LLM's for design scripting

Legal Documents Drafting with Fine-Tuned Pre-Trained Large Language Model

Weaving Pathways for Justice with GPT: LLM-driven automated drafting of interactive legal applications

The Law and NLP: Bridging Disciplinary Disconnects

Large-Scale Collaborative Writing: Technical Challenges and Recommendations

Deconstructing Legal Text_Object Oriented Design in Legal Adjudication

Language and the Law Revisited: An Intellectual History of Contractual Interpretation

Aperture synthesis for gravitational-wave data analysis: Deterministic Sources

Teaching Transformed

Caveat Lector: Large Language Models in Legal Practice

So much for plain language: An analysis of the accessibility of U.S. federal laws over time.

Compiler Design for Legal Document Translation in Digital Government