Abstract:The current fascination with large language models, or LLMs, derives from the fact that many users lack the expertise to evaluate the quality of the generated text. LLMs may therefore appear more capable than they actually are. The dangerous combination of fluency and superficial plausibility leads to the temptation to trust the generated text and creates the risk of overreliance. Who would not trust perfect legalese? Relying recent findings in both technical and legal scholarship, this Article counterbalances the overly optimistic predictions as to the role of LLMs in legal practice. Integrating LLMs into legal workstreams without a better comprehension of their limitations, will create inefficiencies if not outright risks. Notwithstanding their unprecedented ability to generate text, LLMs do not understand text. Without the ability to understand meaning, LLMs will remain unable to use language, to acquire knowledge and to perform complex reasoning tasks. Trained to model language on the basis of stochastic word predictions, LLMs cannot distinguish fact from fiction. Their knowledge of the law is limited to word strings memorized in their parameters. It is also incomplete and largely incorrect. LLMs operate at the level of word distributions, not at the level of verified facts. The resulting propensity to hallucinate, to produce statements that are incorrect but appear helpful and relevant, is alarming in high-risk areas like legal services. At present, lawyers should beware of relying on text generated by LLMs.

Spanish Legalese Language Model and Corpora

SaulLM-7B: A pioneering Large Language Model for Law

A Survey of Spanish Clinical Language Models

LeXFiles and LegalLAMA: Facilitating English Multinational Legal Language Model Development

Large Language Models are legal but they are not: Making the case for a powerful LegalLLM

MultiLegalPile: A 689GB Multilingual Legal Corpus

Resolving Legalese: A Multilingual Exploration of Negation Scope Resolution in Legal Documents

Lawma: The Power of Specialization for Legal Tasks

SaulLM-54B & SaulLM-141B: Scaling Up Domain Adaptation for the Legal Domain

Language Resources in Spanish for Automatic Text Simplification across Domains

Seventeenth-Century Spanish American Notary Records for Fine-Tuning Spanish Large Language Models

Large Language Models "Ad Referendum": How Good Are They at Machine Translation in the Legal Domain?

Evaluating Large Language Models with Tests of Spanish as a Foreign Language: Pass or Fail?

The Factuality of Large Language Models in the Legal Domain

Caveat Lector: Large Language Models in Legal Practice

Dólares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and English

LawLLM: Law Large Language Model for the US Legal System

Spanish Abstract Meaning Representation: Annotation of a General Corpus

Do Language Models Learn about Legal Entity Types during Pretraining?

The Large Language Model GreekLegalRoBERTa

Latxa: An Open Language Model and Evaluation Suite for Basque