Abstract:Artificial Intelligence (AI) is taking on increasingly autonomous roles, e.g., browsing the web as a research assistant and managing money. But specifying goals and restrictions for AI behavior is difficult. Similar to how parties to a legal contract cannot foresee every potential "if-then" contingency of their future relationship, we cannot specify desired AI behavior for all circumstances. Legal standards facilitate robust communication of inherently vague and underspecified goals. Instructions (in the case of language models, "prompts") that employ legal standards will allow AI agents to develop shared understandings of the spirit of a directive that generalize expectations regarding acceptable actions to take in unspecified states of the world. Standards have built-in context that is lacking from other goal specification languages, such as plain language and programming languages. Through an empirical study on thousands of evaluation labels we constructed from U.S. court opinions, we demonstrate that large language models (LLMs) are beginning to exhibit an "understanding" of one of the most relevant legal standards for AI agents: fiduciary obligations. Performance comparisons across models suggest that, as LLMs continue to exhibit improved core capabilities, their legal standards understanding will also continue to improve. OpenAI's latest LLM has 78% accuracy on our data, their previous release has 73% accuracy, and a model from their 2020 GPT-3 paper has 27% accuracy (worse than random). Our research is an initial step toward a framework for evaluating AI understanding of legal standards more broadly, and for conducting reinforcement learning with legal feedback (RLLF).

Concentrating Intelligence: Scaling and Market Structure in Artificial Intelligence

Market Concentration Implications of Foundation Models

Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitions

Organizing a Society of Language Models: Structures and Mechanisms for Enhanced Collective Intelligence

Market Power in Artificial Intelligence

Architectural Foundations for the Large Language Model Infrastructures

Safety vs. Performance: How Multi-Objective Learning Reduces Barriers to Market Entry

Foundation models in brief: A historical, socio-technical focus

An Experimental Study of Competitive Market Behavior Through LLMs

CompeteAI: Understanding the Competition Behaviors in Large Language Model-based Agents

CompeteAI: Understanding the Competition Dynamics of Large Language Model-based Agents

Artificial Intelligence, Algorithmic Competition and Market Structures

How large language models can reshape collective intelligence

CompeteAI: Understanding the Competition Dynamics in Large Language Model-based Agents

SMART: Automatically Scaling Down Language Models with Accuracy Guarantees for Reduced Processing Fees

Large Language Models as Fiduciaries: A Case Study Toward Robustly Communicating With Artificial Intelligence Through Legal Standards

LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

The great Transformer: Examining the role of large language models in the political economy of AI

Reducing the Barriers to Entry for Foundation Model Training

Efficient Large Foundation Model Inference: A Perspective From Model and System Co-Design

A Comprehensive Performance Study of Large Language Models on Novel AI Accelerators