Abstract:Given that Artificial Intelligence (AI) increasingly permeates our lives, it is critical that we systematically align AI objectives with the goals and values of humans. The human-AI alignment problem stems from the impracticality of explicitly specifying the rewards that AI models should receive for all the actions they could take in all relevant states of the world. One possible solution, then, is to leverage the capabilities of AI models to learn those rewards implicitly from a rich source of data describing human values in a wide range of contexts. The democratic policy-making process produces just such data by developing specific rules, flexible standards, interpretable guidelines, and generalizable precedents that synthesize citizens' preferences over potential actions taken in many states of the world. Therefore, computationally encoding public policies to make them legible to AI systems should be an important part of a socio-technical approach to the broader human-AI alignment puzzle. This Essay outlines research on AI that learn structures in policy data that can be leveraged for downstream tasks. As a demonstration of the ability of AI to comprehend policy, we provide a case study of an AI system that predicts the relevance of proposed legislation to any given publicly traded company and its likely effect on that company. We believe this represents the "comprehension" phase of AI and policy, but leveraging policy as a key source of human values to align AI requires "understanding" policy. Solving the alignment problem is crucial to ensuring that AI is beneficial both individually (to the person or group deploying the AI) and socially. As AI systems are given increasing responsibility in high-stakes contexts, integrating democratically-determined policy into those systems could align their behavior with human goals in a way that is responsive to a constantly evolving society.

Envisioning a Human-AI collaborative system to transform policies into decision models

Harnessing AI for efficient analysis of complex policy documents: a case study of Executive Order 14110

Empowering Large Language Models in Hybrid Intelligence Systems through Data-Centric Process Models

Bridging the gap: Towards an Expanded Toolkit for AI-driven Decision-Making in the Public Sector

Creating a Cooperative AI Policymaking Platform through Open Source Collaboration

Human-Modeling in Sequential Decision-Making: An Analysis through the Lens of Human-Aware AI

A Path Towards Legal Autonomy: An interoperable and explainable approach to extracting, transforming, loading and computing legal information using large language models, expert systems and Bayesian networks

Deconstructing Human-AI Collaboration: Agency, Interaction, and Adaptation

Aligning Artificial Intelligence with Humans through Public Policy

Artificial intelligence and policy making; can small municipalities enable digital transformation?

Assistive AI for Augmenting Human Decision-making

Automated Parliaments: A Solution to Decision Uncertainty and Misalignment in Language Models

Deconstructing Human‐AI Collaboration: Agency, Interaction, and Adaptation

Decision-Oriented Dialogue for Human-AI Collaboration

Learning To Guide Human Decision Makers With Vision-Language Models

Artificial intelligence for the public sector: results of landscaping the use of AI in government across the European Union

Data-Centric AI Governance: Addressing the Limitations of Model-Focused Policies

Sustainable AI: An integrated model to guide public sector decision-making

Large Legislative Models: Towards Efficient AI Policymaking in Economic Simulations

Leveraging Artificial Intelligence for Public Sector Decision-Making: Balancing Accountability and Efficiency in Digital Public Services