Abstract:Given that Artificial Intelligence (AI) increasingly permeates our lives, it is critical that we systematically align AI objectives with the goals and values of humans. The human-AI alignment problem stems from the impracticality of explicitly specifying the rewards that AI models should receive for all the actions they could take in all relevant states of the world. One possible solution, then, is to leverage the capabilities of AI models to learn those rewards implicitly from a rich source of data describing human values in a wide range of contexts. The democratic policy-making process produces just such data by developing specific rules, flexible standards, interpretable guidelines, and generalizable precedents that synthesize citizens' preferences over potential actions taken in many states of the world. Therefore, computationally encoding public policies to make them legible to AI systems should be an important part of a socio-technical approach to the broader human-AI alignment puzzle. This Essay outlines research on AI that learn structures in policy data that can be leveraged for downstream tasks. As a demonstration of the ability of AI to comprehend policy, we provide a case study of an AI system that predicts the relevance of proposed legislation to any given publicly traded company and its likely effect on that company. We believe this represents the "comprehension" phase of AI and policy, but leveraging policy as a key source of human values to align AI requires "understanding" policy. Solving the alignment problem is crucial to ensuring that AI is beneficial both individually (to the person or group deploying the AI) and socially. As AI systems are given increasing responsibility in high-stakes contexts, integrating democratically-determined policy into those systems could align their behavior with human goals in a way that is responsive to a constantly evolving society.

Mutuality in AI-enabled new public service solutions

Towards a Policy-as-a-Service Framework to Enable Compliant, Trustworthy AI and HRI Systems in the Wild

What Do Citizens Think of AI Adoption in Public Services? Exploratory Research on Citizen Attitudes through a Social Contract Lens

Governing Ethical AI Transformation: A Case Study of AuroraAI

Artificial Intelligence and Public Values: Value Impacts and Governance in the Public Sector

An Approach for Combining Ethical Principles with Public Opinion to Guide Public Policy

Analysing and Organising Human Communications for AI Fairness-Related Decisions: Use Cases from the Public Sector

Towards "Anytime, Anywhere" Community Learning and Engagement around the Design of Public Sector AI

New Pythias of public administration: ambiguity and choice in AI systems as challenges for governance

Sustainable AI: An integrated model to guide public sector decision-making

Human-centricity in AI governance: A systemic approach

Trust, trustworthiness and AI governance

Aligning Artificial Intelligence with Humans through Public Policy

Artificial Intelligence and the Public Sector—Applications and Challenges

Applied artificial intelligence and trust—The case of autonomous vehicles and medical assistance devices

AI-Ethics by Design. Evaluating Public Perception on the Importance of Ethical Design Principles of AI

Public and Private Value Creation Using Artificial Intelligence: an Empirical Study of AI Voice Robot Users in Chinese Public Sector.

AI-Inclusivity in Healthcare: Motivating an Institutional Epistemic Trust Perspective

Understanding artificial intelligence ethics and safety

Misalignments in AI Perception: Quantitative Findings and Visual Mapping of How Experts and the Public Differ in Expectations and Risks, Benefits, and Value Judgments

Bridging the public administration‐AI divide: A skills perspective