Political Actor Agent: Simulating Legislative System for Roll Call Votes Prediction with Large Language Models

Hao Li,Ruoyuan Gong,Hao Jiang
2024-12-10
Abstract:Predicting roll call votes through modeling political actors has emerged as a focus in quantitative political science and computer science. Widely used embedding-based methods generate vectors for legislators from diverse data sets to predict legislative behaviors. However, these methods often contend with challenges such as the need for manually predefined features, reliance on extensive training data, and a lack of interpretability. Achieving more interpretable predictions under flexible conditions remains an unresolved issue. This paper introduces the Political Actor Agent (PAA), a novel agent-based framework that utilizes Large Language Models to overcome these limitations. By employing role-playing architectures and simulating legislative system, PAA provides a scalable and interpretable paradigm for predicting roll-call votes. Our approach not only enhances the accuracy of predictions but also offers multi-view, human-understandable decision reasoning, providing new insights into political actor behaviors. We conducted comprehensive experiments using voting records from the 117-118th U.S. House of Representatives, validating the superior performance and interpretability of PAA. This study not only demonstrates PAA's effectiveness but also its potential in political science research.
Artificial Intelligence,Computation and Language
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenges faced when predicting roll - call voting results by modeling political actors (i.e., legislators). Specifically, the existing embedding methods have the following problems: 1. **Limitations of Pre - defined Features**: Model training depends on manually pre - defined features, which makes it difficult for the model to naturally extend to new, untrained relationships. 2. **Requirement for the Amount of Training Data**: Most models require a large amount of data to achieve optimal performance, but in actual scenarios (such as predicting the votes of newly - elected legislators), obtaining a large amount of data is not always feasible. 3. **Lack of Predictability Interpretability**: Embedding - based predictions lack interpretability, especially in providing insights in a human - understandable way. To solve these problems, this paper proposes a new agent - based framework - **Political Actor Agent (PAA)**, which uses large language models (LLMs) to overcome the above limitations. PAA provides a scalable and interpretable paradigm for predicting roll - call voting through a role - playing architecture and a simulated legislative system. Specifically, the main contributions of PAA include: 1. **Proposing a New Agent - Based Research Paradigm for Political Actors**: Compared with embedding methods, the role - playing framework of PAA provides more accurate and interpretable results when simulating legislators. 2. **Introducing PAA for Roll - Call Voting Prediction**: By designing scalable profiles, multi - perspective planning, and simulating legislative actions, PAA significantly improves prediction accuracy and provides interpretable decision - making insights for political science research. 3. **Conducting Comprehensive Experiments**: Using the voting records of the 117th to 118th U.S. House of Representatives, the high performance and interpretability of PAA are verified. Through these improvements, PAA not only enhances the accuracy of prediction but also provides new insights into understanding the behavior of political actors.