Abstract:Growing interest and investment in the capabilities of foundation models has positioned such systems to impact a wide array of public services. Alongside these opportunities is the risk that these systems reify existing power imbalances and cause disproportionate harm to marginalized communities. Participatory approaches hold promise to instead lend agency and decision-making power to marginalized stakeholders. But existing approaches in participatory AI/ML are typically deeply grounded in context - how do we apply these approaches to foundation models, which are, by design, disconnected from context? Our paper interrogates this question. First, we examine existing attempts at incorporating participation into foundation models. We highlight the tension between participation and scale, demonstrating that it is intractable for impacted communities to meaningfully shape a foundation model that is intended to be universally applicable. In response, we develop a blueprint for participatory foundation models that identifies more local, application-oriented opportunities for meaningful participation. In addition to the "foundation" layer, our framework proposes the "subfloor'' layer, in which stakeholders develop shared technical infrastructure, norms and governance for a grounded domain, and the "surface'' layer, in which affected communities shape the use of a foundation model for a specific downstream task. The intermediate "subfloor'' layer scopes the range of potential harms to consider, and affords communities more concrete avenues for deliberation and intervention. At the same time, it avoids duplicative effort by scaling input across relevant use cases. Through three case studies in clinical care, financial services, and journalism, we illustrate how this multi-layer model can create more meaningful opportunities for participation than solely intervening at the foundation layer.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: How to achieve meaningful public participation in the development and application of foundation models to mitigate the power imbalances and disproportionate harm to marginalized groups that these models may bring. ### Problem Background Foundation models (such as GPT - 4 or CLIP) have attracted wide attention in various fields (such as healthcare, finance, journalism, etc.) due to their wide versatility and large - scale application potential. However, these models also bring new risks, including environmental impacts, economic impacts, data labor exploitation, legal issues, data opacity, and homogenization of discriminatory behavior across applications. In particular, these risks and opportunities may disproportionately affect different groups, further exacerbating the existing power structures and causing more negative impacts on historically marginalized communities. ### Existing Challenges 1. **Contradiction between Scale and Participation**: Foundation models are designed to be applicable to a wide range of tasks, which makes it difficult for affected communities to have a substantial impact on them. 2. **Limitations of Existing Participation Methods**: Existing participatory AI/ML methods are usually targeted at specific applications and relevant stakeholders and are difficult to be directly applied in the context of foundation models. 3. **Power Concentration**: Foundation models are mainly developed and controlled by large technology companies, which do not pay particular attention to or are not responsible for any specific community or field. ### Paper Objectives The objective of the paper is to fill this gap and propose a multi - level framework to achieve more meaningful public participation. Specifically: - **Analyze Existing Attempts**: Research existing efforts to incorporate participation into the development of foundation models and reveal their limitations in empowering affected communities with decision - making power. - **Propose a Blueprint**: Develop a multi - level participation framework, including the "foundation layer", "sub - bottom layer" and "surface layer", in order to empower stakeholders with more decision - making power in more localized, application - oriented opportunities. - **Foundation Layer**: General foundation models. - **Sub - bottom Layer**: Develop shared technical infrastructure, norms and governance for specific fields (such as clinical care, journalism, finance). - **Surface Layer**: The application layer for specific downstream tasks, where affected communities can shape the use of foundation models at this level. Through three case studies (clinical care, financial services and journalism), the paper shows how this multi - layer model can create more participation opportunities than intervention only at the foundation layer. ### Key Contributions - **Reveal the Participatory Ceiling**: Point out the participatory ceiling when directly intervening in foundation models, that is, it is difficult for affected communities to have a substantial impact on them. - **Propose a Solution**: Through the multi - level framework, provide a possibility to achieve in - depth domain - oriented participation in the foundation model ecosystem, so as to better address the problems of power imbalances and harm to marginalized groups. In conclusion, this paper aims to explore how to achieve meaningful public participation in the development and application of foundation models to ensure that these powerful technological tools can serve society more fairly and justly.

Participation in the age of foundation models

Power to the People? Opportunities and Challenges for Participatory AI

Mapping the individual, social, and biospheric impacts of Foundation Models

Position: Cracking the Code of Cascading Disparity Towards Marginalized Communities

Foundation Models for Decision Making: Problems, Methods, and Opportunities

Foundation models in brief: A historical, socio-technical focus

Provocation: Who benefits from "inclusion" in Generative AI?

The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice

Participatory Approaches in AI Development and Governance: A Principled Approach

Privacy in Foundation Models: A Conceptual Framework for System Design

Data Authenticity, Consent, & Provenance for AI are all broken: what will it take to fix them?

On the Societal Impact of Open Foundation Models

Foundation Models for Education: Promises and Prospects

Foundation Model Sherpas: Guiding Foundation Models through Knowledge and Reasoning

Participatory Approaches in AI Development and Governance: Case Studies

Acceptable Use Policies for Foundation Models

Foundation Models in Augmentative and Alternative Communication: Opportunities and Challenges

The Privacy Pillar -- A Conceptual Framework for Foundation Model-based Systems

When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources