Abstract:The rise of powerful large language models (LLMs) brings about tremendous opportunities for innovation but also looming risks for individuals and society at large. We have reached a pivotal moment for ensuring that LLMs and LLM-infused applications are developed and deployed responsibly. However, a central pillar of responsible AI -- transparency -- is largely missing from the current discourse around LLMs. It is paramount to pursue new approaches to provide transparency for LLMs, and years of research at the intersection of AI and human-computer interaction (HCI) highlight that we must do so with a human-centered perspective: Transparency is fundamentally about supporting appropriate human understanding, and this understanding is sought by different stakeholders with different goals in different contexts. In this new era of LLMs, we must develop and design approaches to transparency by considering the needs of stakeholders in the emerging LLM ecosystem, the novel types of LLM-infused applications being built, and the new usage patterns and challenges around LLMs, all while building on lessons learned about how people process, interact with, and make use of information. We reflect on the unique challenges that arise in providing transparency for LLMs, along with lessons learned from HCI and responsible AI research that has taken a human-centered perspective on AI transparency. We then lay out four common approaches that the community has taken to achieve transparency -- model reporting, publishing evaluation results, providing explanations, and communicating uncertainty -- and call out open questions around how these approaches may or may not be applied to LLMs. We hope this provides a starting point for discussion and a useful roadmap for future research.

Constituting an AI: Accountability Lessons from an LLM Experiment

Informed AI Regulation: Comparing the Ethical Frameworks of Leading LLM Chatbots Using an Ethics-Based Audit to Assess Moral Reasoning and Normative Values

Navigating LLM Ethics: Advancements, Challenges, and Future Directions

Large Language Models as Fiduciaries: A Case Study Toward Robustly Communicating With Artificial Intelligence Through Legal Standards

Accountability in Artificial Intelligence: What It Is and How It Works

Can We Trust AI Agents? An Experimental Study Towards Trustworthy LLM-Based Multi-Agent Systems for AI Ethics

Accounts, Accountability and Agency for Safe and Ethical AI

Unraveling the Nuances of AI Accountability: A Synthesis of Dimensions Across Disciplines

Who's Thinking? A Push for Human-Centered Evaluation of LLMs using the XAI Playbook

Supporting Human-AI Collaboration in Auditing LLMs with LLMs

Investigating accountability for Artificial Intelligence through risk governance: A workshop-based exploratory study

Dislocated Accountabilities in the AI Supply Chain: Modularity and Developers' Notions of Responsibility

The Stuff We Swim in: Regulation Alone Will Not Lead to Justifiable Trust in AI

Constraining Participation: Affordances of Feedback Features in Interfaces to Large Language Models

LLMs as Academic Reading Companions: Extending HCI Through Synthetic Personae

Stronger Together: on the Articulation of Ethical Charters, Legal Tools, and Technical Documentation in ML

AI Transparency in the Age of LLMs: A Human-Centered Research Roadmap

Challenging the appearance of machine intelligence: Cognitive bias in LLMs and Best Practices for Adoption

Accountability in AI: From principles to industry-specific accreditation

LLMs and the Human Condition

Investigating Agency of LLMs in Human-AI Collaboration Tasks