Abstract:The lack of transparency is one of the artificial intelligence (AI)'s fundamental challenges, but the concept of transparency might be even more opaque than AI itself. Researchers in different fields who attempt to provide the solutions to improve AI's transparency articulate different but neighboring concepts that include, besides transparency, explainability and interpretability. Yet, there is no common taxonomy neither within one field (such as data science) nor between different fields (law and data science). In certain areas like healthcare, the requirements of transparency are crucial since the decisions directly affect people's lives. In this paper, we suggest an interdisciplinary vision on how to tackle the issue of AI's transparency in healthcare, and we propose a single point of reference for both legal scholars and data scientists on transparency and related concepts. Based on the analysis of the European Union (EU) legislation and literature in computer science, we submit that transparency shall be considered the “way of thinking” and umbrella concept characterizing the process of AI's development and use. Transparency shall be achieved through a set of measures such as interpretability and explainability, communication, auditability, traceability, information provision, record-keeping, data governance and management, and documentation. This approach to deal with transparency is of general nature, but transparency measures shall be always contextualized. By analyzing transparency in the healthcare context, we submit that it shall be viewed as a system of accountabilities of involved subjects (AI developers, healthcare professionals, and patients) distributed at different layers (insider, internal, and external layers, respectively). The transparency-related accountabilities shall be built-in into the existing accountability picture which justifies the need to investigate the relevant legal frameworks. These frameworks correspond to different layers of the transparency system. The requirement of informed medical consent correlates to the external layer of transparency and the Medical Devices Framework is relevant to the insider and internal layers. We investigate the said frameworks to inform AI developers on what is already expected from them with regards to transparency. We also discover the gaps in the existing legislative frameworks concerning AI's transparency in healthcare and suggest the solutions to fill them in.

Signs for Ethical AI: A Route Towards Transparency

Towards Transparency by Design for Artificial Intelligence

Transparency you can trust: Transparency requirements for artificial intelligence between legal norms and contextual concerns

Think About the Stakeholders First! Towards an Algorithmic Transparency Playbook for Regulatory Compliance

AI data transparency: an exploration through the lens of AI incidents

Transparency of AI in Healthcare as a Multilayered System of Accountabilities: Between Legal Requirements and Technical Limitations

Capturing the Trends, Applications, Issues, and Potential Strategies of Designing Transparent AI Agents

On the path to the future: mapping the notion of transparency in the EU regulatory framework for AI

Towards Responsible AI: A Design Space Exploration of Human-Centered Artificial Intelligence User Interfaces to Investigate Fairness

The Principle of Transparency of Use of Artificial Intelligence

Varieties of transparency: exploring agency within AI systems

Users are the North Star for AI Transparency

Enhancing transparency in AI-powered customer engagement

Towards Intelligent Regulation of Artificial Intelligence

Transparent AI Disclosure Obligations: Who, What, When, Where, Why, How

Navigating and reviewing ethical dilemmas in AI development: Strategies for transparency, fairness, and accountability

On the Transparency of Artificial Intelligence System

Applying Transparency in Artificial Intelligence based Personalization Systems

Governance by Glass-Box: Implementing Transparent Moral Bounds for AI Behaviour

AI-Ethics by Design. Evaluating Public Perception on the Importance of Ethical Design Principles of AI

Transparent human - (non-) transparent technology? The Janus-faced call for transparency in AI-based health care technologies