Implementing AI Ethics: Making Sense of the Ethical Requirements

Mamia Agbese,Rahul Mohanani,Arif Ali Khan,Pekka Abrahamsson
DOI: https://doi.org/10.48550/arXiv.2306.06749
2023-06-11
Computers and Society
Abstract:Society's increasing dependence on Artificial Intelligence (AI) and AI-enabled systems require a more practical approach from software engineering (SE) executives in middle and higher-level management to improve their involvement in implementing AI ethics by making ethical requirements part of their management practices. However, research indicates that most work on implementing ethical requirements in SE management primarily focuses on technical development, with scarce findings for middle and higher-level management. We investigate this by interviewing ten Finnish SE executives in middle and higher-level management to examine how they consider and implement ethical requirements. We use ethical requirements from the European Union (EU) Trustworthy Ethics guidelines for Trustworthy AI as our reference for ethical requirements and an Agile portfolio management framework to analyze implementation. Our findings reveal a general consideration of privacy and data governance ethical requirements as legal requirements with no other consideration for ethical requirements identified. The findings also show practicable consideration of ethical requirements as technical robustness and safety for implementation as risk requirements and societal and environmental well-being for implementation as sustainability requirements. We examine a practical approach to implementing ethical requirements using the ethical risk requirements stack employing the Agile portfolio management framework.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how middle - and senior - level managers consider and implement ethical requirements in software engineering (SE) management. Although certain progress has been made at the technical development level, at the middle - and senior - level management level, the importance attached to ethical requirements is still insufficient. These managers often do not regard them as priorities because their impact on human life is underestimated and it is difficult to convert them into financial values. In addition, product teams rarely discuss ethical requirements with senior managers, unless it involves legal regulations such as privacy laws. Therefore, the research aims to explore how middle - and senior - level SE managers understand, evaluate, improve, currently implement, and increase the visibility of ethical requirements, in order to provide initial steps for the implementation of AI ethics and contribute relevant knowledge to the discussion of AI ethics implementation and SE management practice. Specifically, the research explores the main research question through the following five sub - questions: 1. **RQ1**: How do middle - and senior - level SE managers understand ethical requirements? 2. **RQ2**: What is the value of ethical requirements in middle - and senior - level management? 3. **RQ3**: How to increase the value of ethical requirements? 4. **RQ4**: How are ethical requirements currently implemented in middle - and senior - level SE management? 5. **RQ5**: How to actually implement ethical requirements? The research uses the EU ethical guidelines on trustworthy AI and the agile portfolio management framework as references, and analyzes the understanding and practice of ten Finnish middle - and senior - level SE managers in terms of ethical requirements through interviews. The study finds that these managers' understanding of ethical requirements is rather fragmented, and they usually regard them as part of business ethics or technical requirements, while the value of ethical requirements in the market is mainly reflected in legal and regulatory requirements, lacking financial value. In order to increase the value of ethical requirements, the research suggests enhancing their importance by demonstrating their economic benefits, increasing market demand, and emphasizing ethical risks.