Engineering Digital Systems for Humanity: Challenges and Opportunities

Martina De Sanctis,Paola Inverardi,Patrizio Pelliccione
2024-06-13
Abstract:As testified by new regulations like the European AI act, the worries about the societal impact of (autonomous) software technologies are becoming of public concern. Social and human values, besides the traditional software behaviour and quality, are increasingly recognized as important for sustainability and long-term well-being. In this paper, we identify the macro and technological challenges and opportunities of present and future digital systems that should be engineered for humanity. Our specific perspective in identifying the challenges is to focus on humans and on their role in their co-existence with digital systems. The first challenge considers humans in a proactive role when interacting with the digital systems, i.e., taking initiative in making things happening instead of reacting to events. The second concerns humans having an active role in the interaction with the digital systems i.e., on humans that interact with digital systems as a reaction to events. The third challenge focuses on humans that have a passive role i.e., they experience, enjoy or even suffer the decisions and/or actions of digital systems. Two further transversal challenges are considered: the duality of trust and trustworthiness and the compliance to legislation that both may seriously affect the deployment and use of digital systems.
Software Engineering
What problem does this paper attempt to address?
### What problems does this paper attempt to solve? This paper aims to explore how to design and construct digital systems for human society in order to meet the current and future macro and technical challenges faced by digital systems and seize the opportunities therein. Specifically, the paper focuses on the following core issues: 1. **The role of humans in co - existence with digital systems**: - **Proactive Role**: Humans can initiate actions actively when interacting with digital systems, rather than just responding passively to events. This involves how humans can program or reprogram the system at runtime so that the system's behavior meets the user's needs and expectations. - **Reactive Role**: Humans act as reactors to events in the interaction with digital systems. This requires the system to be able to understand and respond to human emotions and ethical preferences. - **Passive Role**: Humans are in a passive state in the interaction with digital systems, such as experiencing, enjoying or suffering from the decisions and behaviors of digital systems. This requires ensuring that the decision - making process of digital systems is fair and in line with ethical standards. 2. **Trust and Trustworthiness**: - **Trust**: It involves the subjective acceptance of the system by humans, that is, whether humans consider the system to be reliable and trustworthy. - **Trustworthiness**: It involves the design of the system to ensure its behavior is safe and to guarantee the requirements in terms of safety and quality. 3. **Compliance to Legislation**: - The design and use of digital systems must comply with relevant laws and regulations, such as the European AI Act, etc. This requires the system to consider legal compliance during the development and deployment process, especially in high - risk applications. 4. **The influence of social and human values**: - With the popularization of digital systems, social and human values are increasingly regarded as important factors for sustainable development and long - term well - being. Therefore, the design of digital systems should not only focus on traditional behavior and quality, but also consider the impact on social values such as privacy, fairness, and transparency. ### Specific challenges and opportunities in the paper 1. **Continuous Systems Programming**: - **Challenges**: Achieve a balance that allows non - ICT experts to program the system easily and flexibly while ensuring the rigor and accuracy of the programming language. In addition, it is also necessary to ensure that the system always complies with relevant regulations during the continuous programming process. - **Opportunities**: Develop domain - specific programming languages and explore new programming methods such as learning by example and voice control. A successful solution requires the cooperation of interdisciplinary teams. 2. **Humans - Systems Interaction**: - **Challenges**: It is difficult to fully foresee and define human moral preferences at the design stage, and AI tools for automatically inferring emotional and ethical preferences may be risky. In addition, it is also challenging to develop a system that can automatically adjust the distribution of autonomy. - **Opportunities**: Research how to continuously collect and standardize ethical preferences, develop systems that can dynamically adjust the distribution of autonomy, and use synthesis techniques to generate controllers that meet ethical preferences. 3. **Digital Systems Impact on Humans**: - **Challenges**: Ensure the fairness and transparency of the system decision - making process and remove biases in the system and training data. In addition, it is necessary to clarify concepts such as explainability, transparency, interpretability and comprehensibility. - **Opportunities**: Research how to identify, mitigate and eliminate biases and improve the explainability and transparency of AI systems. The community can benefit from formulating new quality standards that should include emerging AI system characteristics. 4. **Trust & Trustworthiness**: - **Challenges**: Distinguish the different meanings of trust and trustworthiness and ensure that the system design can meet the trust needs of humans and ensure the trustworthiness of the system. - **Opportunities**: (The text seems to be incomplete here for this part)