AI Horizon Scanning, White Paper p3395, IEEE-SA. Part I: Areas of Attention

Marina Cortês,Andrew R. Liddle,Christos Emmanouilidis,Anthony E. Kelly,Ken Matusow,Ragu Ragunathan,Jayne M. Suess,George Tambouratzis,Janusz Zalewski,David A. Bray
2024-09-14
Abstract:Generative Artificial Intelligence (AI) models may carry societal transformation to an extent demanding a delicate balance between opportunity and risk. This manuscript is the first of a series of White Papers informing the development of IEEE-SA's p3995: `Standard for the Implementation of Safeguards, Controls, and Preventive Techniques for Artificial Intelligence (AI) Models', Chair: Marina Cortês (<a class="link-external link-https" href="https://standards.ieee.org/ieee/3395/11378/" rel="external noopener nofollow">this https URL</a>). In this first horizon-scanning we identify key attention areas for standards activities in AI. We examine different principles for regulatory efforts, and review notions of accountability, privacy, data rights and mis-use. As a safeguards standard we devote significant attention to the stability of global infrastructures and consider a possible overdependence on cloud computing that may result from densely coupled AI components. We review the recent cascade-failure-like Crowdstrike event in July 2024, as an illustration of potential impacts on critical infrastructures from AI-induced incidents in the (near) future. It is the first of a set of articles intended as White Papers informing the audience on the standard development. Upcoming articles will focus on regulatory initiatives, technology evolution and the role of AI in specific domains.
Computers and Society,Artificial Intelligence
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is the challenges of social transformation brought about by generative artificial intelligence (GenAI) technology, especially the problem of seeking a delicate balance between opportunities and risks. Specifically, the paper focuses on the following aspects: 1. **Key Areas of Standard Activities**: The paper aims to identify the key concerns that need to be standardized in the field of artificial intelligence, especially those areas that may have an impact on the stability of the global infrastructure. 2. **Regulatory Principles**: Explore different regulatory principles, including concepts in aspects such as accountability, privacy, data rights, and misuse, to guide future artificial intelligence governance. 3. **Stability of the Global Infrastructure**: Pay special attention to the over - reliance on cloud computing that may be caused by highly coupled artificial intelligence components and the risks arising therefrom. The paper cites the Crowdstrike event that occurred in July 2024 as an example of the potential impact on critical infrastructure. 4. **Information Authenticity and Identity Verification**: With the development of generative AI, it is becoming increasingly difficult to distinguish between real and false information and identities, which poses new challenges to society. 5. **AI Abuse, Misinformation and Data Poisoning**: Discuss the ways in which AI can be maliciously exploited, including creating misinformation, data - poisoning attacks, etc., and propose corresponding preventive measures. 6. **AI Bias, Traceability and Transparency**: Research how to solve the problem of AI - generated bias through output source verification and improve the transparency and traceability of AI systems. 7. **Energy Consumption**: Focus on the energy consumption problem brought about by the rapid growth of the AI industry and its impact on the environment. 8. **Coping with Challenges at the Individual Level**: Explore how individuals can cope with various challenges brought about by the development of AI technology in their daily lives. In summary, through multi - angle analysis, this paper aims to provide theoretical basis and practical suggestions for formulating effective AI standards and control measures, so as to promote the safe, reliable and responsible development of AI technology.