Super forecasting the technological singularity risks from artificial intelligence

Petar Radanliev,David De Roure,Carsten Maple,Uchenna Ani
DOI: https://doi.org/10.1007/s12530-022-09431-7
2022-12-28
Abstract:The article forecasts emerging cyber-risks from the integration of AI in cybersecurity.
Computers and Society,Artificial Intelligence,Cryptography and Security
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve This paper aims to explore the cybersecurity risks associated with Artificial Intelligence (AI) in the context of the "technological singularity" and propose corresponding predictions and countermeasures. Specifically, the paper focuses on the following aspects: 1. **Cybersecurity and the "Technological Singularity"**: - Investigate the impact of AI on cybersecurity in the context of the "technological singularity." - Analyze the system's response to internal and external failures or breaches, rather than just the system's security. 2. **Emerging Cyber Risks**: - Predict emerging risks brought by the integration of AI in cybersecurity. - Integrate existing literature, data sources, and prediction results based on these predictions to improve the overall feasibility of the research. 3. **Defense Mechanisms**: - Develop new methodologies to use AI to defend against cyber risks. - Focus on addressing the risks of AI attacks and predicting the value of AI in defense and preventing malicious devices from acting independently. 4. **Global Trend Analysis**: - Use tools like Google Trends to analyze search trends for AI, cybersecurity, and cyber risks from 2004 to 2021. - Discover that since 2018, cybersecurity has become a more popular topic than AI, but interest in cyber risks remains low. 5. **Data Sources and Evaluation**: - Identify data sources that can be used to quantify cyber risks, including external data sources (such as Shodan, Censys, etc.) and internal data sources (such as file storage, vulnerability scan reports, etc.). - Discuss how to combine these data sources to improve the quantification of cyber risks. 6. **Current Applications and Future Predictions**: - Outline current applications of AI in cybersecurity, including Intrusion Detection Systems (IDS), email filtering, malware detection, etc. - Predict future applications of AI in cybersecurity, such as large-scale remote lifecycle management, large-scale automated defense, detection of malicious bots, etc. 7. **Potential Threats**: - Predict future ways AI might be used for cyber attacks, such as automated adversarial attacks, data poisoning attacks, generating false classifications, etc. - Analyze why existing cybersecurity solutions might fail due to AI, including limitations in academic research and industrial applications. 8. **Solutions to Enhance Cybersecurity**: - Propose methods based on multi-view/multi-modal analysis, using multiple data sources for deep learning. - Emphasize the importance of opening "black box" algorithms to improve the interpretability and interoperability of algorithms. Overall, this paper attempts to propose a new framework to address the cybersecurity risks brought by AI, especially in the context of the "technological singularity," through comprehensive analysis and prediction.