Analysis and prevention of AI-based phishing email attacks

Chibuike Samuel Eze,Lior Shamir
2024-05-09
Abstract:Phishing email attacks are among the most common and most harmful cybersecurity attacks. With the emergence of generative AI, phishing attacks can be based on emails generated automatically, making it more difficult to detect them. That is, instead of a single email format sent to a large number of recipients, generative AI can be used to send each potential victim a different email, making it more difficult for cybersecurity systems to identify the scam email before it reaches the recipient. Here we describe a corpus of AI-generated phishing emails. We also use different machine learning tools to test the ability of automatic text analysis to identify AI-generated phishing emails. The results are encouraging, and show that machine learning tools can identify an AI-generated phishing email with high accuracy compared to regular emails or human-generated scam email. By applying descriptive analytic, the specific differences between AI-generated emails and manually crafted scam emails are profiled, and show that AI-generated emails are different in their style from human-generated phishing email scams. Therefore, automatic identification tools can be used as a warning for the user. The paper also describes the corpus of AI-generated phishing emails that is made open to the public, and can be used for consequent studies. While the ability of machine learning to detect AI-generated phishing email is encouraging, AI-generated phishing emails are different from regular phishing emails, and therefore it is important to train machine learning systems also with AI-generated emails in order to repel future phishing attacks that are powered by generative AI.
Cryptography and Security,Artificial Intelligence,Computation and Language
What problem does this paper attempt to address?
The problem this paper attempts to address is: how to detect and defend against phishing email attacks based on generative artificial intelligence (AI). Specifically, with the development of generative AI technology, phishing attackers can use AI to automatically generate a large number of unique phishing emails, making it difficult for traditional cybersecurity systems to identify these malicious emails. The paper constructs a corpus of AI-generated phishing emails and uses different machine learning tools to test the ability of automated text analysis to identify these AI-generated phishing emails. The research results show that machine learning tools can distinguish AI-generated phishing emails from regular emails or manually written fraudulent emails with high accuracy. Additionally, the paper also makes this AI-generated phishing email corpus publicly available for subsequent research use.