Abstract:Uniform Resource Locator (URL) is a unique identifier composed of protocol and domain name used to locate and retrieve a resource on the Internet. Like any Internet service, URLs (also called websites) are vulnerable to compromise by attackers to develop Malicious URLs that can exploit/devastate the user's information and resources. Malicious URLs are usually designed with the intention of promoting cyber-attacks such as spam, phishing, malware, and defacement. These websites usually require action on the user's side and can reach users across emails, text messages, pop-ups, or devious advertisements. They have a potential impact that can reach, in some cases, to compromise the machine or network of the user, especially those arriving by email. Therefore, developing systems to detect malicious URLs is of great interest nowadays. This paper proposes a high-performance machine learning-based detection system to identify Malicious URLs. The proposed system provides two layers of detection. Firstly, we identify the URLs as either benign or malware using a binary classifier. Secondly, we classify the URL classes based on their feature into five classes: benign, spam, phishing, malware, and defacement. Specifically, we report on four ensemble learning approaches, viz. the ensemble of bagging trees (En_Bag) approach, the ensemble of k-nearest neighbor (En_kNN) approach, and the ensemble of boosted decision trees (En_Bos) approach, and the ensemble of subspace discriminator (En_Dsc) approach. The developed approaches have been evaluated on an inclusive and contemporary dataset for uniform resource locators (ISCX-URL2016). ISCX-URL2016 provides a lightweight dataset for detecting and categorizing malicious URLs according to their attack type and lexical analysis. Conventional machine learning evaluation measurements are used to evaluate the detection accuracy, precision, recall, F Score, and detection time. Our experiential assessment indicates that the ensemble of bagging trees (En_Bag) approach provides better performance rates than other ensemble methods. Alternatively, the ensemble of the k-nearest neighbor (En_kNN) approach provides the highest inference speed. We also contrast our En_Bag model with state-of-the-art solutions and show its superiority in binary classification and multi-classification with accuracy rates of 99.3% and 97.92%, respectively.

Malicious URL Detection with Feature Extraction Based on Machine Learning

Finding Effective Classifier for Malicious URL Detection

Malicious URL Detection using Machine Learning: A Survey

Improving Malicious URLs Detection Via Feature Engineering: Linear and Nonlinear Space Transformation Methods

Malicious website detection under the exploratory attack

Malicious Web Page Detection Based on On-Line Learning Algorithm

A Malicious Web Page Detection Model Based on SVM Algorithm

Detection of Malicious Websites Using Machine Learning Techniques

Research on Malicious URL Detection Based on Cost-sensitive Learning

An Assessment of Lexical, Network, and Content-Based Features for Detecting Malicious URLs Using Machine Learning and Deep Learning Models

An intelligent identification and classification system for malicious uniform resource locators (URLs)

Malicious URL Detection Based on Improved Multilayer Recurrent Convolutional Neural Network Model

Learning URL Embedding for Malicious Website Detection

Detecting Malicious URLs Via a Keyword-Based Convolutional Gated-Recurrent-Unit Neural Network.

Robust Detection of Malicious URLs with Self-Paced Wide & Deep Learning

Advancing Malicious Website Identification: A Machine Learning Approach Using Granular Feature Analysis

A Malicious Web Page Detection Model based on SVM Algorithm: Research on the Enhancement of SVM Efficiency by Multiple Machine Learning Algorithms

A Convolution-Based System for Malicious URLs Detection

Adaptive Malicious Url Detection: Learning In The Presence Of Concept Drifts

A Novel Approach for Malicious URL Detection Based on the Joint Model

Real-time Detection of Malicious Web Pages Based on Statistical Learning