An Unsupervised-Learning Based Method for Detecting Groups of Malicious Web Crawlers in Internet

Tianyi Yue,Yadong Zhou,Bowen Hu,Zhanbo Xu,Xiaohong Guan,Hao Zhou,Ting Liu
DOI: https://doi.org/10.1109/CASE49439.2021.9551622
2021-01-01
Abstract:Malicious web crawler has been a serious threat to the security and performance of web servers in Internet. Generally, malicious web crawler systematically obtains massive web pages without approval, and may involve the theft of data assets. In this paper, we propose an unsupervised learning based method for detecting malicious web crawler. The method can be divided into three phases. Firstly, the...
What problem does this paper attempt to address?