Preventing Poisoning Attacks on AI based Threat Intelligence Systems

Nitika Khurana,Sudip Mittal,Anupam Joshi
DOI: https://doi.org/10.48550/arXiv.1807.07418
2018-07-19
Abstract:As AI systems become more ubiquitous, securing them becomes an emerging challenge. Over the years, with the surge in online social media use and the data available for analysis, AI systems have been built to extract, represent and use this information. The credibility of this information extracted from open sources, however, can often be questionable. Malicious or incorrect information can cause a loss of money, reputation, and resources; and in certain situations, pose a threat to human life. In this paper, we use an ensembled semi-supervised approach to determine the credibility of Reddit posts by estimating their reputation score to ensure the validity of information ingested by AI systems. We demonstrate our approach in the cybersecurity domain, where security analysts utilize these systems to determine possible threats by analyzing the data scattered on social media websites, forums, blogs, etc.
Social and Information Networks,Cryptography and Security,Machine Learning
What problem does this paper attempt to address?