AST-Based Deep Learning for Detecting Malicious PowerShell

Gili Rusak,Abdullah Al-Dujaili,Una-May O'Reilly
DOI: https://doi.org/10.1145/3243734.3278496
2018-10-04
Abstract:With the celebrated success of deep learning, some attempts to develop effective methods for detecting malicious PowerShell programs employ neural nets in a traditional natural language processing setup while others employ convolutional neural nets to detect obfuscated malicious commands at a character level. While these representations may express salient PowerShell properties, our hypothesis is that tools from static program analysis will be more effective. We propose a hybrid approach combining traditional program analysis (in the form of abstract syntax trees) and deep learning. This poster presents preliminary results of a fundamental step in our approach: learning embeddings for nodes of PowerShell ASTs. We classify malicious scripts by family type and explore embedded program vector representations.
Software Engineering,Machine Learning
What problem does this paper attempt to address?