Abstract:Malware is one of the most significant threats in today’s computing world since the number of websites distributing malware is increasing at a rapid rate. Malware analysis and prevention methods are increasingly becoming necessary for computer systems connected to the Internet. This software exploits the system’s vulnerabilities to steal valuable information without the user’s knowledge, and stealthily send it to remote servers controlled by attackers. Traditionally, anti-malware products use signatures for detecting known malware. However, the signature-based method does not scale in detecting obfuscated and packed malware. Considering that the cause of a problem is often best understood by studying the structural aspects of a program like the mnemonics, instruction opcode, API Call, etc. In this paper, we investigate the relevance of the features of unpacked malicious and benign executables like mnemonics, instruction opcodes, and API to identify a feature that classifies the executable. Prominent features are extracted using Minimum Redundancy and Maximum Relevance (mRMR) and Analysis of Variance (ANOVA). Experiments were conducted on four datasets using machine learning and deep learning approaches such as Support Vector Machine (SVM), Naïve Bayes, J48, Random Forest (RF), and XGBoost. In addition, we also evaluate the performance of the collection of deep neural networks like Deep Dense network, One-Dimensional Convolutional Neural Network (1D-CNN), and CNN-LSTM in classifying unknown samples, and we observed promising results using APIs and system calls. On combining APIs/system calls with static features, a marginal performance improvement was attained comparing models trained only on dynamic features. Moreover, to improve accuracy, we implemented our solution using distinct deep learning methods and demonstrated a fine-tuned deep neural network that resulted in an F1-score of 99.1% and 98.48% on Dataset-2 and Dataset-3, respectively.

The Similarity Analysis of Malicious Software

Malware Similarity Analysis Based on Graph Similarity Flooding Algorithm.

Component Similarity Based Methods for Automatic Analysis of Malicious Executables

Using a Fine-Grained Hybrid Feature for Malware Similarity Analysis.

On the Role of Similarity in Detecting Masquerading Files

A Similarity Metric Method of Obfuscated Malware Using Function-Call Graph

Malware Analysis Using Machine Learning and Deep Learning Techniques

Malicious Code Detection Based on Software Fingerprint

Detecting Malware Variants Via Function-Call Graph Similarity

Malware Detection and Analysis Tools

A Comprehensive Review of Machine Learning Approaches for Detecting Malicious Software

Automatic Malware Description via Attribute Tagging and Similarity Embedding

Study on Modern Malware Analysis System

Machine Learning for Analyzing Malware.

A Malicious Behavior Analysis Method Based on Program Semantic

Detection of Malicious Software by Analyzing Distinct Artifacts Using Machine Learning and Deep Learning Algorithms

Structural Classification and Similarity Measurement of Malware

A Survey of Binary Code Similarity Detection Techniques

A malware detection framework based on kolmogorov complexity

A malicious software evaluation system based on behavior association

K-Means Clustering Analysis Based On Adaptive Weights For Malicious Code Detection