Abstract:Malware is one of the most significant threats in today’s computing world since the number of websites distributing malware is increasing at a rapid rate. Malware analysis and prevention methods are increasingly becoming necessary for computer systems connected to the Internet. This software exploits the system’s vulnerabilities to steal valuable information without the user’s knowledge, and stealthily send it to remote servers controlled by attackers. Traditionally, anti-malware products use signatures for detecting known malware. However, the signature-based method does not scale in detecting obfuscated and packed malware. Considering that the cause of a problem is often best understood by studying the structural aspects of a program like the mnemonics, instruction opcode, API Call, etc. In this paper, we investigate the relevance of the features of unpacked malicious and benign executables like mnemonics, instruction opcodes, and API to identify a feature that classifies the executable. Prominent features are extracted using Minimum Redundancy and Maximum Relevance (mRMR) and Analysis of Variance (ANOVA). Experiments were conducted on four datasets using machine learning and deep learning approaches such as Support Vector Machine (SVM), Naïve Bayes, J48, Random Forest (RF), and XGBoost. In addition, we also evaluate the performance of the collection of deep neural networks like Deep Dense network, One-Dimensional Convolutional Neural Network (1D-CNN), and CNN-LSTM in classifying unknown samples, and we observed promising results using APIs and system calls. On combining APIs/system calls with static features, a marginal performance improvement was attained comparing models trained only on dynamic features. Moreover, to improve accuracy, we implemented our solution using distinct deep learning methods and demonstrated a fine-tuned deep neural network that resulted in an F1-score of 99.1% and 98.48% on Dataset-2 and Dataset-3, respectively.

Malware Detection Using Bilayer Behavior Abstraction and Improved One-Class Support Vector Machines

Malware Analysis Using Machine Learning and Deep Learning Techniques

Behavior-based malicious executables detection by multi-class SVM

Malware Behavioural Detection and Vaccine Development by Using a Support Vector Model Classifier.

Collaborative Support Vector Machine for Malware Detection

A Layered Classification for Malicious Function Identification and Malware Detection

NtMalDetect: A Machine Learning Approach to Malware Detection Using Native API System Calls

Integration of Multi-Modal Features for Android Malware Detection Using Linear Svm

Detection of Malicious Software by Analyzing Distinct Artifacts Using Machine Learning and Deep Learning Algorithms

A Layered Detection Method For Malware Identification

Malware Analysis and Detection Using Machine Learning Algorithms

Towards Building an Intelligent Anti-Malware System: A Deep Learning Approach using Support Vector Machine (SVM) for Malware Classification

Malware Detection Using Machine Learning Based on the Combination of Dynamic and Static Features

Malware Classification Using Probability Scoring and Machine Learning.

Automatic Malware Classification and New Malware Detection Using Machine Learning

A New Malware Classification Approach Based On Malware Dynamic Analysis

Malware Detection Based on Multi-level and Dynamic Multi-feature Using Ensemble Learning at Hypervisor

Large-scale Malware Automatic Detection Based on Multiclass Features and Machine Learning.

A New Learning Approach to Malware Classification Using Discriminative Feature Extraction.

Abstracting Minimal Security-Relevant Behaviors for Malware Analysis

Evaluation of Machine Learning Algorithms for Malware Detection