Abstract:The increased usage of the Internet raises cyber security attacks in digital environments. One of the largest threats that initiate cyber attacks is malicious software known as malware. Automatic creation of malware as well as obfuscation and packing techniques make the malicious detection processes a very challenging task. The obfuscation techniques allow malware variants to bypass most of the leading literature malware detection methods. In this paper, a more effective malware detection system is proposed. The goal of the study is to detect traditional as well as new and complex malware variants. The proposed approach consists of three modules. Initially, the malware samples are collected and analyzed by using dynamic malware analysis tools, and execution traces are collected. Then, the collected system calls are used to create malware behaviors as well as features. Finally, a proposed deep learning methodology is used to effectively separate malware from benign samples. The deep learning methodology consists of one input layer, three hidden layers, and an output layer. In hidden layers, 500, 64, and 32 fully connected neurons are used in the first, second, and third hidden layers, respectively. To keep the model simple as well as obtain optimal solutions, we have selected three hidden layers in which neurons are decreasing in the following subsequent layers. To increase the model performance and use more important features, various activation functions are used. The test results show that the proposed system can effectively detect the malware with more than 99% DR, f-measure, and 99.80 accuracy, which is substantially high when compared with other methods. The proposed system can recognize new malware variants that could not be detected with signature, heuristic, and some behavior-based detection techniques. Further, the proposed system has performed better than the well-known methods that are mentioned in the literature based on the DR, precision, recall, f-measure, and accuracy metrics.

Behavior-Based Malware Analysis and Detection

LSTM Android Malicious Behavior Analysis Based on Feature Weighting

Behavior-Based Malware Detection on Mobile Phone

Malware Analysis Using Machine Learning and Deep Learning Techniques

A Review of Deep Learning Based Malware Detection Techniques

A study on malicious software behaviour analysis and detection techniques: Taxonomy, current trends and challenges

Demystifying Behavior-Based Malware Detection at Endpoints

A Comprehensive Review of Machine Learning Approaches for Detecting Malicious Software

Impeding Behavior-Based Malware Analysis Via Replacement Attacks to Malware Specifications

A Malware Detection Method Based on Sandbox, Binary Instrumentation and Multidimensional Feature Extraction

MALDC: a depth detection method for malware based on behavior chains

An Android Behavior-Based Malware Detection Method Using Machine Learning

Advanced Cybersecurity Enhancement through Mathematical Models: A Comprehensive Approach Using Statistical Methods, Cryptographic Techniques, and Machine Learning Algorithms (SVM, Random Forest, and Neural Networks) for Behavior-Based Malware Detection

Separating Malicious from Benign Software Using Deep Learning Algorithm

Mining Malware Specifications through Static Reachability Analysis

Dynamic Extraction of Initial Behavior for Evasive Malware Detection

Discovering Malicious Signatures in Software from Structural Interactions

Artificial Intelligence-Based Malware Detection, Analysis, and Mitigation

Tools and Techniques for Malware Detection and Analysis

Malware Analysis and Detection Using Machine Learning Algorithms

Malware Detection and Analysis Tools