Abstract:Monitoring Indicators of Compromise (IOC) leads to malware detection for identifying malicious activity. Malicious activities potentially lead to a system breach or data compromise. Various tools and anti-malware products exist for the detection of malware and cyberattacks utilizing IOCs, but all have several shortcomings. For instance, anti-malware systems make use of malware signatures, requiring a database containing such signatures to be constantly updated. Additionally, this technique does not work for zero-day attacks or variants of existing malware. In the quest to fight zero-day attacks, the research paradigm shifted from primitive methods to classical machine learning-based methods. Primitive methods are limited in catering to anti-analysis techniques against zero-day attacks. Hence, the direction of research moved towards methods utilizing classic machine learning, however, machine learning methods also come with certain limitations. They may include but not limited to the latency/lag introduced by feature-engineering phase on the entire training dataset as opposed to the real-time analysis requirement. Likewise, additional layers of data engineering to cater to the increasing volume of data introduces further delays. It led to the use of deep learning-based methods for malware detection. With the speedy occurrence of zero-day malware, researchers chose to experiment with few shot learning so that reliable solutions can be produced for malware detection with even a small amount of data at hand for training. In this paper, we surveyed several possible strategies to support the real-time detection of malware and propose a hierarchical model to discover security events or threats in real-time. A key focus in this survey is on the use of Deep Learning-based methods. Deep Learning based methods dominate this research area by providing automatic feature engineering, the capability of dealing with large datasets, enabling the mining of features from limited data samples, and supporting one-shot learning. We compare Deep Learning-based approaches with conventional machine learning based approaches and primitive (statistical analysis based) methods commonly reported in the literature.

Deep-Learning and Machine-Learning-Based Techniques for Malware Detection and Data-Driven Network Security

Malware Analysis Using Machine Learning and Deep Learning Techniques

The rise of machine learning for detection and classification of malware: Research developments, trends and challenges

A Selective Survey of Deep Learning Techniques and Their Application to Malware Analysis

Machine Learning for Windows Malware Detection and Classification: Methods, Challenges and Ongoing Research

Malware Attacks Detection in Network Security using Deep Learning Approaches

A Review of Deep Learning Based Malware Detection Techniques

Robust Intelligent Malware Detection Using Deep Learning

Deep Learning Models for Detecting Malware Attacks

A Survey of the Recent Trends in Deep Learning Based Malware Detection

Malicious Code Detection Using Machine Learning

Deep learning-powered malware detection in cyberspace: a contemporary review

New Era of Deeplearning-Based Malware Intrusion Detection: The Malware Detection and Prediction Based On Deep Learning

A Survey on Machine Learning-based Detection and Classification Technology of Malware

An investigation of a deep learning based malware detection system

A Survey of Malware Detection Using Deep Learning

Evaluation of Machine Learning Algorithms for Malware Detection

A Survey on Different Approaches for Malware Detection Using Machine Learning Techniques

Malware Detection Module using Machine Learning Algorithms to Assist in Centralized Security in Enterprise Networks

Deep Learning Methods for Malware and Intrusion Detection: A Systematic Literature Review

Detection of Malicious Software by Analyzing Distinct Artifacts Using Machine Learning and Deep Learning Algorithms