Abstract:A computer virus or malware is a computer program, but with the purpose of causing harm to the system. This year has witnessed the rise of malware and the loss caused by them is high. Cyber criminals have continually advancing their methods of attack. The existing methodologies to detect the existence of such malicious programs and to prevent them from executing are static, dynamic and hybrid analysis. These approaches are adopted by anti-malware products. The conventional methods of were only efficient till a certain extent. They are incompetent in labeling the malware because of the time taken to reverse engineer the malware to generate a signature. When the signature becomes available, there is a high chance that a significant amount of damage might have occurred. However, there is a chance of detecting the malicious activities quickly by analyzing the events of DNS logs, Emails, and URLs. As these unstructured raw data contains rich source of information, we explore how the large volume of data can be leveraged to create cyber intelligent situational awareness to mitigate advanced cyber threats. Deep learning is a machine learning technique largely used by researchers in recent days. It avoids feature engineering which served as a critical step for conventional machine learning algorithms. It can be used along with the existing automation methods such as rule and heuristics based and machine learning techniques. This work takes the advantage of deep learning architectures to classify and correlate malicious activities that are perceived from the various sources such as DNS, Email, and URLs. Unlike conventional machine learning approaches, deep learning architectures don’t follow any feature engineering and feature representation methods. They can extract optimal features by themselves. Still, additional domain level features can be defined for deep learning methods in NLP tasks to enhance the performance. The cyber security events considered in this study are surrounded by texts. To convert text to real valued vectors, various natural language processing and text mining methods are incorporated. To our knowledge, this is the first attempt, a framework that can analyze and correlate the events of DNS, Email, andURLsat scale to provide situational awareness against malicious activities. The developed framework is highly scalable and capable of detecting the malicious activities in near real time. Moreover, the framework can be easily extended to handle large volume of other cyber security events by adding additional resources. These characteristics have made the proposed framework stand out from any other system of similar kind.

An ensemble-based framework for user behaviour anomaly detection and classification for cybersecurity

A Scalable Architecture Exploiting Elastic Stack and Meta Ensemble of Classifiers for Profiling User Behaviour

An Ensemble Approach for Detecting Anomalous User Behaviors

Using Ensemble Learning for Anomaly Detection in Cyber–Physical Systems

Comprehensive Analysis and Evaluation of Anomalous User Activity in Web Server Logs

A Dynamic Ensemble Learning Framework for Data Stream Analysis and Real-Time Threat Detection

A compression based framework for the detection of anomalies in heterogeneous data sources

A Deep Learning Ensemble for Network Anomaly and Cyber-Attack Detection

Super Learner Ensemble for Anomaly Detection and Cyber-risk Quantification in Industrial Control Systems

Learning Representations for Log Data in Cybersecurity

Applying High-Performance Bioinformatics Tools for Outlier Detection in Log Data

Dynamic log file analysis: An unsupervised cluster evolution approach for anomaly detection

Efficient Distributed Preprocessing Model for Machine Learning-Based Anomaly Detection over Large-Scale Cybersecurity Datasets

Enhancing Critical Infrastructure Security: Unsupervised Learning Approaches for Anomaly Detection

An Anomaly-based Detection System for Monitoring Kubernetes Infrastructures

CyberEduPlatform: an educational tool to improve cybersecurity through anomaly detection with Artificial Intelligence

Anomaly detection in the CERN cloud infrastructure

A novel approach to feature collection for anomaly detection in Kubernetes environment and agent for metrics collection from Kubernetes nodes

ScaleNet: Scalable and Hybrid Framework for Cyber Threat Situational Awareness Based on DNS, URL, and Email Data Analysis

End-To-End Anomaly Detection for Identifying Malicious Cyber Behavior through NLP-Based Log Embeddings

Big-data Analysis of Multi-Source Logs for Anomaly Detection on Network-Based System.