Abstract:Deep learning (DL) has proven to be effective in detecting sophisticated malware that is constantly evolving. Even though deep learning has alleviated the feature engineering problem, finding the most optimal DL model's architecture and set of hyper-parameters, remains a challenge that requires domain expertise. In addition, many of the proposed state-of-the-art models are very complex and may not be the best fit for different datasets. A promising approach, known as Automated Machine Learning (AutoML), can reduce the domain expertise required to develop custom DL models by automating the ML pipeline key components, namely hyperparameter optimization and neural architecture search (NAS). AutoML reduces the amount of human trial-and-error involved in designing DL models, and in more recent implementations can find new model architectures with relatively low computational overhead. Research on the feasibility of using AutoML for malware detection is very limited. This work provides a comprehensive analysis and insights on using AutoML for both static and online malware detection. For static, our analysis is performed on two widely used malware datasets: SOREL-20M to demonstrate efficacy on large datasets; and EMBER-2018, a smaller dataset specifically curated to hinder the performance of machine learning models. In addition, we show the effects of tuning the NAS process parameters on finding a more optimal malware detection model on these static analysis datasets. Further, we also demonstrate that AutoML is performant in online malware detection scenarios using Convolutional Neural Networks (CNNs) for cloud IaaS. We compare an AutoML technique to six existing state-of-the-art CNNs using a newly generated online malware dataset with and without other applications running in the background during malware execution. We show that the AutoML technique is more performant than the state-of-the-art CNNs with little overhead in finding the architecture. In general, our experimental results show that the performance of AutoML based static and online malware detection models are on par or even better than state-of-the-art models or hand-designed models presented in literature.

AutoML: A survey of the state-of-the-art

Automated Machine Learning: From Principles to Practices

Advances in neural architecture search

Techniques for Automated Machine Learning

Taking Human out of Learning Applications: A Survey on Automated Machine Learning.

AutoML: state of the art with a focus on anomaly detection, challenges, and research directions

A Comprehensive Survey of Neural Architecture Search: Challenges and Solutions

A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Tasks

Mastering AI: Big Data, Deep Learning, and the Evolution of Large Language Models -- AutoML from Basics to State-of-the-Art Techniques

Neural Architecture Search Survey: A Computer Vision Perspective

On the Security Risks of AutoML

Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows

AutoML from Software Engineering Perspective: Landscapes and Challenges

Automated machine learning for deep learning based malware detection

Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture

AutoML for Deep Recommender Systems: A Survey

Benchmark and Survey of Automated Machine Learning Frameworks

Assessing the Use of AutoML for Data-Driven Software Engineering

Efficient Automation of Neural Network Design: A Survey on Differentiable Neural Architecture Search

Automated Machine Learning on Graphs: A Survey

A Survey of Deep Learning Techniques for Autonomous Driving