Abstract:Continuous Integration/Continuous Deployment (CI/CD) is fundamental for advanced software development, supporting faster and more efficient delivery of code changes into cloud environments. However, security issues in the CI/CD pipeline remain challenging, and incidents (e.g., DDoS, Bot, Log4j, etc.) are happening over the cloud environments. While plenty of literature discusses static security testing and CI/CD practices, only a few deal with network traffic pattern analysis to detect different cyberattacks. This research aims to enhance CI/CD pipeline security by implementing anomaly detection through AI (Artificial Intelligence) support. The goal is to identify unusual behaviour or variations from network traffic patterns in pipeline and cloud platforms. The system shall integrate into the workflow to continuously monitor pipeline activities and cloud infrastructure. Additionally, it aims to explore adaptive response mechanisms to mitigate the detected anomalies or security threats. This research employed two popular network traffic datasets, CSE-CIC-IDS2018 and CSE-CIC-IDS2017. We implemented a combination of Convolution Neural Network(CNN) and Long Short-Term Memory (LSTM) to detect unusual traffic patterns. We achieved an accuracy of 98.69% and 98.30% and generated log files in different CI/CD pipeline stages that resemble the network anomalies affected to address security challenges in modern DevOps practices, contributing to advancing software security and reliability.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to enhance the security and reliability of software in the continuous integration / continuous deployment (CI/CD) pipeline in the cloud environment. Specifically, the author focuses on how to identify and mitigate abnormal network traffic behaviors or changes in the CI/CD pipeline and cloud platform through artificial intelligence (AI) - based anomaly detection techniques. These abnormal behaviors may include various types of network attacks, such as DDoS, Bot, Log4j, etc., which pose a serious threat to the cloud environment. The main objectives of the paper include: 1. **Develop an anomaly detection system**: Build a system that can identify unusual behaviors or deviations from expected patterns in the CI/CD pipeline and cloud platform. 2. **Integrate into existing workflows**: Integrate this system into the existing CI/CD workflows to continuously monitor pipeline activities and cloud infrastructure. 3. **Explore adaptive response mechanisms**: Research how to automatically respond to detected anomalies or security threats to mitigate their impact. 4. **Improve detection accuracy**: Utilize deep - learning algorithms (such as CNN - LSTM) to improve the accuracy of anomaly detection and reduce the false positive rate. To achieve these goals, the author used two publicly available network traffic data sets (CSE - CIC - IDS2018 and CSE - CIC - IDS2017), carried out extensive data pre - processing and feature selection, and trained a hybrid deep - learning model that combines convolutional neural network (CNN) and long - short - term memory network (LSTM). Eventually, this model was deployed in the Jenkins pipeline to monitor network activities in real - time and generate log files containing network anomaly information. Through these methods, the paper aims to provide solutions for software security and reliability in modern DevOps practices, especially in the cloud environment.

Advancing Software Security and Reliability in Cloud Platforms through AI-based Anomaly Detection