Studying the Characteristics of AIOps Projects on GitHub

Roozbeh Aghili,Heng Li,Foutse Khomh

2023-09-06

Abstract:Artificial Intelligence for IT Operations (AIOps) leverages AI approaches to handle the massive amount of data generated during the operations of software systems. Prior works have proposed various AIOps solutions to support different tasks in system operations and maintenance, such as anomaly detection. In this study, we conduct an in-depth analysis of open-source AIOps projects to understand the characteristics of AIOps in practice. We first carefully identify a set of AIOps projects from GitHub and analyze their repository metrics (e.g., the used programming languages). Then, we qualitatively examine the projects to understand their input data, analysis techniques, and goals. Finally, we assess the quality of these projects using different quality metrics, such as the number of bugs. To provide context, we also sample two sets of baseline projects from GitHub: a random sample of machine learning projects and a random sample of general-purposed projects. By comparing different metrics between our identified AIOps projects and these baselines, we derive meaningful insights. Our results reveal a recent and growing interest in AIOps solutions. However, the quality metrics indicate that AIOps projects suffer from more issues than our baseline projects. We also pinpoint the most common issues in AIOps approaches and discuss potential solutions to address these challenges. Our findings offer valuable guidance to researchers and practitioners, enabling them to comprehend the current state of AIOps practices and shed light on different ways of improving AIOps' weaker aspects. To the best of our knowledge, this work marks the first attempt to characterize open-source AIOps projects.

Software Engineering

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to study the characteristics of AIOps (Artificial Intelligence for IT Operations) projects on GitHub and compare them with traditional machine learning projects and general projects. Specifically:

1. **Understanding the Current State**: Understand the characteristics of AIOps in practical applications by analyzing open-source AIOps projects.
2. **Input Data, Analysis Techniques, and Goals**: Qualitatively examine the types of input data, analysis techniques, and goals used in these projects.
3. **Quality Assessment**: Evaluate the quality of these projects using different quality metrics, such as the number of bugs.

By comparing AIOps projects with two benchmarks (randomly selected machine learning projects and general projects), the paper reveals the growth trends and existing issues of AIOps solutions in recent years and proposes potential improvements. This is the first systematic study of open-source AIOps projects.