AI‐Augmented Software Engineering: Revolutionizing or Challenging Software Quality and Testing?
Tafline Ramos,Amanda Dean,David McGregor
DOI: https://doi.org/10.1002/smr.2741
2024-11-27
Journal of Software Evolution and Process
Abstract:With organizations seeking faster, cheaper, smarter ways of delivering higher quality software, many are looking towards generative artificial intelligence (AI) to drive efficiencies and innovation throughout the software development lifecycle. In this position paper, we examine the application of Quality Engineering to AI systems, including shortcomings in existing AI quality models, and proposing extensions to those models based on an industry survey. We also reflect on skills IT graduates may need in the future, to support delivery of higher‐quality AI. With organizations seeking faster, cheaper, and smarter ways of delivering higher quality software, many are looking towards generative artificial intelligence (AI) to drive efficiencies and innovation throughout the software development lifecycle. However, generative AI can suffer from several fundamental issues, including a lack of traceability in concept generation and decision‐making, the potential for making incorrect inferences (hallucinations), shortcomings in response quality, and bias. Quality engineering (QE) has long been utilized to enable more efficient and effective delivery of higher quality software. A core aspect of QE is adopting quality models to support various lifecycle practices, including requirements definition, quality risk assessments, and testing. In this position paper, we introduce the application of QE to AI systems, consider shortcomings in existing AI quality models from the International Organization for Standardization (ISO), and propose extensions to ISO models based on the results of a survey. We also reflect on skills that IT graduates may need in the future, to support delivery of better‐quality AI.
computer science, software engineering