Navigating the Complexity of Generative AI Adoption in Software Engineering

Daniel Russo

DOI: https://doi.org/10.1145/3652154

IF: 3.685

2024-03-28

ACM Transactions on Software Engineering and Methodology

Abstract:This paper explores the adoption of Generative Artificial Intelligence (AI) tools within the domain of software engineering, focusing on the influencing factors at the individual, technological, and social levels. We applied a convergent mixed-methods approach to offer a comprehensive understanding of AI adoption dynamics. We initially conducted a questionnaire survey with 100 software engineers, drawing upon the Technology Acceptance Model (TAM), the Diffusion of Innovation Theory (DOI), and the Social Cognitive Theory (SCT) as guiding theoretical frameworks. Employing the Gioia Methodology, we derived a theoretical model of AI adoption in software engineering: the Human-AI Collaboration and Adaptation Framework (HACAF). This model was then validated using Partial Least Squares – Structural Equation Modeling (PLS-SEM) based on data from 183 software engineers. Findings indicate that at this early stage of AI integration, the compatibility of AI tools within existing development workflows predominantly drives their adoption, challenging conventional technology acceptance theories. The impact of perceived usefulness, social factors, and personal innovativeness seems less pronounced than expected. The study provides crucial insights for future AI tool design and offers a framework for developing effective organizational implementation strategies.

computer science, software engineering

What problem does this paper attempt to address?

The problem that this paper attempts to solve is what factors influence the adoption of generative artificial intelligence (Generative AI) tools in the field of software engineering. Specifically, the paper explores the factors that influence the adoption of generative AI tools at the individual, technical, and social levels. Through questionnaire surveys and theoretical modeling methods, the research aims to provide a comprehensive understanding framework to explain why software engineers will or will not adopt these tools and the driving factors behind these decisions.

The research question of the paper can be summarized as: "What factors influence the adoption of generative AI tools in software engineering?"

To answer this question, the author adopted a mixed - methods research design, combining quantitative and qualitative data collection and analysis methods. First, the research constructed a theoretical framework based on the Technology Acceptance Model (TAM), the Diffusion of Innovations theory (DOI), and the Social Cognitive Theory (SCT). Subsequently, data from 100 software engineers were collected through a questionnaire survey, and a preliminary theoretical model - the Human - Machine Collaboration and Adaptation Framework (HACAF) - was developed using the Gioia methodology. Finally, data collected from 183 software engineers were verified using the Partial Least Squares Structural Equation Modeling (PLS - SEM) to confirm the validity of the model.

The research found that in the early integration stage of generative AI tools, the compatibility of these tools with existing development workflows is the main driving force for their adoption, while the influence of perceived usefulness, social factors, and individual innovativeness is not as significant as expected. These findings are of great significance for guiding the future design of AI tools and the formulation of implementation strategies at the organizational level.