Validating an Instrument for Teachers' Acceptance of Artificial Intelligence in Education

Shuchen Guo,Lehong Shi,Xiaoming Zhai
2024-06-15
Abstract:As artificial intelligence (AI) receives wider attention in education, examining teachers' acceptance of AI (TAAI) becomes essential. However, existing instruments measuring TAAI reported limited reliability and validity evidence and faced some design challenges, such as missing informed definitions of AI to participants. This study aimed to develop and validate a TAAI instrument, with providing sufficient evidence for high psychometric quality. Based on the literature, we first identified five dimensions of TAAI, including perceived usefulness, perceived ease of use, behavioral intention, self-efficacy, and anxiety, and then developed items to assess each dimension. We examined the face and content validity using expert review and think-aloud with pre-service teachers. Using the revised instrument, we collected responses from 274 pre-service teachers and examined the item discriminations to identify outlier items. We employed the confirmatory factor analysis and Cronbach's alpha to examine the construct validity, convergent validity, discriminant validity, and reliability. Results confirmed the dimensionality of the scale, resulting in 27 items distributed in five dimensions. The study exhibits robust validity and reliability evidence for TAAI, thus affirming its usefulness as a valid measurement instrument.
Computers and Society
What problem does this paper attempt to address?
The problem that this paper attempts to solve is to develop and validate an effective tool for measuring teachers' acceptance of artificial intelligence (AI). Specifically, existing tools for assessing teachers' acceptance of AI have some limitations, such as limited evidence of psychometric quality and design challenges, for example, failing to provide sufficient definitions of AI to participants. Therefore, this paper aims to develop and validate a measurement tool for teachers' acceptance of AI (TAAI) by providing sufficient evidence of high psychometric quality. Based on the literature, researchers first identified five dimensions of TAAI, including perceived usefulness, perceived ease of use, behavioral intention, self - efficacy, and anxiety, and developed items to assess each dimension. The face validity and content validity of the items were examined through expert review and the think - aloud method of pre - service teachers. Using the revised tool, responses were collected from 274 pre - service teachers to check the discrimination of items and identify outlier items. Confirmatory factor analysis (CFA) and Cronbach's alpha were used to test the structural validity, convergent validity, discriminant validity, and reliability. The results confirmed the dimensionality of the scale, and finally 27 items distributed across five dimensions were formed. The research shows that this tool has robust validity and reliability evidence in measuring teachers' acceptance of AI, thus affirming its practicality as an effective measurement tool.