Pre-Service Teachers' Assessment of ChatGPT's Utility in Higher Education: SWOT and Content Analysis

Angelos Markos,Jim Prentzas,Maretta Sidiropoulou

DOI: https://doi.org/10.3390/electronics13101985

IF: 2.9

2024-05-20

Electronics

Abstract:ChatGPT (GPT-3.5), an intelligent Web-based tool capable of conducting text-based conversations akin to human interaction across various subjects, has recently gained significant popularity. This surge in interest has led researchers to examine its impact on numerous fields, including education. The aim of this paper is to investigate the perceptions of undergraduate students regarding ChatGPT's utility in academic environments, focusing on its strengths, weaknesses, opportunities, and threats. It responds to emerging challenges in educational technology, such as the integration of artificial intelligence in teaching and learning processes. The study involved 257 students from two university departments in Greece—namely primary and early childhood education pre-service teachers. Data were collected using a structured questionnaire. Various methods were employed for data analysis, including descriptive statistics, inferential analysis, K-means clustering, and decision trees. Additional insights were obtained from a subset of students who undertook a project in an elective course, detailing the types of inquiries made to ChatGPT and their reasons for recommending (or not recommending) it to their peers. The findings offer valuable insights for tutors, researchers, educational policymakers, and ChatGPT developers. To the best of the authors' knowledge, these issues have not been dealt with by other researchers.

engineering, electrical & electronic,computer science, information systems,physics, applied

What problem does this paper attempt to address?

### Problems the Paper Aims to Address

This paper aims to explore pre-service teachers' (i.e., future teachers) perceptions of the application of ChatGPT in higher education, focusing on analyzing its strengths, weaknesses, opportunities, and threats (SWOT analysis). Specifically:

1. **Assessment of ChatGPT's Application**: The study evaluates how undergraduates perceive the application of ChatGPT in academic settings, including its advantages in text correction, task response, and rewriting; disadvantages such as the effectiveness, originality, and potential biases of the information; opportunities to enhance academic experiences through research experiments, collaborative projects, and creative expression; and threats to traditional teaching methods, critical thinking, and interpersonal interactions.

2. **Impact of Familiarity**: It explores how students' familiarity with ChatGPT influences their perceptions of its strengths, weaknesses, opportunities, and threats.

3. **Identification of Group Characteristics**: It identifies whether specific student groups exhibit different SWOT perspectives based on their familiarity and interaction levels with ChatGPT.

4. **Impact of Various Factors**: It investigates how undergraduates' perceptions of ChatGPT's strengths, weaknesses, opportunities, and threats vary due to different factors and identifies key factors influencing their overall evaluation.

5. **Main Query Content**: It examines the topics and queries that undergraduates (pre-service teachers) pose to ChatGPT.

6. **Reasons for Recommendation**: It explores the main reasons why undergraduates would recommend ChatGPT to their peers.

The study conducted a survey of 257 undergraduates from the School of Education at Democritus University of Thrace, Greece, using various data analysis methods such as descriptive statistics, inferential analysis, K-means clustering, and decision trees, aiming to provide valuable insights into the application of ChatGPT in the educational field.