Generative AI Chatbots - ChatGPT versus YouChat versus Chatsonic: Use Cases of Selected Areas of Applied English Language Studies

Chaka Chaka
DOI: https://doi.org/10.26803/ijlter.22.6.1
2023-06-30
Abstract:This paper reports on the comparison of the accuracy and quality of the responses produced by the three artificial intelligence (AI) chatbots, ChatGPT, YouChat, and Chatsonic, based on the prompts (use cases) related to selected areas of applied English language studies (AELS). An exploratory research design was employed and we utilised purposive sampling. The three aforementioned AI chatbots were used to collect data sets. Of the three chatbots, YouChat was technically unstable and unreliable, and had some inconsistency in generating responses. The other two chatbots, ChatGPT and Chatsonic, consistently exhibited a tendency to plagiarise responses from internet information without acknowledging the sources. In certain cases, the three chatbots all generated almost similar responses for different and unrelated prompts. This made their responses look like run-of-the-mill responses that lacked credibility, accuracy, and quality. One chatbot (ChatGPT) could not recognise a scholar mentioned in one of the prompts, while the other one (Chatsonic) misrecognised this scholar, and ended up rambling parts of its response. Additionally, the three chatbots all mechanically and superficially generated phrases and ideas in their responses without detecting the related critical nuances in the original sources in which they were used. This made the knowledge communicated by those responses appearing too fluffy. In this paper the educational and knowledge implications of the generated responses for AELS were educed. Based on the shortcomings the three AI chatbots displayed, I concluded that these three chatbots are not yet credible and reliable generators of knowledge for the aspects of AELS discussed.
What problem does this paper attempt to address?