Comuniqa : Exploring Large Language Models for improving speaking skills

Manas Mhasakar,Shikhar Sharma,Apurv Mehra,Utkarsh Venaik,Ujjwal Singhal,Dhruv Kumar,Kashish Mittal
2024-05-14
Abstract:In this paper, we investigate the potential of Large Language Models (LLMs) to improve English speaking skills. This is particularly relevant in countries like India, where English is crucial for academic, professional, and personal communication but remains a non-native language for many. Traditional methods for enhancing speaking skills often rely on human experts, which can be limited in terms of scalability, accessibility, and affordability. Recent advancements in Artificial Intelligence (AI) offer promising solutions to overcome these limitations.
Human-Computer Interaction,Computers and Society
What problem does this paper attempt to address?
The paper attempts to address the issue of how to leverage large language models (LLMs) to improve English speaking skills in non-native English-speaking countries, such as India. Specifically, the paper focuses on: 1. **Limitations of Traditional Methods**: Traditional methods for improving English speaking skills typically rely on human experts, but these methods have limitations in terms of scalability, accessibility, and cost-effectiveness. This is especially true in countries like India, where English is crucial for academic, professional, and personal communication but remains a second language for many. 2. **Potential of AI Solutions**: In recent years, advancements in artificial intelligence technology have provided new possibilities for overcoming the aforementioned limitations. The paper proposes a system based on large language models—Comuniqa—aimed at enhancing English speaking skills by offering scalable, accessible, and personalized learning experiences. 3. **Evaluation and Comparison**: The paper employs a user-centered evaluation approach, dividing participants into 3 groups for the experiment: - The first group uses only the LLM-based system (Comuniqa application) to improve speaking skills. - The second group is guided solely by human experts to improve speaking skills. - The third group uses both the LLM-based system and human experts. Through surveys, interviews, and actual learning sessions, the paper provides a detailed analysis of the effectiveness of different learning modes and explores the respective advantages and disadvantages of LLM systems and human experts. Overall, the paper aims to explore the potential of large language models in improving English speaking skills and to provide a valuable tool for achieving Sustainable Development Goal 4 (Quality Education), particularly for those who do not have access to human expert guidance.