A Survey on Conversational AI Question answering System for Low Resource Language

Dr Sanjeevkumar Angadi,Deepti A Chaudhari,Dr. Rahul Shrivastava
DOI: https://doi.org/10.52783/jes.3240
2024-05-02
Abstract:Question-and-answer (QA) systems allow users to pose questions about the information accessible in a variety of formats, such as structured and unstructured information in natural languages. It contributes significantly to conversational artificial intelligence (AI), which has led to the creation of a novel research field on conversational question answering (CQA), in which a system is required to understand the provided context before engaging in multi-turn QA to satisfy a user's informational needs. While the majority of currently done research focuses on single-turn QA, pre-trained language models and the availability of large multi-turn QA datasets have recently made multi-turn QA more significant. This study aims to give a thorough analysis of the most recent CQA research trends, mostly based on publications that have been reviewed in recent years. Our data indicates a shift in the industry's preference for multi-turn QA over single-turn QA, which has numerous advantages for conversational AI. In order to create a solid basis for the field of CQA, this survey aims to serve as the pinnacle for the research community.
Linguistics,Computer Science
What problem does this paper attempt to address?
The paper attempts to address the application and development of low-resource languages (such as minority languages or languages with fewer resources) in conversational question answering (CQA) systems. Specifically, the paper aims to analyze and summarize current research trends in conversational question answering systems, particularly the advantages and challenges of multi-turn QA in low-resource language environments. The paper also explores how to leverage pre-trained language models and large-scale multi-turn QA datasets to enhance the performance of conversational question answering systems in low-resource languages. ### Main Research Questions: 1. **The current state of development of conversational question answering systems in low-resource languages**: The paper analyzes the current application of conversational question answering systems in low-resource languages, pointing out that most research focuses on single-turn QA, while multi-turn QA has greater potential in low-resource languages. 2. **Advantages of multi-turn QA**: The paper emphasizes the importance of multi-turn QA in conversational AI, particularly in understanding context, reasoning, and providing continuous user information support. 3. **Technical challenges**: The paper discusses the technical challenges of achieving efficient conversational question answering systems in low-resource language environments, including data scarcity, the complexity of language understanding, and generation. 4. **Solutions**: The paper proposes methods such as cross-lingual transfer learning to improve the performance of conversational question answering systems in low-resource languages. ### Research Objectives: - **Provide a comprehensive literature review**: Summarize the current research progress of conversational question answering systems through a review of relevant literature in recent years. - **Analyze the trends of multi-turn QA**: Explore the application prospects of multi-turn QA in low-resource languages and its advantages over single-turn QA. - **Propose future research directions**: Provide guidance and suggestions for further research on conversational question answering systems in low-resource languages. Through this research, the paper aims to provide a theoretical foundation and technical support for the development of conversational question answering systems in low-resource languages, promoting progress in this field.