Abstract:In the modern era of rapidly increasing data volumes, accurately retrieving and recommending relevant documents has become crucial in enhancing the reliability of Question Answering (QA) systems. Recently, Retrieval Augmented Generation (RAG) has gained significant recognition for enhancing the capabilities of large language models (LLMs) by mitigating hallucination issues in QA systems, which is particularly beneficial in the legal domain. Various methods, such as semantic search using dense vector embeddings or a combination of multiple techniques to improve results before feeding them to LLMs, have been proposed. However, these methods often fall short when applied to the Vietnamese language due to several challenges, namely inefficient Vietnamese data processing leading to excessive token length or overly simplistic ensemble techniques that lead to instability and limited improvement. Moreover, a critical issue often overlooked is the ordering of final relevant documents which are used as reference to ensure the accuracy of the answers provided by LLMs. In this report, we introduce our three main modifications taken to address these challenges. First, we explore various practical approaches to data processing to overcome the limitations of the embedding model. Additionally, we enhance Reciprocal Rank Fusion by normalizing order to combine results from keyword and vector searches effectively. We also meticulously re-rank the source pieces of information used by LLMs with Active Retrieval to improve user experience when refining the information generated. In our opinion, this technique can also be considered as a new re-ranking method that might be used in place of the traditional cross encoder. Finally, we integrate these techniques into a comprehensive QA system, significantly improving its performance and reliability

Document Searching System based on Natural Language Query Processing for Vietnam Open Courseware Library

Building a Vietnamese Language Query Processing Framework for ELibrary Searching Systems

Vietnamese Legal Information Retrieval in Question-Answering System

Intelligent search system for resume and labor law

A Question-Answering System over Traditional Chinese Medicine

Building a Semantic Role Labelling System for Vietnamese

SPBERTQA: A Two-Stage Question Answering System Based on Sentence Transformers for Medical Texts

A Semantic Search System for Pharmaceutical Manufacturing in Traditional Chinese Medicine

A Chinese Intelligent Question Answering System Based on Domain Ontology and Sentence Templates

E-learning Support System Aided by VSM Based Question Answering System

R2GQA: Retriever-Reader-Generator Question Answering System to Support Students Understanding Legal Regulations in Higher Education

A Vietnamese Text-Based Conversational Agent

Quda: Natural Language Queries for Visual Data Analytics

Building a Vietnamese question answering system based on knowledge graph and distributed CNN

Vietnamese Text Classification Algorithm using Long Short Term Memory and Word2Vec

A Vietnamese information retrieval system for product-price

Using Natural Language to Access Databases on the Web.

Knowledge Management for Information Querying System in Education via the Combination of Rela-Ops Model and Knowledge Graph

Towards a Natural Language Query Processing System

Developing a Semantic Question Answering System for E-learning Environments using Linguistic Resources

QUASE: AN Ontology-Based Domain Specific Natural Language Question Answering System