Abstract:In the modern era of rapidly increasing data volumes, accurately retrieving and recommending relevant documents has become crucial in enhancing the reliability of Question Answering (QA) systems. Recently, Retrieval Augmented Generation (RAG) has gained significant recognition for enhancing the capabilities of large language models (LLMs) by mitigating hallucination issues in QA systems, which is particularly beneficial in the legal domain. Various methods, such as semantic search using dense vector embeddings or a combination of multiple techniques to improve results before feeding them to LLMs, have been proposed. However, these methods often fall short when applied to the Vietnamese language due to several challenges, namely inefficient Vietnamese data processing leading to excessive token length or overly simplistic ensemble techniques that lead to instability and limited improvement. Moreover, a critical issue often overlooked is the ordering of final relevant documents which are used as reference to ensure the accuracy of the answers provided by LLMs. In this report, we introduce our three main modifications taken to address these challenges. First, we explore various practical approaches to data processing to overcome the limitations of the embedding model. Additionally, we enhance Reciprocal Rank Fusion by normalizing order to combine results from keyword and vector searches effectively. We also meticulously re-rank the source pieces of information used by LLMs with Active Retrieval to improve user experience when refining the information generated. In our opinion, this technique can also be considered as a new re-ranking method that might be used in place of the traditional cross encoder. Finally, we integrate these techniques into a comprehensive QA system, significantly improving its performance and reliability

Building a Vietnamese Language Query Processing Framework for ELibrary Searching Systems

Document Searching System based on Natural Language Query Processing for Vietnam Open Courseware Library

Development and Evaluation of Task-Specific NLP Framework in China.

Vietnamese Legal Information Retrieval in Question-Answering System

Research and Implementation of Intelligent Search Engine Based on Ontology in Parts-Library

Intelligent search system for resume and labor law

A Vietnamese information retrieval system for product-price

Building a Semantic Role Labelling System for Vietnamese

Adapting Corpus Linguistics for Primary EFL Education in Vietnam: Perspectives from Linguistics Scholars

Towards Comprehensive Vietnamese Retrieval-Augmented Generation and Large Language Models

A Vietnamese Text-Based Conversational Agent

BERT-VBD: Vietnamese Multi-Document Summarization Framework

A Hidden Topic-Based Framework toward Building Applications with Short Web Documents

VLSP 2023 -- LTER: A Summary of the Challenge on Legal Textual Entailment Recognition

ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models

Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives

Building a Natural Language Interface for FHIR Clinical Terminology Server

Using TBLT Framework in Technology-mediated Environments to Enhance Students’ Vocabulary Retention and Interpreting Skills

Research and Development of Java based User Interface Component Library in Digital Library

Improving Vietnamese Legal Document Retrieval using Synthetic Data

VAIS ASR: Building a conversational speech recognition system using language model combination