Abstract:In the modern era of rapidly increasing data volumes, accurately retrieving and recommending relevant documents has become crucial in enhancing the reliability of Question Answering (QA) systems. Recently, Retrieval Augmented Generation (RAG) has gained significant recognition for enhancing the capabilities of large language models (LLMs) by mitigating hallucination issues in QA systems, which is particularly beneficial in the legal domain. Various methods, such as semantic search using dense vector embeddings or a combination of multiple techniques to improve results before feeding them to LLMs, have been proposed. However, these methods often fall short when applied to the Vietnamese language due to several challenges, namely inefficient Vietnamese data processing leading to excessive token length or overly simplistic ensemble techniques that lead to instability and limited improvement. Moreover, a critical issue often overlooked is the ordering of final relevant documents which are used as reference to ensure the accuracy of the answers provided by LLMs. In this report, we introduce our three main modifications taken to address these challenges. First, we explore various practical approaches to data processing to overcome the limitations of the embedding model. Additionally, we enhance Reciprocal Rank Fusion by normalizing order to combine results from keyword and vector searches effectively. We also meticulously re-rank the source pieces of information used by LLMs with Active Retrieval to improve user experience when refining the information generated. In our opinion, this technique can also be considered as a new re-ranking method that might be used in place of the traditional cross encoder. Finally, we integrate these techniques into a comprehensive QA system, significantly improving its performance and reliability

Towards Comprehensive Vietnamese Retrieval-Augmented Generation and Large Language Models

LaVy: Vietnamese Multimodal Large Language Model

Retrieval-Augmented Generation for Large Language Models: A Survey

Data Augmentation with Large Language Models for Vietnamese Abstractive Text Summarization

Crossing Linguistic Horizons: Finetuning and Comprehensive Evaluation of Vietnamese Large Language Models

A Survey on Retrieval-Augmented Text Generation for Large Language Models

Evaluating Large Language Model Capability in Vietnamese Fact-Checking Data Generation

Development and Testing of Retrieval Augmented Generation in Large Language Models -- A Case Study Report

Vi-Mistral-X: Building a Vietnamese Language Model with Advanced Continual Pre-training

ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models

Retrieval-Augmented Generation for Natural Language Processing: A Survey

Metadata-based Data Exploration with Retrieval-Augmented Generation for Large Language Models

Vietnamese AI Generated Text Detection

Vietnamese Legal Information Retrieval in Question-Answering System

A Novel Pretrained General-Purpose Vision Language Model for the Vietnamese Language

A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models

VisRAG: Vision-based Retrieval-augmented Generation on Multi-modality Documents

RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing

Embedding-Informed Adaptive Retrieval-Augmented Generation of Large Language Models

ViDeBERTa: A powerful pre-trained language model for Vietnamese