R^3AG: First Workshop on Refined and Reliable Retrieval Augmented Generation

Zihan Wang,Xuri Ge,Joemon M. Jose,Haitao Yu,Weizhi Ma,Zhaochun Ren,Xin Xin

2024-10-28

Abstract:Retrieval-augmented generation (RAG) has gained wide attention as the key component to improve generative models with external knowledge augmentation from information retrieval. It has shown great prominence in enhancing the functionality and performance of large language model (LLM)-based applications. However, with the comprehensive application of RAG, more and more problems and limitations have been identified, thus urgently requiring further fundamental exploration to improve current RAG frameworks. This workshop aims to explore in depth how to conduct refined and reliable RAG for downstream AI tasks. To this end, we propose to organize the first R3AG workshop at SIGIR-AP 2024 to call for participants to re-examine and formulate the basic principles and practical implementation of refined and reliable RAG. The workshop serves as a platform for both academia and industry researchers to conduct discussions, share insights, and foster research to build the next generation of RAG systems. Participants will engage in discussions and presentations focusing on fundamental challenges, cutting-edge research, and potential pathways to improve RAG. At the end of the workshop, we aim to have a clearer understanding of how to improve the reliability and applicability of RAG with more robust information retrieval and language generation.

Information Retrieval

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: how to conduct more refined and reliable Retrieval - Augmented Generation (RAG) to address the challenges and limitations existing in the current RAG framework.

Specifically, RAG combines the advantages of Information Retrieval (IR) and Large Language Models (LLMs), aiming to improve the response quality of the generation model through the enhancement of external knowledge bases. However, with the wide application of RAG technology, more and more problems and limitations have been identified, and further fundamental exploration is required to improve the existing RAG framework.

These problems include, but are not limited to:
1. **User Intent Understanding**: Understanding the user's query intent in the context of long - conversations.
2. **Complex Document Parsing**: Handling complex documents containing tables and charts.
3. **Reliable Knowledge Retrieval**: Ensuring that the retrieved information is accurate and free of noise or contradictions.
4. **Response Generation and Optimization**: Generating high - quality, accurate and coherent responses.
5. **Multimodal RAG**: Extending RAG technology to support other modalities besides text (such as images, videos, etc.).

To address these challenges, the paper proposes to organize the first R3AG workshop (SIGIR - AP 2024), inviting experts from academia and industry to jointly discuss and formulate the basic principles and practical implementation methods of RAG, and promote the research and development of the next - generation RAG systems.