Abstract:This paper describes how recent advancements in the field of Generative AI (GenAI), and more specifically large language models (LLMs), are incorporated into a practical application that solves the widespread and relevant business problem of information retrieval from textual data in PDF format: searching through legal texts, financial reports, research articles and so on. Marketing research, for example, often requires reading through hundreds of pages of financial reports to extract key information for research on competitors, partners, markets and prospective clients. It is a manual, error-prone and time-consuming task for marketers, where until recently there was little scope for automation, optimisation and scaling. The application we have developed combines LLMs with a retrieval augmented generation (RAG) architecture and prompt engineering to make this process more efficient. We have developed a chatbot that allows the user to upload multiple PDF documents and obtain a summary of predefined key areas as well as to ask specific questions and get answers from the combined documents’ content. The application’s architecture begins with the creation of an index for each of the PDF files. This index includes embedding the textual content and constructing a vector store. A query engine, employing a small-to-big retrieval method, is then used to accurately respond to a set of predefined questions for each PDF to create the summary. The prompt has been designed in a manner that minimises the risk of hallucination which is common in this type of model. The user interacts with the model via a chatbot feature. It utilises similar small-to-big retrieval techniques over the indices for straightforward queries, and a more complex sub-questions engine for in-depth analysis, providing a comprehensive and interactive tool for document analysis. We have estimated that the implementation of this tool would reduce the time spent on manual research tasks by around 60 per cent, based on the discussions we have had with potential users.

PDF CHAT_BOT USING GENERATIVE AI (LLMS&RAG)

RAG based Chatbot using LLMs

Information retrieval from textual data: Harnessing large language models, retrieval augmented generation and prompt engineering

A Complete Survey on LLM-based AI Chatbots

An LLM-Driven Chatbot in Higher Education for Databases and Information Systems

CHATBOT: A Comprehensive Review of AI

ChatEd: A Chatbot Leveraging ChatGPT for an Enhanced Learning Experience in Higher Education

Large Language Model‐Based Chatbots in Higher Education

Bio-Eng-LMM AI Assist chatbot: A Comprehensive Tool for Research and Education

Battling Botpoop using GenAI for Higher Education: A Study of a Retrieval Augmented Generation Chatbots Impact on Learning

Generative AI in Education

Developing a Retrieval Augmented Generation (RAG) Chatbot App Using Adaptive Large Language Models (LLM) and LangChain Framework

Generative AI: Implications and Applications for Education

An AI-Based Chatbot Using Deep Learning

Beyond Traditional Teaching: The Potential of Large Language Models and Chatbots in Graduate Engineering Education

Walert: Putting Conversational Search Knowledge into Action by Building and Evaluating a Large Language Model-Powered Chatbot

Development of a Legal Document AI-Chatbot

ChatGPT Alternative Solutions: Large Language Models Survey

Gemini MultiPDF Chatbot: Multiple Document RAG Chatbot using Gemini Large Language Model

Q-Module-Bot: A Generative AI-Based Question and Answer Bot for Module Teaching Support

Analysis of Language-Model-Powered Chatbots for Query Resolution in PDF-Based Automotive Manuals