Abstract:This paper describes how recent advancements in the field of Generative AI (GenAI), and more specifically large language models (LLMs), are incorporated into a practical application that solves the widespread and relevant business problem of information retrieval from textual data in PDF format: searching through legal texts, financial reports, research articles and so on. Marketing research, for example, often requires reading through hundreds of pages of financial reports to extract key information for research on competitors, partners, markets and prospective clients. It is a manual, error-prone and time-consuming task for marketers, where until recently there was little scope for automation, optimisation and scaling. The application we have developed combines LLMs with a retrieval augmented generation (RAG) architecture and prompt engineering to make this process more efficient. We have developed a chatbot that allows the user to upload multiple PDF documents and obtain a summary of predefined key areas as well as to ask specific questions and get answers from the combined documents’ content. The application’s architecture begins with the creation of an index for each of the PDF files. This index includes embedding the textual content and constructing a vector store. A query engine, employing a small-to-big retrieval method, is then used to accurately respond to a set of predefined questions for each PDF to create the summary. The prompt has been designed in a manner that minimises the risk of hallucination which is common in this type of model. The user interacts with the model via a chatbot feature. It utilises similar small-to-big retrieval techniques over the indices for straightforward queries, and a more complex sub-questions engine for in-depth analysis, providing a comprehensive and interactive tool for document analysis. We have estimated that the implementation of this tool would reduce the time spent on manual research tasks by around 60 per cent, based on the discussions we have had with potential users.

DocuBot : Generating financial reports using natural language interactions

Doc2Bot: Accessing Heterogeneous Documents via Conversational Bots

AI-Powered Legal Documentation Assistant

Virtual Bank Assistance: An AI Based Voice BOT for Better Banking

Et Machina: Exploring the Use of Conversational Agents Such as ChatGPT in Scientific Writing

A Conversational Digital Assistant for Intelligent Process Automation

Empowering Financial Peace through Chatbot Guidance

Robodoc: a conversational-AI based app for medical conversations

Development of a Legal Document AI-Chatbot

Efficient Deployment of Conversational Natural Language Interfaces over Databases

Information retrieval from textual data: Harnessing large language models, retrieval augmented generation and prompt engineering

Virtual Bot Powered by Machine Learning and NLP Technologies: Emulating Human-Like Conversations through Speech-to-Text Conversions

FinRobot: AI Agent for Equity Research and Valuation with Large Language Models

Document Automation Using Artificial Intelligence

Optimizing Structured Data Processing through Robotic Process Automation

Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

Improving Clinical Documentation with AI: A Comparative Study of Sporo AI Scribe and GPT-4o mini

Understanding Questions that Arise When Working with Business Documents

KNIMEZoBot: Enhancing Literature Review with Zotero and KNIME OpenAI Integration using Retrieval-Augmented Generation

Unveiling AI-Generated Financial Text: A Computational Approach Using Natural Language Processing and Generative Artificial Intelligence

Revolutionizing Student Engagement and Enrollment through Personalized, AI-Driven Dialog Systems in Higher Education