Abstract:Large Language Models (LLMs) are pre-trained on large-scale corpora and excel in numerous general natural language processing (NLP) tasks, such as question answering (QA). Despite their advanced language capabilities, when it comes to domain-specific and knowledge-intensive tasks, LLMs suffer from hallucinations, knowledge cut-offs, and lack of knowledge attributions. Additionally, fine tuning LLMs' intrinsic knowledge to highly specific domains is an expensive and time consuming process. The retrieval-augmented generation (RAG) process has recently emerged as a method capable of optimization of LLM responses, by referencing them to a predetermined ontology. It was shown that using a Knowledge Graph (KG) ontology for RAG improves the QA accuracy, by taking into account relevant sub-graphs that preserve the information in a structured manner. In this paper, we introduce SMART-SLIC, a highly domain-specific LLM framework, that integrates RAG with KG and a vector store (VS) that store factual domain specific information. Importantly, to avoid hallucinations in the KG, we build these highly domain-specific KGs and VSs without the use of LLMs, but via NLP, data mining, and nonnegative tensor factorization with automatic model selection. Pairing our RAG with a domain-specific: (i) KG (containing structured information), and (ii) VS (containing unstructured information) enables the development of domain-specific chat-bots that attribute the source of information, mitigate hallucinations, lessen the need for fine-tuning, and excel in highly domain-specific question answering tasks. We pair SMART-SLIC with chain-of-thought prompting agents. The framework is designed to be generalizable to adapt to any specific or specialized domain. In this paper, we demonstrate the question answering capabilities of our framework on a corpus of scientific publications on malware analysis and anomaly detection.

Materializing and Querying Learned Knowledge

Towards Machine Learning on the Semantic Web

Multivariate Prediction for Learning on the Semantic Web

Quantum Machine Learning Algorithm for Knowledge Graphs

SPARQL as a Foreign Language

A Scalable Approach for Statistical Learning in Semantic Graphs

Revealing Secrets in SPARQL Session Level

HOLMES: Hyper-Relational Knowledge Graphs for Multi-hop Question Answering using LLMs

LLM-based SPARQL Query Generation from Natural Language over Federated Knowledge Graphs

Towards Loosely-Coupling Knowledge Graph Embeddings and Ontology-based Reasoning

Knowledge Graphs Querying

Knowledge Solver: Teaching LLMs to Search for Domain Knowledge from Knowledge Graphs

Domain-Specific Retrieval-Augmented Generation Using Vector Stores, Knowledge Graphs, and Tensor Factorization

Rethinking Complex Queries on Knowledge Graphs with Neural Link Predictors

GIVE: Structured Reasoning with Knowledge Graph Inspired Veracity Extrapolation

Multi-hop Question Answering over Knowledge Graphs using Large Language Models

Bottom-up Anytime Discovery of Generalised Multimodal Graph Patterns for Knowledge Graphs

Semantic search and a new moore's law effect in knowledge engineering.

From human experts to machines: An LLM supported approach to ontology and knowledge graph construction

Semantic TrueLearn: Using Semantic Knowledge Graphs in Recommendation Systems

SPARKLE: Enhancing SPARQL Generation with Direct KG Integration in Decoding