Abstract:Complex question answering (CQA) over knowledge bases(KB) is a challenging task that has attracted increasing attention in recent years. Semantic parsing-based methods face challenges such as poor adaptability for incomplete KB, large search spaces, and high costs to label logic forms. The gap between knowledge graph representations and question token embeddings leads to poor generalizability and uninterpretable reasoning of information retrieval-based methods. We propose an interpretable and scalable system called Predict, Pretrained, Select and Answer (PPSA) to solve CQA tasks over KB. Our system first trains a language model to predict the reasoning paths required to answer questions. We select only the entities that the predicted reasoning paths pass through in the knowledge graph as candidate entities to reduce the amount of distracting information. The paths that connect the topic entity and the selected candidate entity along with the question are then fed into another language model for answer prediction. The answer prediction module loads the parameters of the trained path prediction module before training to improve accuracy. The system reduces the search space by predicting the path and does not need expensive logic forms annotation. The textual path is the input to the language model, which bridges the gap between the graph representations and token embeddings. We analyse the system reasoning ability over knowledge graphs with different degrees of sparseness, and evaluate the system generalizability. The results of experiments performed with the Complex WebQuestions and WebQuestionsSP datasets demonstrate the effectiveness of our approach for CQA task.

ReLMKG: Reasoning with Pre-Trained Language Models and Knowledge Graphs for Complex Question Answering

Retrieval and Reasoning on KGs: Integrate Knowledge Graphs into Large Language Models for Complex Question Answering

Efficient Question Answering Based on Language Models and Knowledge Graphs

ReasoningLM: Enabling Structural Subgraph Reasoning in Pre-trained Language Models for Question Answering over Knowledge Graph

Knowledge Graph-augmented Language Models for Complex Question Answering

keqing: knowledge-based question answering is a nature chain-of-thought mentor of LLM

Gs-Cbr-Kbqa: Graph-Structured Case-Based Reasoning for Knowledge Base Question Answering

A Method for Complex Question-Answering over Knowledge Graph

A Framework of Knowledge Graph-Enhanced Large Language Model Based on Question Decomposition and Atomic Retrieval

Interactive-KBQA: Multi-Turn Interactions for Knowledge Base Question Answering with Large Language Models

Multi-hop Question Answering over Knowledge Graphs using Large Language Models

Retrieve-Rewrite-Answer: A KG-to-Text Enhanced LLMs Framework for Knowledge Graph Question Answering

Structured Knowledge Grounding for Question Answering

LLM-based Discriminative Reasoning for Knowledge Graph Question Answering

Question-Directed Reasoning with Relation-Aware Graph Attention Network for Complex Question Answering over Knowledge Graph

JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering

Augmenting Reasoning Capabilities of LLMs with Graph Structures in Knowledge Base Question Answering

EffiQA: Efficient Question-Answering with Strategic Multi-Model Collaboration on Knowledge Graphs

Knowledge Graph Question Answering with semantic oriented fusion model.

Enhancing Large Language Models with Knowledge Graphs for Robust Question Answering

Predict, Pretrained, Select and Answer: Interpretable and Scalable Complex Question Answering over Knowledge Bases.