Abstract:Generative commonsense question answering (GenCQA) is a task of automatically generating a list of answers given a question. The answer list is required to cover all reasonable answers. This presents the considerable challenges of producing diverse answers and ranking them properly. Incorporating a variety of closely-related background knowledge into the encoding of questions enables the generation of different answers. Meanwhile, learning to distinguish positive answers from negative ones potentially enhances the probabilistic estimation of plausibility, and accordingly, the plausibility-based ranking. Therefore, we propose a Knowledge Enhancement and Plausibility Ranking (KEPR) approach grounded on the Generate-Then-Rank pipeline architecture. Specifically, we expand questions in terms of Wiktionary commonsense knowledge of keywords, and reformulate them with normalized patterns. Dense passage retrieval is utilized for capturing relevant knowledge, and different PLM-based (BART, GPT2 and T5) networks are used for generating answers. On the other hand, we develop an ELECTRA-based answer ranking model, where logistic regression is conducted during training, with the aim of approximating different levels of plausibility in a polar classification scenario. Extensive experiments on the benchmark ProtoQA show that KEPR obtains substantial improvements, compared to the strong baselines. Within the experimental models, the T5-based GenCQA with KEPR obtains the best performance, which is up to 60.91% at the primary canonical metric Inc@3. It outperforms the existing GenCQA models on the current leaderboard of ProtoQA.

CKBP v2: Better Annotation and Reasoning for Commonsense Knowledge Base Population

Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation

CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm

BB-KBQA: BERT-Based Knowledge Base Question Answering

Building a commonsense knowledge base for context-awareness inference

Commonsense Knowledge Base Completion with Relational Graph Attention Network and Pre-trained Language Model

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

Distinguish Before Answer: Generating Contrastive Explanation As Knowledge for Commonsense Question Answering.

Amplifying Diversity and Quality in Commonsense Knowledge Graph Completion (student Abstract)

Evaluating Commonsense in Pre-trained Language Models

Knowledge-Enhanced Retrieval: A Scheme for Question Answering

KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answering

Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

What Really is Commonsense Knowledge?

CAR: Conceptualization-Augmented Reasoner for Zero-Shot Commonsense Question Answering

Refined Commonsense Knowledge from Large-Scale Web Contents

Knowledge-aware adaptive graph network for commonsense question answering

Robust Commonsense Reasoning Against Noisy Labels Using Adaptive Correction

Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models

A Graph-Guided Reasoning Approach for Open-ended Commonsense Question Answering

Context-Aware Commonsense Knowledge Graph Reasoning with Path-Guided Explanations