Abstract:Commonsense reasoning is one of the abilities necessary for artificial intelligence to be as intelligent as humans. However, how to make AI understand commonsense has been a problem that has plagued artificial intelligence for more than 60 years. Existing efforts focus more on the means of knowledge acquisition and strive to enrich the capacity of commonsense knowledge (CSK) bases and dimensions of CSK through advanced methods. Unfortunately, this exuberance has obscured a general consideration of CSK, such as how to follow human habits to obtain the most representative knowledge we need to understand the world. In this paper, this representative knowledge is referred to as core CSK. The influence of core CSK is extensive, and it constitutes almost the fundamental element of human life and the most fundamental cognition of the world. Harnessing human curiosity to find solutions to the above problems is an effective and straightforward route. Specifically, we focus on a special corpus to mine core CSK, namely, why-questions. For example, we can harvest “the sky is blue” from “why is the sky blue?”. To this end, we propose a novel method to extract CSK from why-questions, which mainly consist of two modules. The first is a question classification module used to determine whether a question contains CSK. In this module, we propose a classifier based on a one-sided bootstrapping method and design several informative features for the classifier. The second is a crowdsourcing module used to improve the quality of the extracted commonsense. We conduct extensive experiments, and the experimental results show that our method effectively mines CSK from question corpora. Furthermore, statistical analysis demonstrates the feasibility of this curiosity-driven approach, implying that we provide a basic idea for collecting core CSK. Remarkably, today’s outstanding large language models do not have such simple knowledge summarization capabilities, demonstrating the barrier between the excellence of language models and the universality of CSK.

Incorporating Domain Knowledge and Semantic Information into Language Models for Commonsense Question Answering

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

Align, Mask and Select: A Simple Method for Incorporating Commonsense Knowledge into Language Representation Models

A Chinese Intelligent Question Answering System Based on Domain Ontology and Sentence Templates

Parallel Fusion of Graph and Text with Semantic Enhancement for Commonsense Question Answering

Evaluating Commonsense in Pre-trained Language Models

Don’t Ignore the Drive of Curiosity: Rethinking Subtleties Between Universality of Commonsense Knowledge and Excellence of Large Language Models

Intelligent Question Answering in Restricted Domains Using Deep Learning and Question Pair Matching

A Semantic-based Method for Unsupervised Commonsense Question Answering

ALBERT with Knowledge Graph Encoder Utilizing Semantic Similarity for Commonsense Question Answering

LB-KBQA: Large-language-model and BERT based Knowledge-Based Question and Answering System

Deep Learning Approaches to Semantic Relevance Modeling for Chinese Question-Answer Pairs.

Open Domain Question Answering with Character-Level Deep Learning Models.

Commonsense Knowledge Transfer for Pre-trained Language Models

Improving Commonsense Question Answering by Graph-based Iterative Retrieval over Multiple Knowledge Sources

Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering

Open Domain Question Answering Via Semantic Enrichment

Keep Skills in Mind: Understanding and Implementing Skills in Commonsense Question Answering

Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering

Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation

CIKQA: Learning Commonsense Inference with a Unified Knowledge-in-the-loop QA Paradigm