Abstract:Numerical reasoning is pivotal in various artificial intelligence applications, such as natural language processing and recommender systems, where it involves using entities, relations, and attribute values (e.g., weight, length) to infer new factual relations (e.g., the Nile is longer than the Amazon). However, existing approaches encounter two critical challenges in modeling: (1) semantic relevance-the challenge of insufficiently capturing the necessary contextual interactions among entities, relations, and numerical attributes, often resulting in suboptimal inference; and (2) semantic ambiguity-the difficulty in accurately distinguishing ordinal relationships during numerical reasoning, which compromises the generation of high-quality samples and limits the effectiveness of contrastive learning. To address these challenges, we propose the novel Knowledge-Aware Attributes Embedding model (KAAE) for knowledge graph embeddings in numerical reasoning. Specifically, to overcome the challenge of semantic relevance, we introduce a Mixture-of-Experts-Knowledge-Aware (MoEKA) Encoder, designed to integrate the semantics of entities, relations, and numerical attributes into a joint semantic space. To tackle semantic ambiguity, we implement a new ordinal knowledge contrastive learning (OKCL) strategy that generates high-quality ordinal samples from the original data with the aid of ordinal relations, capturing fine-grained semantic nuances essential for accurate numerical reasoning. Experiments on three public benchmark datasets demonstrate the superior performance of KAAE across various attribute value distributions.

Mapping Factoid Adjective Constraints to Existential Restrictions over Knowledge Bases.

An Empirical Study of Representing Adjectives over Knowledge Bases: Approach, Lexicon and Application

KBQA: Learning Question Answering over QA Corpora and Knowledge Bases

Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering

A Semantic Mapping System for Bridging the Gap between Relational Database and Semantic Web

Open Domain Question Answering Via Semantic Enrichment

Learning Representation Mapping for Relation Detection in Knowledge Base Question Answering.

Sweet Apple, company? or food? Adjective-centric commonsense knowledge acquisition with taxonomy-guided induction

Novel Knowledge-Based System with Relation Detection and Textual Evidence for Question Answering Research.

Predicting the uncertainty of sentiment adjectives in indirect answers.

Temporality-enhanced Knowledgememory Network for Factoid Question Answering

Improving Complex Knowledge Base Question Answering Via Structural Information Learning

Domain Adaptive Question Answering over Knowledge Base.

Lexicalization Is All You Need: Examining the Impact of Lexical Knowledge in a Compositional QALD System

An In-Context Schema Understanding Method for Knowledge Base Question Answering

KAAE: Numerical Reasoning for Knowledge Graphs via Knowledge-aware Attributes Learning

Open Domain Question Answering with Character-Level Deep Learning Models.

Hybrid Question Answering over Knowledge Base and Free Text.

How Proficient Are Large Language Models in Formal Languages? An In-Depth Insight for Knowledge Base Question Answering

Exploiting Abstract Meaning Representation for Open-Domain Question Answering

KBQA: an Online Template Based Question Answering System over Freebase.