A Unifying Framework for Incompleteness, Inconsistency, and Uncertainty in Databases

Benny Kimelfeld,Phokion G. Kolaitis

DOI: https://doi.org/10.1145/3624717

IF: 22.7

2024-02-24

Communications of the ACM

Abstract:Deploying possible world semantics and the challenge of computing the certain answers to queries.

computer science, theory & methods, software engineering, hardware & architecture

What problem does this paper attempt to address?

A Semantic Mapping System for Bridging the Gap between Relational Database and Semantic Web

Linhua Zhou,Huajun Chen,Chunying Zhou,Zhang Yu

2008-01-01

Abstract:Recently, there has been a growing need for integrating legacy relational databases with semantic web ontologies, however, experience in building such applications has re- vealed a gap between semantic web languages and relational data model. We present a formal mapping system to bridge the gap and study the problem of reasoning and query answer- ing using view underlying the mapping system. Particularly, we consider a special mapping called "constraint mapping" between database integrity constraints and OWL axioms. We then propose an approach to incorporating these OWL ax- ioms and description logic reasoning into query rewriting us- ing views to enable the algorithm to answer more types of queries. The approach has been used to develop a pilot data integration application for neuroscience community.
Axiomatic Foundations and Algorithms for Deciding Semantic Equivalences of SQL Queries

Shumo Chu,Brendan Murphy,Jared Roesch,Alvin Cheung,Dan Suciu

DOI: https://doi.org/10.48550/arXiv.1802.02229

2018-05-24

Abstract:Deciding the equivalence of SQL queries is a fundamental problem in data management. As prior work has mainly focused on studying the theoretical limitations of the problem, very few implementations for checking such equivalences exist. In this paper, we present a new formalism and implementation for reasoning about the equivalences of SQL queries. Our formalism, U-semiring, extends SQL's semiring semantics with unbounded summation and duplicate elimination. U-semiring is defined using only very few axioms and can thus be easily implemented using proof assistants such as Coq for automated query reasoning. Yet, they are sufficient enough to enable us reason about sophisticated SQL queries that are evaluated over bags and sets, along with various integrity constraints. To evaluate the effectiveness of U-semiring, we have used it to formally verify 39 query rewrite rules from both classical data management research papers and real-world SQL engines, where many of them have never been proven correct before.

Databases,Programming Languages
I don't care, I don't know ... I know too much! On Incompleteness and Undecidedness in Abstract Argumentation.

Pietro Baroni,Massimiliano Giacomin,Bei Shui Liao

DOI: https://doi.org/10.1007/978-3-319-14726-0_18

2015-01-01

Abstract:Incompleteness and undecidedness are pervasively present in human reasoning activities and make the definition of the relevant computational models challenging. In this discussion paper we focus on one such model, namely abstract argumentation frameworks, and examine several flavours of incompleteness and undecidedness thereof, by providing a conceptual analysis, a critical literature review, and some new ideas with pointers to future research.
Resolving Uncertainty in Context Integration and Abstraction

Juan Ye,Susan McKeever,Lorcan Coyle,Steve Neely,Simon Dobson

DOI: https://doi.org/10.1145/1387269.1387292

2008-01-01

Abstract:Pervasive computing is typically highly sensor-driven, but sensors provide only evidence of fact rather than facts themselves. The uncertainty of sensor data will affect each component in a pervasive computing system, which may decrease the quality of its provided services. We provide a general model to represent semantics of uncertainty in different levels (e.g., sensor, lower-level context and higher-level context). Within our model, fine-grained approaches are applied to evaluate and propagate uncertainties. They will help to resolve the uncertainty in each process of context management so that the effect of uncertainty on system services will be minimised.
Possible and Certain Answers for Queries over Order-Incomplete Data

Antoine Amarilli,Mouhamadou Lamine Ba,Daniel Deutch,Pierre Senellart

DOI: https://doi.org/10.4230/LIPIcs.TIME.2017.4

2018-01-27

Abstract:To combine and query ordered data from multiple sources, one needs to handle uncertainty about the possible orderings. Examples of such "order-incomplete" data include integrated event sequences such as log entries, lists of properties (e.g., hotels and restaurants) ranked by an unknown function reflecting relevance or customer ratings, and documents edited concurrently with an uncertain order on edits. This paper introduces a query language for order-incomplete data, based on the positive relational algebra with order-aware accumulation. We use partial orders to represent order-incomplete data, and study possible and certain answers for queries in this context. We show that these problems are respectively NP-complete and coNP-complete, but identify many tractable cases depending on the query operators or input partial orders.

Databases
Completeness Guarantees for Incomplete Ontology Reasoners: Theory and Practice

Bernardo Cuenca Grau,Boris Motik,Giorgos Stoilos,Ian Horrocks

DOI: https://doi.org/10.1613/jair.3470

2014-01-19

Abstract:To achieve scalability of query answering, the developers of Semantic Web applications are often forced to use incomplete OWL 2 reasoners, which fail to derive all answers for at least one query, ontology, and data set. The lack of completeness guarantees, however, may be unacceptable for applications in areas such as health care and defence, where missing answers can adversely affect the applications functionality. Furthermore, even if an application can tolerate some level of incompleteness, it is often advantageous to estimate how many and what kind of answers are being lost. In this paper, we present a novel logic-based framework that allows one to check whether a reasoner is complete for a given query Q and ontology T---that is, whether the reasoner is guaranteed to compute all answers to Q w.r.t. T and an arbitrary data set A. Since ontologies and typical queries are often fixed at application design time, our approach allows application developers to check whether a reasoner known to be incomplete in general is actually complete for the kinds of input relevant for the application. We also present a technique that, given a query Q, an ontology T, and reasoners R_1 and R_2 that satisfy certain assumptions, can be used to determine whether, for each data set A, reasoner R_1 computes more answers to Q w.r.t. T and A than reasoner R_2. This allows application developers to select the reasoner that provides the highest degree of completeness for Q and T that is compatible with the applications scalability requirements. Our results thus provide a theoretical and practical foundation for the design of future ontology-based information systems that maximise scalability while minimising or even eliminating incompleteness of query answers.

Artificial Intelligence,Logic in Computer Science
A Unified Semantics Space Model

Juan Ye,Lorcan Coyle,Simon Dobson,Paddy Nixon

DOI: https://doi.org/10.1007/978-3-540-75160-1_7

2007-01-01

Abstract:Location-aware systems provide customised services or applications according to users' locations. While much research has been carried out in developing models to represent location information and spatial relationships, it is usually limited to modelling simple environments (cf. [ 13,19,3]). This paper proposes a unified space model for more complex environments (e.g., city plan or forest). This space model provides a flexible, expressive, and powerful spatial representation. It also proposes a new data structure - an integrated lattice and graph model - to express comprehensive spatial relationships. This structure not only provides multiple graphs at different abstraction levels, but it also collapses the whole map into smaller local graphs. This mechanism is beneficial in reducing the complexity of creating and maintaining a map and improving the efficiency of path finding algorithms.
On Desirable Semantics of Functional Dependencies over Databases with Incomplete Information

Antonio Badia,Daniel Lemire

DOI: https://doi.org/10.3233/FI-2018-1651

2017-04-07

Abstract:Codd's relational model describes just one possible world. To better cope with incomplete information, extended database models allow several possible worlds. Vague tables are one such convenient extended model where attributes accept sets of possible values (e.g., the manager is either Jill or Bob). However, conceptual database design in such cases remains an open problem. In particular, there is no canonical definition of functional dependencies (FDs) over possible worlds (e.g., each employee has just one manager). We identify several desirable properties that the semantics of such FDs should meet including Armstrong's axioms, the independence from irrelevant attributes, seamless satisfaction and implied by strong satisfaction. We show that we can define FDs such that they have all our desirable properties over vague tables. However, we also show that no notion of FD can satisfy all our desirable properties over a more general model (disjunctive tables). Our work formalizes a trade-off between having a general model and having well-behaved FDs.

Databases
A Formalization of SQL with Nulls

Wilmer Ricciotti,James Cheney

DOI: https://doi.org/10.48550/arXiv.2003.11331

2022-06-20

Abstract:SQL is the world's most popular declarative language, forming the basis of the multi-billion-dollar database industry. Although SQL has been standardized, the full standard is based on ambiguous natural language rather than formal specification. Commercial SQL implementations interpret the standard in different ways, so that, given the same input data, the same query can yield different results depending on the SQL system it is run on. Even for a particular system, mechanically checked formalization of all widely-used features of SQL remains an open problem. The lack of a well-understood formal semantics makes it very difficult to validate the soundness of database implementations. Although formal semantics for fragments of SQL were designed in the past, they usually did not support set and bag operations, lateral joins, nested subqueries, and, crucially, null values. Null values complicate SQL's semantics in profound ways analogous to null pointers or side-effects in other programming languages. Since certain SQL queries are equivalent in the absence of null values, but produce different results when applied to tables containing incomplete data, semantics which ignore null values are able to prove query equivalences that are unsound in realistic databases. A formal semantics of SQL supporting all the aforementioned features was only proposed recently. In this paper, we report about our mechanization of SQL semantics covering set/bag operations, lateral joins, nested subqueries, and nulls, written in the Coq proof assistant, and describe the validation of key metatheoretic properties. Additionally, we are able to use the same framework to formalize the semantics of a flat relational calculus (with null values), and show a certified translation of its normal forms into SQL.

Logic in Computer Science
Incorporating Integrity Constraints in Uncertain Databases

Naveen Ashish,Sharad Mehrotra,Pouria Pirzadeh

DOI: https://doi.org/10.48550/arXiv.0907.1632

2009-07-09

Databases

Abstract:We develop an approach to incorporate additional knowledge, in the form of general purpose integrity constraints (ICs), to reduce uncertainty in probabilistic databases. While incorporating ICs improves data quality (and hence quality of answers to a query), it significantly complicates query processing. To overcome the additional complexity, we develop an approach to map an uncertain relation U with ICs to another uncertain relation U', that approximates the set of consistent worlds represented by U. Queries over U can instead be evaluated over U' achieving higher quality (due to reduced uncertainty in U') without additional complexity in query processing due to ICs. We demonstrate the effectiveness and scalability of our approach to large data-sets with complex constraints. We also present experimental results demonstrating the utility of incorporating integrity constraints in uncertain relations, in the context of an information extraction application.
Querying Incomplete Numerical Data: Between Certain and Possible Answers

Marco Console,Leonid Libkin,Liat Peterfreund

DOI: https://doi.org/10.48550/arXiv.2210.15395

2022-11-01

Abstract:Queries with aggregation and arithmetic operations, as well as incomplete data, are common in real-world database, but we lack a good understanding of how they should interact. On the one hand, systems based on SQL provide ad-hoc rules for numerical nulls, on the other, theoretical research largely concentrates on the standard notions of certain and possible answers. In the presence of numerical attributes and aggregates, however, these answers are often meaningless, returning either too little or too much. Our goal is to define a principled framework for databases with numerical nulls and answering queries with arithmetic and aggregations over them. Towards this goal, we assume that missing values in numerical attributes are given by probability distributions associated with marked nulls. This yields a model of probabilistic bag databases in which tuples are not necessarily independent, since nulls can repeat. We provide a general compositional framework for query answering, and then concentrate on queries that resemble standard SQL with arithmetic and aggregation. We show that these queries are measurable, and that their outputs have a finite representation. Moreover, since the classical forms of answers provide little information in the numerical setting, we look at the probability that numerical values in output tuples belong to specific intervals. Even though their exact computation is intractable, we show efficient approximation algorithms to compute such probabilities.

Databases
Database Semantics

Robert E. Kent

DOI: https://doi.org/10.48550/arXiv.1209.3054

2012-09-14

Abstract:This paper, the first step to connect relational databases with systems consequence (Kent: "System Consequence" 2009), is concerned with the semantics of relational databases. It aims to to study system consequence in the logical/semantic system of relational databases. The paper, which was inspired by and which extends a recent set of papers on the theory of relational database systems (Spivak: "Functorial Data Migration" 2012), is linked with work on the Information Flow Framework (IFF) [<a class="link-external link-http" href="http://suo.ieee.org/IFF/" rel="external noopener nofollow">this http URL</a>] connected with the ontology standards effort (SUO), since relational databases naturally embed into first order logic. The database semantics discussed here is concerned with the conceptual level of database architecture. We offer both an intuitive and technical discussion. Corresponding to the notions of primary and foreign keys, relational database semantics takes two forms: a distinguished form where entities are distinguished from relations, and a unified form where relations and entities coincide. The distinguished form corresponds to the theory presented in (Spivak: "Simplicial databases" 2009)[<a class="link-https" data-arxiv-id="0904.2012" href="https://arxiv.org/abs/0904.2012">arXiv:0904.2012</a>]. The unified form, a special case of the distinguished form, corresponds to the theory presented in (Spivak: "Functorial Data Migration" 2012). A later paper will discuss various formalisms of relational databases, such as relational algebra and first order logic, and will complete the description of the relational database logical environment.

Databases,Category Theory
Integrating Relational Databases with Semantic Web Ontologies : Reasoning and Query Answering using Views

Linhua Zhou,Yuxin Mao,Huajun Chen

2007-01-01

Abstract:Recently, there has been a growing need for integrating legacy relational databases with semantic web ontologies, however, experience in building such applications has revealed a gap between semantic web languages and relational data model. We present a formal mapping system to bridge the gap and study the problem of reasoning and query answering using view underlying the mapping system. Particularly, we consider a special mapping called “constraint mapping” between database integrity constraints and OWL axioms. We then propose an approach to incorporating these OWL axioms and description logic reasoning into query rewriting using views to enable the algorithm to answer more types of queries. The approach has been used to develop a pilot data integration application for neuroscience community.
Bayesian-knowledge driven ontologies: A framework for fusion of semantic knowledge under uncertainty and incompleteness

Eugene Santos,Jacob Jurmain,Anthony Ragazzi

DOI: https://doi.org/10.1371/journal.pone.0296864

IF: 3.7

2024-03-27

PLoS ONE

Abstract:The modeling of uncertain information is an open problem in ontology research and is a theoretical obstacle to creating a truly semantic web. Currently, ontologies often do not model uncertainty, so stochastic subject matter must either be normalized or rejected entirely. Because uncertainty is omnipresent in the real world, knowledge engineers are often faced with the dilemma of performing prohibitively labor-intensive research or running the risk of rejecting correct information and accepting incorrect information. It would be preferable if ontologies could explicitly model real-world uncertainty and incorporate it into reasoning. We present an ontology framework which is based on a seamless synthesis of description logic and probabilistic semantics. This synthesis is powered by a link between ontology assertions and random variables that allows for automated construction of a probability distribution suitable for inferencing. Furthermore, our approach defines how to represent stochastic, uncertain, or incomplete subject matter. Additionally, this paper describes how to fuse multiple conflicting ontologies into a single knowledge base that can be reasoned with using the methods of both description logic and probabilistic inferencing. This is accomplished by using probabilistic semantics to resolve conflicts between assertions, eliminating the need to delete potentially valid knowledge and perform consistency checks. In our framework, emergent inferences can be made from a fused ontology that were not present in any of the individual ontologies, producing novel insights in a given domain.

multidisciplinary sciences
Querying Incomplete Data : Complexity and Tractability via Datalog and First-Order Rewritings

Amélie Gheerbrant,Leonid Libkin,Alexandra Rogova,Cristina Sirangelo

2023-10-19

Abstract:To answer database queries over incomplete data the gold standard is finding certain answers: those that are true regardless of how incomplete data is interpreted. Such answers can be found efficiently for conjunctive queries and their unions, even in the presence of constraints. With negation added, the problem becomes intractable however. We concentrate on the complexity of certain answers under constraints, and on effficiently answering queries outside the usual classes of (unions) of conjunctive queries by means of rewriting as Datalog and first-order queries. We first notice that there are three different ways in which query answering can be cast as a decision problem. We complete the existing picture and provide precise complexity bounds on all versions of the decision problem, for certain and best answers. We then study a well-behaved class of queries that extends unions of conjunctive queries with a mild form of negation. We show that for them, certain answers can be expressed in Datalog with negation, even in the presence of functional dependencies, thus making them tractable in data complexity. We show that in general Datalog cannot be replaced by first-order logic, but without constraints such a rewriting can be done in first-order. The paper is under consideration in Theory and Practice of Logic Programming (TPLP).

Databases
Possible Worlds Semantics: A Research Program That Cannot Fail?

Johan van Benthem

DOI: https://doi.org/10.1007/bf00370508

1984-01-01

Studia Logica

Abstract:Providing a possible worlds semantics for a logic involves choosing a class of possible worlds models, and setting up a truth definition connecting formulas of the logic with statements about these models. This scheme is so flexible that a danger arises: perhaps, any (reasonable) logic whatsoever can be modelled in this way. Thus, the enterprise would lose its essential ‘tension’. Fortunately, it may be shown that the so-called ‘incompleteness-examples’ from modal logic resist possible worlds modelling, even in the above wider sense. More systematically, we investigate the interplay of truth definitions and model conditions, proving a preservation theorem characterizing those types of truth definition which generate the minimal modal logic.
Uncertain Spatial Data Management:An Overview

Andreas Zuefle

DOI: https://doi.org/10.48550/arXiv.2009.01121

2020-09-02

Abstract:Both the current trends in technology such as smartphones, general mobile devices, stationary sensors, and satellites as well as a new user mentality of using this technology to voluntarily share enriched location information produces a flood of geo-spatial and geo-spatiotemporal data. This data flood provides tremendous potential for discovering new and useful knowledge. But in addition to the fact that measurements are imprecise, spatial data is often interpolated between discrete observations. To reduce communication and bandwidth utilization, data is often subjected to a reduction, thereby eliminating some of the known/recorded values. These issues introduce the notion of uncertainty in spatial data management, an aspect raising the imminent need for scalable and flexible solutions. The main scope of this chapter is to survey existing techniques for managing, querying, and mining uncertain spatial data. First, this chapter surveys common data representations for uncertain data, explains the commonly used possible worlds semantics to interpret an uncertain database, and surveys existing system to process uncertain data. Then, this chapter defines the notion of probabilistic result semantics to distinguish the task of computing individual object probabilities versus computing entire result probabilities. This is important, as, for many queries, the problem of computing object-level probabilities can be solved efficiently, whereas result-level probabilities are hard to compute. Finally, this chapter introduces a novel paradigm to efficiently answer any kind of query on uncertain data: the Paradigm of Equivalent Worlds, which groups the exponential set of possible database worlds into a polynomial number of sets of equivalent worlds that can be processed efficiently. Examples and use-cases of querying uncertain spatial data are provided using the example of uncertain range queries.

Databases
Integrity Constraints for General-Purpose Knowledge Bases

Luís Cruz-Filipe,Isabel Nunes,Peter Schneider-Kamp

DOI: https://doi.org/10.1007/978-3-319-30024-5_13

2016-01-20

Abstract:Integrity constraints in databases have been studied extensively since the 1980s, and they are considered essential to guarantee database integrity. In recent years, several authors have studied how the same notion can be adapted to reasoning frameworks, in such a way that they achieve the purpose of guaranteeing a system's consistency, but are kept separate from the reasoning mechanisms. In this paper we focus on multi-context systems, a general-purpose framework for combining heterogeneous reasoning systems, enhancing them with a notion of integrity constraints that generalizes the corresponding concept in the database world.

Databases
Conjunctive Query Containment and Answering under Description Logics Constraints

Diego Calvanese,Giuseppe De Giacomo,Maurizio Lenzerini

DOI: https://doi.org/10.48550/arXiv.cs/0507067

2005-07-28

Abstract:Query containment and query answering are two important computational tasks in databases. While query answering amounts to compute the result of a query over a database, query containment is the problem of checking whether for every database, the result of one query is a subset of the result of another query. In this paper, we deal with unions of conjunctive queries, and we address query containment and query answering under Description Logic constraints. Every such constraint is essentially an inclusion dependencies between concepts and relations, and their expressive power is due to the possibility of using complex expressions, e.g., intersection and difference of relations, special forms of quantification, regular expressions over binary relations, in the specification of the dependencies. These types of constraints capture a great variety of data models, including the relational, the entity-relationship, and the object-oriented model, all extended with various forms of constraints, and also the basic features of the ontology languages used in the context of the Semantic Web. We present the following results on both query containment and query answering. We provide a method for query containment under Description Logic constraints, thus showing that the problem is decidable, and analyze its computational complexity. We prove that query containment is undecidable in the case where we allow inequalities in the right-hand side query, even for very simple constraints and queries. We show that query answering under Description Logic constraints can be reduced to query containment, and illustrate how such a reduction provides upper bound results with respect to both combined and data complexity.

Databases,Artificial Intelligence
Entity integrity management under data volume, variety and veracity

Sebastian Link

DOI: https://doi.org/10.1007/s10115-022-01814-1

IF: 2.7

2023-01-27

Knowledge and Information Systems

Abstract:Edgar Codd introduced the principle of entity integrity in the context of his relational model of data. The principle says that every targeted real-world entity should be uniquely represented in the database. In actual database systems, entity integrity is typically enforced by primary keys. We introduce a framework toward generalizing entity integrity to different dimensions of data, including volume, variety, and veracity. We establish axiomatic and algorithmic foundations for the implication problem of the combined class of uniqueness constraints, functional dependencies, and multivalued dependencies in all combinations of the dimensions we consider. These are based on specific approaches to the semantics of these integrity constraints and to the dimensions of data. We also highlight how our concepts lead to new opportunities for diverse and important areas of applications, such as query optimization, database design and security, and data quality. Overall, this sets out an agenda for future research that extends our approaches or applies different approaches in this area, as driven by application requirements.

computer science, information systems, artificial intelligence

A Unifying Framework for Incompleteness, Inconsistency, and Uncertainty in Databases

A Semantic Mapping System for Bridging the Gap between Relational Database and Semantic Web

Axiomatic Foundations and Algorithms for Deciding Semantic Equivalences of SQL Queries

I don't care, I don't know ... I know too much! On Incompleteness and Undecidedness in Abstract Argumentation.

Resolving Uncertainty in Context Integration and Abstraction

Possible and Certain Answers for Queries over Order-Incomplete Data

Completeness Guarantees for Incomplete Ontology Reasoners: Theory and Practice

A Unified Semantics Space Model

On Desirable Semantics of Functional Dependencies over Databases with Incomplete Information

A Formalization of SQL with Nulls

Incorporating Integrity Constraints in Uncertain Databases

Querying Incomplete Numerical Data: Between Certain and Possible Answers

Database Semantics

Integrating Relational Databases with Semantic Web Ontologies : Reasoning and Query Answering using Views

Bayesian-knowledge driven ontologies: A framework for fusion of semantic knowledge under uncertainty and incompleteness

Querying Incomplete Data : Complexity and Tractability via Datalog and First-Order Rewritings

Possible Worlds Semantics: A Research Program That Cannot Fail?

Uncertain Spatial Data Management:An Overview

Integrity Constraints for General-Purpose Knowledge Bases

Conjunctive Query Containment and Answering under Description Logics Constraints

Entity integrity management under data volume, variety and veracity