Abstract:The importance of difference semantics (e.g., “similar” or “dissimilar”) is recently recognized for declaring dependencies among various types of data, such as numerical values or text values. We propose a novel form of differential dependencies (DDs), which specifies constraints on difference, instead of equality function in traditional dependency notations like functional dependencies. Informally, a differential dependency states that if two tuples have distances on attributes X agreeing with a certain differential function, then their distances on attributes Y should also agree with the corresponding differential function on Y. For example, [date(≤ 7)]→[price(In this thesis, we first report our preliminary work on several theoretical issues of differential dependencies, including formal definitions of DDs and differential keys, subsumption order relation of differential functions, implication of DDs, closure of a differential function, a sound and complete inference system, and minimal cover for DDs. Then, we investigate a practical problem, i.e., how to discover DD s and differential keys from a given sample data. Due to the intrinsic hardness, we develop several pruning methods to improve the discovery efficiency in practice. Moreover, we address differential dependencies that “almost” hold in a given data instance, namely approximate differential dependencies . Several approaches are studied to evaluate how a DD approximately holds in a data instance. Through the extensive experimental evaluation on real data sets, we demonstrate the performance of discovery algorithms, and the effectiveness of DDs in several real applications.

Data Dependencies Extended for Variety and Veracity: A Family Tree (extended Abstract)

Data Dependencies Extended for Variety and Veracity: A Family Tree

Data Dependencies over Big Data: A Family Tree

Survey on research and application of graph dependencies

Data dependencies in the presence of difference

On Data Dependencies in Dataspaces

Do data dependencies in source code complement call dependencies for understanding requirements traceability?

Functional Dependencies Discovering in Distributed Big Data

Discovering Approximate Functional Dependencies from Distributed Big Data.

Comparable Dependencies over Heterogeneous Data.

Differential dependencies: Reasoning and discovery

Scalable Functional Dependencies Discovery from Big Data

Data Dependencies Based on Vague Relational Data Model

Multivalued Dependencies for XML Documents with DTDs

Efficient Discovery of Functional Dependencies with Degrees of Satisfaction.

Conditional Dependencies: A Principled Approach to Improving Data Quality

Dependencies Theory and Its Application for Repairing Inconsistent Data

Efficient Discovery of Functional Dependencies on Massive Data

Functional Dependencies with Built-in Predicates and Its Axiomatization

Inferring and Propagating Pivot Dependencies in Schema Transformation Between Data and Metadata.

An Extension Of Classical Functional Dependency: Rough Functional Dependency And Its Inference Rules