Abstract:In banks, governments, and Internet companies, inconsistent data problems may often arise when various information systems are collecting, processing, and updating data due to human or equipment reasons. The emergence of inconsistent data makes it impossible to obtain correct information from the data and reduces its availability. Such problems may be fatal in data-intensive enterprises, which causes huge economic losses. Moreover, it is very difficult to clean inconsistent data in databases, especially for data containing conditional functional dependencies with built-in predicates (CFDPs), because it tends to contain more candidate repair values. For the inconsistent data containing CFDPs to detect incomplete and repair difficult problems in databases, we propose a dependency lifting algorithm (DLA) based on the maximum dependency set (MDS) and a reparation algorithm (C-Repair) based on integrating the minimum cost and attribute correlation, respectively. In detection, we find recessive dependencies from the original dependency set to obtain the MDS and improve the original algorithm by dynamic domain adjustment, which extends the applicability to continuous attributes and improves the detection accuracy. In reparation, we first set up a priority queue (PQ) for elements to be repaired based on the minimum cost idea to select a candidate element; then, we treat the corresponding conflict-free instance ( I n v ) as the training set to learn the correlation among attributes and compute the weighted distance (WDis) between the tuple of the candidate element and other tuples in I n v according to the correlation; and, lastly, we perform reparation based on the WDis and re-compute the PQ after each reparation round to improve the efficiency, and use a label, flag, to mark the repaired elements to ensure the convergence at the same time. By setting up a contrast experiment, we compare the DLA with the CFDPs based algorithm, and the C-Repair with a cost-based, interpolation-based algorithm on a simulated instance and a real instance. From the experimental results, the DLA and C-Repair algorithms have better detection and repair ability at a higher time cost.

Data Inconsistency Evaluation for Cyberphysical System

Assessing Data Quality Within Available Context

Optimizing the Spatio-temporal Distribution of Cyber-Physical Systems for Environment Abstraction

Reliability Assessment of Data Storage in Cyber Physical Systems

Robustness Improvement for Cyber Physical System Based on an Optimization Model of Interdependent Constraints

Optimal Coupling Pattern of Cyber-Physical Systems

Towards Cyber-Physical Systems in Social Spaces: The Data Reliability Challenge

A Solution of Data Inconsistencies in Data Integration — Designed for Pervasive Computing Environment

One-Pass Inconsistency Detection Algorithms for Big Data.

Scenario-Based Behavioral Nonexistent Consistency Checking for Cyber-Physical Systems

Hadoop-Based Inconsistence Detection and Reparation Algorithm for Big Data

Guided conditional functional dependency discovery

Diagnosis driven Anomaly Detection for CPS

Complexity and Efficient Algorithms for Data Inconsistency Evaluating and Repairing

Analysis of the Composition of Non-Deducibility in Cyber-Physical Systems

Uncertainty Theory Based Reliability-Centric Cyber-Physical System Design

Data-driven Discovery of Cyber-Physical Systems

Inconsistent Data Cleaning Based on the Maximum Dependency Set and Attribute Correlation

A Solution for Data Inconsistency in Data Integration

Data Driven Testing of Cyber Physical Systems

Improving The Reliability Of Cps With Hierarchical-Decentralized Decision Solution