Abstract:With the rapid development of the internet technology, dirty data are commonly observed in various real scenarios, e.g., owing to unreliable sensor reading, transmission and collection from heterogeneous sources. To deal with their negative effects on downstream applications, data cleaning approaches are designed to preprocess the dirty data before conducting applications. The idea of most data cleaning methods is to identify or correct dirty data, referring to the values of their neighbors which share the same information. Unfortunately, owing to data sparsity and heterogeneity, the number of neighbors based on equality relationship is rather limited, especially in the presence of data values with variances. To tackle this problem, distance-based data cleaning approaches propose to consider similarity neighbors based on value distance. By tolerance of small variants, the enriched similarity neighbors can be identified and used for data cleaning tasks. At the same time, distance relationship between tuples is also helpful to guide the data cleaning, which contains more information and includes the equality relationship. Therefore, distance-based technology plays an important role in the data cleaning area, and we also have reason to believe that distance-based data cleaning technology will attract more attention in data preprocessing research in the future. Hence this survey provides a classification of four main data cleaning tasks, i.e., rule profiling, error detection, data repair and data imputation, and comprehensively reviews the state of the art for each class.

Research on data cleaning based on domain-ontology

An Ontology-Based Approach to Data Cleaning

Contextual Data Cleaning with Ontology Functional Dependencies

Discovery and Contextual Data Cleaning with Ontology Functional Dependencies

An Open Data Cleaning Framework Based on Semantic Rules for Continuous Auditing

Content semantic filter based on domain ontology

Distance-based Data Cleaning: A Survey (Technical Report)

Research on Construction Methods of Domain Ontology

Data Cleaning and Semantic Improvement in Biological Databases

Discovering Domain Concepts and Hyponymy Relations by Text Relevance Classifying Based Iterative Web Searching

Research on Product Ontology Construction in E-commerce Environment

Semantic-based Intelligent Data Clean Framework for Big Data

Research on Knowledge Correctness Checking in Semantic Web

Method for Ontology Conflict Checking Based on Heuristic Rules

Data Cleaning Using Large Language Models

Research on Improved Model for Concept Similarity Computation in Domain Ontology and Application

Efficient Discovery of Ontology Functional Dependencies

RESEARCH ON ONTOLOGY-BASED DOMAIN FEATURE MODELING PROCESS

Improved semantic annotation method for documents based on ontology

Review on Wordnet-Based Ontology Construction in China

Intelligent Information Systems and Data Mining Study on Evolution of Domain Ontology