Abstract:With the rapid development of the internet technology, dirty data are commonly observed in various real scenarios, e.g., owing to unreliable sensor reading, transmission and collection from heterogeneous sources. To deal with their negative effects on downstream applications, data cleaning approaches are designed to preprocess the dirty data before conducting applications. The idea of most data cleaning methods is to identify or correct dirty data, referring to the values of their neighbors which share the same information. Unfortunately, owing to data sparsity and heterogeneity, the number of neighbors based on equality relationship is rather limited, especially in the presence of data values with variances. To tackle this problem, distance-based data cleaning approaches propose to consider similarity neighbors based on value distance. By tolerance of small variants, the enriched similarity neighbors can be identified and used for data cleaning tasks. At the same time, distance relationship between tuples is also helpful to guide the data cleaning, which contains more information and includes the equality relationship. Therefore, distance-based technology plays an important role in the data cleaning area, and we also have reason to believe that distance-based data cleaning technology will attract more attention in data preprocessing research in the future. Hence this survey provides a classification of four main data cleaning tasks, i.e., rule profiling, error detection, data repair and data imputation, and comprehensively reviews the state of the art for each class.

Data Cleaning About Student Information Based on Massive Open Online Course System.

Design of Online Education Big Data Platform Based on Data Mining and Data Collection Technology

Learning Quality Evaluation of MOOC Based on Big Data Analysis.

Big Data Application in Education: Dropout Prediction in Edx MOOCs

The Analysis and Early Warning of Student Loss in MOOC Course

Exploring causes for the dropout on massive open online courses.

Learning Behavior Analysis Using Clustering and Evolutionary Error Correcting Output Code Algorithms in Small Private Online Courses

Quantitative Analysis of Learning Data in a Programming Course.

Learning Behavior Analysis and Prediction Based on MOOC Data

Providing personalized learning guidance in MOOCs by multi-source data analysis

Student Achievement Analysis and Prediction Based on the Whole Learning Process

A Research on Techniques for Data Fusion and Analysis of Cross-platform MOOC Data

Design of Online Learning Behavior Analysis System Based on Big Data

Learning Analytics and Education Assessment Based on Big Data Generated by MOOCs

Supporting quality teaching using educational data mining based on OpenEdX platform.

Data-driven analytics for student reviews in China’s higher vocational education MOOCs: A quality improvement perspective

Distance-based Data Cleaning: A Survey (Technical Report)

Online SQL automatic evaluation system for MOOC and its application

Research on the Big Data System of Massive Open Online Course

Analysis of Teaching Effect of Korean Education Course Based on Data Acquisition Technology

Optimization and Improvements of A Moodle-Based Online Learning System for C Programming