Design and Application of Data Quality Detection System Based on Simple Rules

Ke GAO,Xing-chun DIAO,Jian-jun CAO
DOI: https://doi.org/10.3969/j.issn.1673-629X.2015.06.039
2015-01-01
Abstract:In order to carry out the overall detection of data quality and locate the incorrect data,analyze the general indexes of data quali-ty assessment. The rules of structured data,which takes the form,grammar,length,range of single field and the logical,functional depend-ency relationship of different fields into account,was classified and programmed by using corresponding algorithm. Design a correspond-ing data quality inspection tools and realize it by programming,forming a set of whole data quality inspection tool. Test on the data of fa-cility and staff information from the angle of integrity,normalization,consistence,effectiveness. The result of experiment shows that such data rules can find out the errors of the data.
What problem does this paper attempt to address?