Abstract:With the continuous expansion of power systems, as well as ever-developing technology and reduced costs of measurement devices, the recorded data in power systems have been increasing significantly and progressively exhibit the feature of big data. Much attention has been paid to the full use of big data for improving the planning, operation and control of power system, and hence how to evaluate the quality of big data is becoming an important problem to be examined. Some research publications are available on data quality improvement, such as data cleaning, data integration, and the detection of similar records, but the existing research work is still preliminary in data quality evaluations. Given this background, considering the characteristics of power systems and associated big data, this paper proposes a comprehensive method for evaluating the quality of big data in power systems. Firstly, we construct an index system for big data quality evaluations. Then aiming at the timeliness of big data, we adopt the K-means clustering algorithm in parallel with MapReduce for fast preprocessing of the big data sample set. Secondly, we use entropy weight method to calculate the objective weight of each dataset and grey evaluation method to determine the data quality level. On this basis, the comprehensive evaluation of the sample data set is carried out. Finally, the recorded electric load historical data in a city power company are employed to demonstrate the proposed method.

The Research on Evaluation System of Statistical Data Quality

Research and development on data quality assessment management system

Assessing Data Quality Within Available Context

Research and Design of Quantitative Analysis System on Physical Examination Status

Study on Quality Evaluation in DFQ

Studies on Data Quality Evaluation Index System for Internet Plus Government Services in Big Data Era

A Fuzzy Approach for the Evaluation of Accounting Information Quality under Big Data Environmental——Case Study from China

Data quality assessment for on-line monitoring and measuring system of power quality based on big data and data provenance theory

An Evaluation System of Local Government Public Service Quality and its Application

The Challenges of Data Quality and Data Quality Assessment in the Big Data Era

Research for a New Model of Data Quality

Comprehensive Evaluation of Big Data Quality in Power Systems with Entropy Weight and Grey System Theory

Research on the Information Quality Measurement of Judicial Documents.

The Research on the Quality Standards for Assessing Digital Reference Services upon User’s Opinion

Research on the Construction of Urban Quality Development Evaluation System from the Perspective of Macro-quality

The Construction of Evaluation System of Regional Economic Growth Quality: Empirical Analysis Based on Shaanxi Province Data

The Deviation of Quantitative Evaluation of University Research Performance from Quality-orientation and Its Effective Governance

A Fair Data Market System With Data Quality Evaluation And Repairing Recommendation

On the Quality Index of Basic Research Achievement in Social Sciences——Taking Law for Example

Discussion on the establishment of evaluation index of quality management of geological survey project

Exploration of the Quality Egvaluation System for Clinical Research Based on Quantitative Evaluation