High-performance Distributed Feature Storage and Consumption Services in Power Grid Scenarios

Guoqing Wang,Yiming Lu,Peng Liu,Wang Zhou

DOI: https://doi.org/10.1109/BigDataSecurityHPSCIDS54978.2022.00023

2022-01-01

Abstract:As more and more services in the power grid introduce machine learning and deep learning technologies, feature engineering has become more and more complex. In order to improve the efficiency of feature engineering, this paper proposes a high-performance distributed feature storage and consumption service based on grid scenarios, referred to as HFSA (High-performance feature storage and access). HFSA designed a feature data storage and consumption platform with the help of the idea of message middleware. HFSA services include HFSA Cluster, Producer and Consumer. This article verifies whether the HFSA service meets the design requirements from three aspects: functional testing, accuracy testing and performance testing. The experimental results show that the HFSA service has complete functions and good performance, which basically solves the problem of characteristic storage and consumption of the power grid.