Abstract:In recent years, with the advancement of the national construction of smart grid and the development of power grid enterprise integration system, the traditional power data platform has some defect, such as insufficient scalability, repeated implementation of two sets of logic of off-line data warehouse and real-time data warehouse, highly correlated storage of data warehouse during computation, and difficulty in platform migration, which restrict the deeper mining and analysis of power big data. Therefore, this paper adopts a technical architecture incorporating distributed calculating, micro-service, flow-batch integration and lake-warehouse integration, combining the current popular Web front-end and back-end technologies such as Vue, SpringCloud and Flask, and utilizing big data components such as Hadoop, Flink, Hudi and Kafka as well as Docker containerization technology. We explore and build a power grid system operation oriented big data platform that assembles real-time computing, multi-source heterogeneous data storage, and develop APIs for authority management, information management, data analysis and visualization, machine learning and other data supporting services that assist power enterprises in managing electrical equipment and users' power consumption.With the help of this platform, power enterprises can intelligently track the equipment status, view the offline and real-time visual charts to analyze the power consumption by users, so as to have better basis in the power dispatching, maintenance and scheme adjustment of electrical market.

A Productive Cloud Computing Platform Research for Big Data Analytics.

Building a Productive Domain-Specific Cloud for Big Data Processing and Analytics Service

Visual Analysis of Cloud Computing Performance Using Behavioral Lines

Application of cloud computing platform in industrial big data processing

Construction of Cloud Computing Platform Facing Scientific Big Data——a Case of Southeast University

A hybrid big data platform based on private cloud VMs and bare metals

Towards an Integrated Platform for Big Data Analysis

Review on Construction and Application of Big Data Analytical Platform

Mobile Cloud Platform - Architecture, Deployment and Big Data Applications.

Analysis of Big Data Platform with OpenStack and Hadoop.

A Novel Workflow Based Data Processing Platform As a Service

A System for Exploratory Analysis in Cloud

DataCloud: an Efficient Massive Data Mining and Analysis Framework on Large Clusters.

An Efficient Massive Data Processing Model in the Cloud -- A Preliminary Report

Transplantation of Data Mining Algorithms to Cloud Computing Platform when Dealing Big Data

Big Data Analytics Technology and Applications in Cloud Computing Perspective

Mass Data Analysis and Forecasting Based on Cloud Computing

Design and Implementation of Power Big Data Platform

Reproducible and Portable Big Data Analytics in the Cloud

A Comparative Investigation on the Use of Cloud Computing for Big Data Analytics

Big Data and Cloud Computing Platform for Energy Internet