Abstract:Since there is a longitudinal and horizontal penetration problem between multi-level data centers in the smart grid information transmission network. Based on the improved Simulated Annealing algorithm, this paper proposes a data storage optimization model for smart grids based on Hadoop architecture. Combining the characteristics of distributed storage in cloud computing, the smart grid data are equivalent to a task-oriented data set. The smart grid information platform is flattened, equal to a collection of multiple distributed data centers. The smart grid data over time were counted to derive the dependencies between task sets and data sets. According to the dependency between task sets and data sets, the mathematical model was established in combination with the actual data transmission of the power grid. The optimal transmission correspondence between each data set and the data center was calculated. An improved Simulated Annealing algorithm solves the longitudinal and horizontal penetration problem between multi-level data centers. When generating a new solution, the Grey Wolf algorithm provides direction for finding the optimal solution. This paper integrated the existing business data and computational storage resources in the smart grid to establish a mathematical model of the affiliation between data centers and data sets. The optimal distribution of the data set was calculated, and the optimally distributed data set was stored in a distributed physical disk. Arithmetic examples were used to analyze the efficiency and stability of several algorithms to verify the improved algorithm’s advantages, and the improved algorithms’ effectiveness was confirmed by simulation.

Analysis and Prediction of Massive Electricity Information Based on Hadoop Ha Architecture

The Correlation Analysis And Prediction Between Mobile Phone Users Complaints And Telecom Equipment Failures Under Big Data Environments

Power Big Data Analysis Platform Design Based on Hadoop

A Distributed Data Mining System Framework for Mobile Internet Access Log Based on Hadoop.

Hadoop-based Framework for Big Data Analysis of Synchronised Harmonics in Active Distribution Network

Power Safety Warning Method Based on GM-FHMM Load Decomposition Algorithm

An Auxiliary Decision-Making System for Electric Power Intelligent Customer Service Based on Hadoop

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

A Weekly Load Data Mining Approach Based on Hidden Markov Model

Design and Implementation of Power Big Data Platform

Big Data Analytics and Visualization of Residential Electricity Consumption Behavior based on Smart Meter Data

Data Storage Optimization Model Based on Improved Simulated Annealing Algorithm

Big Data Quality Prediction in the Process Industry: A Distributed Parallel Modeling Framework

Comprehensive Evaluation of Big Data Quality in Power Systems with Entropy Weight and Grey System Theory

Key technologies of line loss and stealing electricity prediction analysis based on big data platform

Large-scale Data Modelling in Hive and Distributed Query Processing using MapReduce and Tez

An Intelligent System for Forecasting the Trend of Consumed Electricity

Data Mining Analysis and High-dimensional Visualization Based on Electric Big Data

Design and Implementation of Log Data Analysis Management System Based on Hadoop

Big data resolving using Apache Spark for load forecasting and demand response in smart grid: a case study of Low Carbon London Project

Predictive Data and Energy Management under Budget