Abstract:Reliable data storage is crucial to the production, transmission, transaction, consumption, and analysis of an Energy Internet (EI). Whereas mainstream distributed data storage seems to be a plausible solution, the existing methods suffer from a tradeoff between the storage overhead (incurred by the replicas of data encodings for lossless recovery) and the communication latency (due to the spiking network traffic resulting from massive queries of data replicas across devices). To balance this tradeoff, we propose a Lightweight Dynamic Storage Algorithm based on Adaptive Encoding (LDSA-AE) approach for EI data storage. Our key idea is to classify the data into active and inactive categories, where the active data are most likely to be accessed and thus corrupted in high frequencies. As such, wherever the active data are housed, the replicas of them can be proactively allocated into a set of nearby devices. The main challenges are to realize the classification in real-time and to tailor encoding methods for the active and inactive separately in correspondence to their own characteristics. To overcome these, our LDSA-AE 1) proposes a novel density-based clustering algorithm to tackle performance data classification in an online and unsupervised fashion and 2) leverages Minimum Density RAID-6 (MDR) code and Cauchy Reed-Solomon (CRS) code for active and inactive data encodings, respectively, striving to ensure data storage with low overhead, low latency, high reliability, and high throughput at once. A theoretical analysis substantiates the viability and effectiveness of our proposed LDSA-AE approach. We also prototype our LDSA-AE on a real-world server testbed, and the empirical study suggests the superiority of our approach over the state-of-the-art distributed storage schemes for EI in terms of storage overhead, repair throughput, and reliability.

Priori information and sliding window based prediction algorithm for energy-efficient storage systems in cloud.

An Energy-Efficient Scheme for Cloud Resource Provisioning Based on CloudSim

Energy-efficient Streaming Media Storage System with QoS Guarantee

PEAM: Predictive Energy-Aware Management for Storage Systems

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Energy-Aware Disk Storage Management: Online Approach with Application in DBMS

Energy efficient job scheduling with workload prediction on cloud data center

SWEP-RF: Accuracy Sliding Window-based Ensemble Pruning Method for Latent Sector Error Prediction in Cloud Storage Computing.

Towards Learned Predictability of Storage Systems

Improving the Effective IO Throughput by Adaptive Read-Ahead Strategy for Private Cloud Storage Service

Efficient resource utilization using multi-step-ahead workload prediction technique in cloud

Using deep reinforcement learning (DRL) for minimizing power consumption in video-on-demand (VoD) storage systems

Three-Way Ensemble Prediction for Workload in the Data Center

Research on virtual machine consolidation strategy based on combined prediction and energy-aware in cloud computing platform

A load prediction model for cloud computing using PSO-based weighted wavelet support vector machine

MCS-B: an Energy Efficient Storage System for Astronomical Observation Data Based on Logical Block Replacement Strategy

Optimizing Multi-Cloud CDN Deployment and Scheduling Strategies Using Big Data Analysis

Workload-Aware Scheduling of Real-Time Jobs in Cloud Computing to Minimize Energy Consumption

Predictive Data and Energy Management under Budget

Prediction Method of Energy Consumption Based on Multiple Energy-Related Features in Data Center

A Lightweight Dynamic Storage Algorithm With Adaptive Encoding for Energy Internet