Abstract:Reliable data storage is crucial to the production, transmission, transaction, consumption, and analysis of an Energy Internet (EI). Whereas mainstream distributed data storage seems to be a plausible solution, the existing methods suffer from a tradeoff between the storage overhead (incurred by the replicas of data encodings for lossless recovery) and the communication latency (due to the spiking network traffic resulting from massive queries of data replicas across devices). To balance this tradeoff, we propose a Lightweight Dynamic Storage Algorithm based on Adaptive Encoding (LDSA-AE) approach for EI data storage. Our key idea is to classify the data into active and inactive categories, where the active data are most likely to be accessed and thus corrupted in high frequencies. As such, wherever the active data are housed, the replicas of them can be proactively allocated into a set of nearby devices. The main challenges are to realize the classification in real-time and to tailor encoding methods for the active and inactive separately in correspondence to their own characteristics. To overcome these, our LDSA-AE 1) proposes a novel density-based clustering algorithm to tackle performance data classification in an online and unsupervised fashion and 2) leverages Minimum Density RAID-6 (MDR) code and Cauchy Reed-Solomon (CRS) code for active and inactive data encodings, respectively, striving to ensure data storage with low overhead, low latency, high reliability, and high throughput at once. A theoretical analysis substantiates the viability and effectiveness of our proposed LDSA-AE approach. We also prototype our LDSA-AE on a real-world server testbed, and the empirical study suggests the superiority of our approach over the state-of-the-art distributed storage schemes for EI in terms of storage overhead, repair throughput, and reliability.

A Dynamic Host Selection Algorithm for Layered Data Storage Architecture in a Pervasive Space

A Tree-Based Hierarchy Data Storage Framework in A Pervasive Space

Optimizing the Spatio-temporal Distribution of Cyber-Physical Systems for Environment Abstraction

Hierarchical Spatial Clustering in Multi-Hop Wireless Sensor Networks

Load Balanced and Efficient Hierarchical Data-Centric Storage in Sensor Networks

Dynamic Table: A Layered and Configurable Storage Structure in the Cloud.

Dynamic Layer Management in Superpeer Architectures

Clustering-based Distributed and Adaptive Data Storage in Wireless Sensor Networks

Hierarchical Storage for Massive Social Network Data Based on Improved Decision Tree

Optimal layer division for low latency in DHT-based hierarchical P2P network

Hierarchical Architecture for Better Network Management

A Lightweight Dynamic Storage Algorithm With Adaptive Encoding for Energy Internet

An Efficient Hierarchical Data Placement Algorithm for Massive Spatial Data Storage Systems

A Cross-Layer Design for Data-Centric Storage in Underwater Acoustic Sensor Networks

A Stable Cloud Storage Algorithm for Online Interaction Effect Data based on HarmonyOS

Capability-aware Data Placement for Heterogeneous Active Storage Systems

RESEARCH ON HIERARCHICAL STORAGE STRATEGY ON P2P HYBRID CLUSTER

Design of Distributed Storage System on Peer-to-Peer Structure

Achieving optimal data storage position in wireless sensor networks

DHS: Adaptive Memory Layout Organization of Sketch Slots for Fast and Accurate Data Stream Processing

A Tree-Based Hierarchy Framework for RFID Data Repository