Abstract:With the increasing popularity of a large number of Internet-based services and a large number of services hosted on cloud platforms, a more powerful back-end storage system is needed to support these services. At present, it is very difficult or impossible to implement a distributed storage to meet all the above assumptions. Therefore, the focus of research is to limit different characteristics to design different distributed storage solutions to meet different usage scenarios. Economic big data should have the basic requirements of high storage efficiency and fast retrieval speed. The large number of small files and the diversity of file types make the storage and retrieval of economic big data face severe challenges. This paper is oriented to the application requirements of cross-modal analysis of economic big data. According to the source and characteristics of economic big data, the data types are analyzed and the database storage architecture and data storage structure of economic big data are designed. Taking into account the spatial, temporal, and semantic characteristics of economic big data, this paper proposes a unified coding method based on the spatiotemporal data multilevel division strategy combined with Geohash and Hilbert and spatiotemporal semantic constraints. A prototype system was constructed based on Mongo DB, and the performance of the multilevel partition algorithm proposed in this paper was verified by the prototype system based on the realization of data storage management functions. The Wiener distributed memory based on the principle of Wiener filter is used to store the workload of each workload distributed storage window in a distributed manner. For distributed storage workloads, this article adopts specific types of workloads. According to its periodicity, the workload is divided into distributed storage windows of specific duration. At the beginning of each distributed storage window, distributed storage is distributed to the next distributed storage window. Experiments and tests have verified the distributed storage strategy proposed in this article, which proves that the Wiener distributed storage solution can save platform resources and configuration costs while ensuring Service Level Agreement (SLA).

A Hierarchical Storage Strategy Based on Block-Level Data Valuation

Data Valuation on Multi-tiered Storage

Qos-Aware Indiscriminate Volume Storage Cloud

Distributed Heterogeneous Storage Based On Data Value

A distributed storage method of remote sensing data based on image blocks organization

Design and Implementation of Information Lifecycle Management System on Hierarchical Storage Management

Design and Implementation of Hierarchical Storage System FQ-HSM Based on File Queue

Efficient Hierarchical Storage Management Framework Empowered by Reinforcement Learning

Self-adaptive hierachical storage management in SAN based on block-level

Haina Storage: A Decentralized Secure Storage Framework Based on Improved Blockchain Structure

A Time-Sensitive and Efficient Hybrid Storage Model Involving SSD and HDD

HSM: A Hybrid Storage Method Based on the Heat of Data and Global Disk Space Utilization

Hierarchical Storage for Massive Social Network Data Based on Improved Decision Tree

WHOBBS: an Object-Based Distributed Hybrid Storage Providing Block Storage for Virtual Machines

Meta-Block: Exploiting Cross-Layer and Direct Storage Access for Decentralized Blockchain Storage Systems

High-Speed And Sustained Mass Data Storage System Based On Hierarchical Disk Array

T-Archive:Information Lifecycle Management System Based on Hierarchical Storage

hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems

Research on Auto-tiering Storage Model in Content Aware Storage System

Block-level Virtualization System for Mass Storage Networks

Distributed Storage Strategy and Visual Analysis for Economic Big Data