Abstract:With the increasing popularity of a large number of Internet-based services and a large number of services hosted on cloud platforms, a more powerful back-end storage system is needed to support these services. At present, it is very difficult or impossible to implement a distributed storage to meet all the above assumptions. Therefore, the focus of research is to limit different characteristics to design different distributed storage solutions to meet different usage scenarios. Economic big data should have the basic requirements of high storage efficiency and fast retrieval speed. The large number of small files and the diversity of file types make the storage and retrieval of economic big data face severe challenges. This paper is oriented to the application requirements of cross-modal analysis of economic big data. According to the source and characteristics of economic big data, the data types are analyzed and the database storage architecture and data storage structure of economic big data are designed. Taking into account the spatial, temporal, and semantic characteristics of economic big data, this paper proposes a unified coding method based on the spatiotemporal data multilevel division strategy combined with Geohash and Hilbert and spatiotemporal semantic constraints. A prototype system was constructed based on Mongo DB, and the performance of the multilevel partition algorithm proposed in this paper was verified by the prototype system based on the realization of data storage management functions. The Wiener distributed memory based on the principle of Wiener filter is used to store the workload of each workload distributed storage window in a distributed manner. For distributed storage workloads, this article adopts specific types of workloads. According to its periodicity, the workload is divided into distributed storage windows of specific duration. At the beginning of each distributed storage window, distributed storage is distributed to the next distributed storage window. Experiments and tests have verified the distributed storage strategy proposed in this article, which proves that the Wiener distributed storage solution can save platform resources and configuration costs while ensuring Service Level Agreement (SLA).

Analysis on Storage Virtualization Technology and Application Trends

On Application of Server Virtualization Technology in Campus Network Management

Cloud Storage As the Infrastructure of Cloud Computing

Design and Implementation of a Network-Based Virtualized Storage System

Survey of New Technology of Network Storage

Virtual Machine Based Energy-Efficient Data Center Architecture for Cloud Computing: A Performance Perspective.

Big Data Storage Architecture Design in Cloud Computing

Evaluate The Performance And Scalability Of Image Deployment In Virtual Data Center

Research on Distributed Storage Technology of Database Big Data Based on Cloud Computing

Research on Cloud Storage Technology in Digital Campus Big Data Scenario

Optimizing NVMe Storage for Large-scale Deployment: Key Technologies and Strategies in Alibaba Cloud

Research on Data Storage Technology in Cloud Computing Environment

TH-VSS: an asymmetric storage virtualization system for the SAN environment

The study and evaluation of ARM-based mobile virtualization

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Analysis of a Secure Virtual Desktop Infrastructure System

Distributed Storage Strategy and Visual Analysis for Economic Big Data

Research about Virtualization of ARM-Based Mobile Smart Devices

On Data and Virtualization Security Risks and Solutions of Cloud Computing.

Analysis of network storage mode in digital library

Big Data Storage Index Mechanism Based on Spatiotemporal Information Cloud Platform