Abstract:With the increasing popularity of a large number of Internet-based services and a large number of services hosted on cloud platforms, a more powerful back-end storage system is needed to support these services. At present, it is very difficult or impossible to implement a distributed storage to meet all the above assumptions. Therefore, the focus of research is to limit different characteristics to design different distributed storage solutions to meet different usage scenarios. Economic big data should have the basic requirements of high storage efficiency and fast retrieval speed. The large number of small files and the diversity of file types make the storage and retrieval of economic big data face severe challenges. This paper is oriented to the application requirements of cross-modal analysis of economic big data. According to the source and characteristics of economic big data, the data types are analyzed and the database storage architecture and data storage structure of economic big data are designed. Taking into account the spatial, temporal, and semantic characteristics of economic big data, this paper proposes a unified coding method based on the spatiotemporal data multilevel division strategy combined with Geohash and Hilbert and spatiotemporal semantic constraints. A prototype system was constructed based on Mongo DB, and the performance of the multilevel partition algorithm proposed in this paper was verified by the prototype system based on the realization of data storage management functions. The Wiener distributed memory based on the principle of Wiener filter is used to store the workload of each workload distributed storage window in a distributed manner. For distributed storage workloads, this article adopts specific types of workloads. According to its periodicity, the workload is divided into distributed storage windows of specific duration. At the beginning of each distributed storage window, distributed storage is distributed to the next distributed storage window. Experiments and tests have verified the distributed storage strategy proposed in this article, which proves that the Wiener distributed storage solution can save platform resources and configuration costs while ensuring Service Level Agreement (SLA).

An Efficient Hierarchical Data Placement Algorithm for Massive Spatial Data Storage Systems

HGeoHashBase: an Optimized Storage Model of Spatial Objects for Location-Based Services

A New Linkless Hierarchical Structure Based on Perfect Hashing

HBaseSpatial: A Scalable Spatial Data Storage Based on HBase

Efficient Spatial Big Data Storage and Query in HBase.

A Study of Performance Optimization Method for Massive Spaito-temporal Data Based on Spatio-temporal Partition Clustering

Study of Seamless Organization and Storage Structure for Massive Spatio-Temporal Data

Management of Massive Spatial Data Based on Feature-Oriented Object Level Model

A Tree-Based Hierarchy Data Storage Framework in A Pervasive Space

Vector Spatial Big Data Storage and Optimized Query Based on the Multi-Level Hilbert Grid Index in HBase

A spatial data partition algorithm based on statistical cluster

QoS-Aware Data Placement for MapReduce Applications in Geo-Distributed Data Centers

A Packaging Approach for Massive Amounts of Small Geospatial Files with HDFS.

Big Data Storage Index Mechanism Based on Spatiotemporal Information Cloud Platform

Spatial-Htm: A Mapreduce-Based System For Querying Spatial Data With The Hierarchical Triangular Mesh

A New Storage Architecture Based on Global Subdivision Theory for Spatial Data

Massive volume data organization in geo-science based on relational database

Distributed Storage Strategy and Visual Analysis for Economic Big Data

Adaptive priority-based data placement and multi-task scheduling in geo-distributed cloud systems

A Study on Data Storage and Management for Massive Remote Sensing Data Based on Multi-level Grid Model

Distributed Storage And Index Of Vector Spatial Data Based On Hbase