Abstract:To accommodate the explosively increasing amount of data in many areas such as scientific computing and e-Business, physical storage devices and control components have been separated from traditional computing systems to become a scalable, intelligent storage subsystem that, when appropriately designed, should provide transparent storage interface, effective data allocation, flexible and efficient storage management, and other impressive features. The design goals and desirable features of such a storage subsystem include high performance, high scalability, high availability, high reliability and high security. Extensive research has been conducted in this field by researchers all over the world, yet many issues still remain open and challenging. This paper studies five different online massive storage systems and one offline storage system that we have developed with the research grant support from China. The storage pool with multiple network-attached RAIDs avoids expensive store-and-forward data copying between the server and storage system, improving data transfer rate by a factor of 2–3 over a traditional disk array. Two types of high performance distributed storage systems for local-area network storage are introduced in the paper. One of them is the Virtual Interface Storage Architecture (VISA) where VI as a communication protocol replaces the TCP/IP protocol in the system. VISA’s performance is shown to achieve better than that of IP SAN by designing and implementing the vSCSI (VI-attached SCSI) protocol to support SCSI commands in the VI network. The other is a fault-tolerant parallel virtual file system that is designed and implemented to provide high I/O performance and high reliability. A global distributed storage system for wide-area network storage is discussed in detail in the paper, where a Storage Service Provider is added to provide storage service and plays the role of user agent for the storage system. Object based Storage Systems not only store data but also adopt the attributes and methods of objects that encapsulate the data. The adaptive policy triggering mechanism (APTM), which borrows proven machine learning techniques to improve the scalability of object storage systems, is the embodiment of the idea about smart storage device and facilitates the self-management of massive storage systems. A typical offline massive storage system is used to backup data or store documents, for which the tape virtualization technology is discussed. Finally, a domain-based storage management framework for different types of storage systems is presented in the paper.

A Serie Method of Massive Information Storage, Retrieval and Sharing

Cloud Storage of Massive Remote Sensing Data Based on Distributed File System

A Novel Scalable Architecture of Cloud Storage System for Small Files Based on P2P

Study on the P2P Cloud Storage System

Implementation of large-scale distributed information retrieval system

A distributed storage method of remote sensing data based on image blocks organization

A Kind of Cloud Storage Model Research Based on Massive Information Processing

A Hadoop-Based Efficient Economic Cloud Storage System

Mass Data Storage and Management Solution Based on Cloud Computing

Study on Cloud Storage System Based on Distributed Storage Systems

Massive Data HBase Storage Method for Electronic Archive Management

A Data Accessing Method in Distributed Massive Computing.

Massive Storage Systems

Research on Data Storage Technology in Cloud Computing Environment

Research on Distributed Storage Technology of Database Big Data Based on Cloud Computing

Towards a New Model of Storage and Access to Data in Big Data and Cloud Computing

A Cloud Computing Platform Technology Based on Space-based Intelligent Information Network

Design of the mass multimedia files storage architecture based on Hadoop

Research on remote sensing image storage management and a fast visualization system based on cloud computing technology

Distributed Heterogeneous Storage Based On Data Value

The Stndy of Massive lnformation Management System 13ased on Multilevel Storage Architecture