Abstract:Scalability and Latency are the two important performance indicators for the distributed file system, and Google and Apache have achieved a great success with GFS and HDFS when operating big files, but the latency is too long when reading and writing small-size files, because the concurrent I/O can't work for small files, besides the master node is difficult to extend in the cloud storage system with Master/Slave structure. In this paper, we propose a distributed cloud storage system based on P2P, where a central route node is introduced to improve the resource query efficiency, so clients can find data using only one message compared with Chord's log(N). The central routing node only stores the status and routing information of all data nodes, which are indexed by the Trie Tree structure, so query time meets the requirement of online query. The data nodes store file's content and file's metadata thus the system is easy to extend because the master node no longer needs to store the metadata. Clients can also cache the routing information, so the read and write time is reduced according to the Locality Principle. Experiments show that the reading and writing time is significantly reduced compared with Hadoop HDFS.

The Design and Implementation of a Slice-based Loose-coupled Distributed File System

A Novel Scalable Architecture of Cloud Storage System for Small Files Based on P2P

QDFS: A Quality-Aware Distributed File Storage Service Based on HDFS

QoSC: A QoS-Aware Storage Cloud Based on HDFS

A Scheme to Construct Global File System

Cumulus: A Distributed File System Based on Network Coding

The Framework of a Distributed File System for Geospatial Data Management.

Global File Store: a Massive Storage System on the Internet - Concept and Design

Cloud Storage of Massive Remote Sensing Data Based on Distributed File System

CSFS: a Java Enabled Network File Storage System

Design and implementation of K-distributed file system

A scalable version control layer in p2p file system

Design and Implementation of Scalable Grid File Access Interface

A Distributed File System with Variable Sized Objects for Enhanced Random Writes.

GridFS: A Web-Based Data Grid for the Distributed Sharing of Educational Resource Files.

CorsairFS: A Distributed File System for Campus Network

USING A CLUSTER FILE SYSTEM -- TH-CLUFS -- TO CONSTRUCT A SCALABLE CLUSTER SYSTEM OF WEB SERVERS

Distributed File Streamer: A Framework for Distributed Application Data Coupling

Grid File System Used in Remote Education Resource Management

Navigating the Landscape of Distributed File Systems: Architectures, Implementations, and Considerations

Adaptive file-grain distribution in a cluster file system