Abstract:With the rapid development of computer and network technology, to deal with explosively growing mass data correctly, distributed file systems have come into being, and they have been applied in many enterprises. However, in the packet storage process, the traditional TCP/IP transmission protocol has to pass through the operating system and application software layer. It takes up many server resources and memory bus bandwidth, which places a heavy burden on the server’s CPU and memory. In this paper, we analyze the research status of the distributed file system based on analyzing and comparing the advantages of RDMA over traditional TCP Ethernet communication architecture. We propose an optimization scheme for the network transmission performance of the original FastDFS to replace the original TCP module with an RDMA network communication module, and we design a lightweight distributed file system with higher performance than the original FastDFS, which is suitable for small file storage. Using the zero-copy technology and kernel bypass technology of soft RDMA, the network communication mechanism in FastDFS is optimized to free the server’s CPU from heavy data processing work. In this paper, the RDMA-based FastDFS is compared with the original FastDFS. The test results show that the network transmission performance of the optimized FastDFS is improved compared with the original FastDFS, which achieves the expected effect and can better meet the requirements of mass small file storage for today’s Internet applications.

Design and Implementation of Distributed Personal File System

Study on the P2P Cloud Storage System

Research and Implementation of a Scalable Distributed Mail System

Design and implementation of K-distributed file system

Research and Design on The Distributed Network Storage Management System

Distributed Secure File System Based on LDAP and SSH

Data Acquisition and Distributed Computing System Based on Embedded Network

Design and Implementation of Distributed Real-time Data Processing System

Design and Optimization of a Distributed File System Based on RDMA

Distributed collaborative CAD system framework based on Web Service

EStore: A User-Friendly Encrypted Storage Scheme for Distributed File Systems

Investigation on Distributed File System for Scientific Big Data Storage

Distributed File Streamer: A Framework for Distributed Application Data Coupling

CDN AND P2P-BASED DISTRIBUTED NETWORK STORAGE SYSTEM

A Seismic Data Processing System based on Fast Distributed File System

DESIGN AND IMPLEMENTATION OF THREE PARTIES FTP SYSTEM BASED ON WEB SERVICE

The Design and Implementation of a Slice-based Loose-coupled Distributed File System

Design of Distributed Storage System on Peer-to-Peer Structure

Research and Design of MDS in Distributed Storage System

Navigating the Landscape of Distributed File Systems: Architectures, Implementations, and Considerations

P2P-based Distributed Storage System