Abstract:Many massive data processing applications nowadays often need long, continuous, and uninterrupted data accesses. Distributed file systems are used as the back-end storage to provide the global namespace management and reliability guarantee. Due to increasing hardware failures and software issues with the growing system scale, metadata service reliability has become a critical issue as it has a direct impact on file and directory operations. Existing metadata management mechanisms can provide fault tolerance capability to some level but are inadequate. They often have limitations in system availability, state consistence, and performance overhead and lack an effective mechanism to offer metadata reliability. This paper introduces a novel highly reliable metadata service to address these issues in large-scale file systems. Different from traditional strategies, this proposed reliable metadata service adopts a new active-standby architecture for fault tolerance and uses a holistic approach to improve file system availability. A new shared storage pool (SSP) is designed for transparent metadata synchronization and replication between active and standby servers. Based on the SSP, a new policy called multiple actives multiple standbys (MAMS) is presented to perform metadata service recovery in case of failures. A new global state recovery strategy and a smart client fault tolerance mechanism are achieved to maintain the continuity of metadata service. We have implemented such highly reliable metadata service in a prototype file system CFS (Clover file system) and conducted extensive tests to evaluate it. Experimental results confirm that it can significantly improve file system reliability with fast failover under different failure scenarios while having negligible influence on performance. Compared with typical reliability designs in Hadoop Avatar, Hadoop HA, and Boom-FS file systems, the mean-time-to-recovery (MTTR) with the highly reliable metadata service was reduced by 80.23, 65.46 and 28.13 percent, respectively.

Metadata Optimization Method for Distributed File System Based on SSD Feature

A Metadata Cooperative Caching Architecture Based on SSD and DRAM for File Systems

Metadata-intensive I/O Optimizations in Parallel File Systems

Optimization Of Index-Based Method Of Metadata Search For Large-Scale File Systems

NVM-Accelerated Metadata Management for Flash-Based SSDs

x Meta : SSD-HDD-Hybrid Optimization for Metadata Maintenance of Cloud-Scale Object Storage

Small File Access Optimization Based on Glusterfs

File Creation Optimization for Metadata-Intensive Application in File Systems.

Adaptive Tradeoff In Metadata-Based Small File Optimizations For A Cluster File System

Analysis of the File System and Block IO Scheduler for SSD in Performance and Energy Consumption

Freewrite: creating (almost) zero-cost writes to SSD in applications.

Performance Optimization of Small File I/O with Adaptive Migration Strategy in Cluster File System

An efficient metadata management method in large distributed storage systems

Macss: A metadata-aware combo storage system

An Improvement of Static Subtree Partitioning in Metadata Server Cluster

Distributed storage and retrieval of massive small files metadata

FDSSS: An Efficient Metadata Management Scheme in Large Scale Data Environment

ConeSSD: A Novel Policy to Optimize the Performance of HDFS Heterogeneous Storage.

A Highly Reliable Metadata Service for Large-Scale Distributed File Systems

Proxy Based Metadata Optimization and Implementation in Parallel Filesystem

A Server-Driven Lockless Method for File Metadata Operations