Abstract:Nowadays, big data has been one of the hottest research frontiers. It puts forward higher requirements to network storage systems. Flash memory has become a popular alternative to replace disks in the network storage systems because of its high performance. However, it has characteristics of erase-before-write and limited cycles of erase operations, which introduce new challenges into the design of file system. Conventional file systems do not consider flash memory characteristics, and bring extra writes to flash memory. We propose a new flash file system named NIFFS, to reduce the writes to flash memory and promote the performance on index. To reduce the writes, NIFFS redesigns data layout, inode structure and data organization. NIFFS promotes index performance by hybrid extendable hash-based directory structure (HyEx Hash) and adaptive file data index. In addition, NIFFS also provides metadata log to avoid frequent updating in metadata. Meanwhile, garbage collection with different granularities is used to reclaims obsoletes and a fast recovery which guarantees consistency by shrinking scanning space. The experimental results show that NIFFS reduces the index cost by 25% to 55%, and outperforms the state-of-the-art file systems both in throughput, read/write bandwidth, and endurance.

FRAID: A Networked Data Storage Layout

Flash: A Dependable Networked Data Storage Solution

File System Implementation Method to Improve the Network Storage Performance

The Jigsaw secure distributed file system

A Data Layout Method in Heterogeneous RAID

Disk Tree - A Case Of Parallel Storage Architecture To Improve Performance In Random Access Pattern

A Cluster Storage Architecture on Network-Attached Object-Based Devices

Consistent Hash Based Flexible Redundant Data Partition Strategy

Land House: A Network Storage Structure Combining Regular Graph with Distributed Hash Table and Its Data Accessing Methods

Niffs: A New Index Flash File System for Network Applications

A New Network Storage Architecture of Cache-Cluster Based on Scheduling Decision Strategy

An Efficient File Assignment Strategy for Hybrid Parallel Storage System with Energy & Reliability Constraints

Distributed Storage Cluster Design for Remote Mirroring Based on Storage Area Network.

Design and Implementation Analysis of Storage Management System Based on Third-Party Transfer Mechanism

BFXM: A Parallel File System Model Based on the Mechanism of Distributed Shared Memory.

Data Layouts of Parallel Storage System Based on Ordinal Selection

Flexible Networked Data Storage Center

Research on a New Type of Network-Attached Object Based Storage Device

A Performance-Optimizing Dependable Virtual Storage Scheme

A Migratory Heterogeneity-Aware Data Layout Scheme for Parallel File Systems.

Active Block Layout