UBIFS Flash File System Analysis and Research

Gao-ming JU,Jian-xin YU

2014-01-01

Abstract:Describe Unsorted Block Image File System, then analyse the garbage collection and wear leveling algorithm deeply. meanwhile, introduce a new feature:fastmap.then do experimental analysis on fastmap, prove that fastmap can significantly reduce mount time.

What problem does this paper attempt to address?

Embedded File Systems for Large-scale Flash Memory

Qiang LI,Wei DU,Chundi Mu

DOI: https://doi.org/10.3969/j.issn.1000-3428.2005.10.027

2005-01-01

Abstract:A new file system devising page-unit storage format for files is proposed. A benefit-cost algorithm for garbage collection considerin temporal locality and wear leveling is also presented. Measurements demonstrate that contrasting with JFFS2, this file system improves garbag collection efficiency and system performance while reducing the footprint and leveling the worn-out.
Journal-based Block Images for Flash Memory Storage Systems.

Lei Jiao,Yanyuan Zhang,Wei Lin

DOI: https://doi.org/10.1109/icycs.2008.371

2008-01-01

Abstract:Flash memory has been widely used in various embedded systems as a novel nonvolatile storage media. There are currently two different approaches to store data on flash memory. One is to build a FTL (Flash Translation Layer) on flash memory and use traditional disk file systems on top of it; the other is to build dedicated flash file systems directly on flash memory. In order to address the common flash handling mechanisms redundantly implemented in FTL and flash file systems, BIL (Block Images Layer) has been developed. At present, the most common BIL is UBI (Unsorted Block Images), which still have some drawbacks making it inappropriate for high capacity flash chips. In this paper, we propose JBI (Journal-based Block Images), a novel BIL based on the journal system. The mapping management of JBI is completely based on the proposed journal system. Our performance evaluation demonstrates that JBI outperforms UBI significantly.
Fat File System Design and Research

Haoyu Zhao,Xiongfei Li,Liang Chang,Xuebai Zang

DOI: https://doi.org/10.1109/icnisc.2015.114

2015-01-01

Abstract:The Fat File System has a clear structure, can be managed easily. At the same time, the simplified structure has some shortage, such as low speed. Attempt to use map management and B+-Tree as new ways to improve it, and store and manage the B+-tree index with map. File system comparative test data can be clearly demonstrated: The use of B + tree index significantly improves the query speed of FAT file system.
Analysis and comparison of NAND flash specific file systems

Shu Liu,Xuetao Guan,Dong Tong,Xu Cheng

DOI: https://doi.org/10.23919/cje.2010.10167491

IF: 1.019

2010-01-01

Chinese Journal of Electronics

Abstract:NAND flash memory becomes one of the most popular storage devices in embedded system and mobile computers. Efficient flash file system designs are important for system designers and users. In this paper, we study the design issues and performance of flash-specific file systems and define four performance metrics to evaluate flash file systems. Then, detailed comparisons of three mainstream flash file systems are conducted, including JFFS2, YAFFS2 and UBIFS. Taking techniques used in the three file systems and evaluation results into account, flash file system design space is discussed. This paper can provide users a comprehensive understanding of NAND flash file system design, present guidelines for measurement of flash file systems and help users determine which file system best meets their need.
Frequent Pattern-Based Mapping at Flash Translation Layer of Solid-State Drives.

Jun Li,Xiaofei Xu,Bowen Huang,Jianwei Liao,Xiaoning Peng

DOI: https://doi.org/10.1109/access.2019.2929056

IF: 3.9

2019-01-01

IEEE Access

Abstract:In order to reduce the overhead of garbage collection, as well as yield an even erasure distribution of blocks in solid-state drives (SSDs), this paper proposes a mapping approach at flash translation layer (FTL) of the SSD devices. To be specific, it first analyzes certain I/O requests, for mining frequent item sets of logical sector numbers, to direct scheduling the write requests. After that, we map the requests belonging to the same frequent itemset, to the SSD blocks having a relative small erasure count. That is to say, these requests are supposed to be flushed onto the same SSD blocks when they have been ejected from the cache. As a result, the data on the same block are mostly like to be rewritten together in the near future, so that the overhead of garbage collection can be significantly cut down. Furthermore, it is able to yield a uniform erasure distribution among all blocks of SSDs even without wear-leveling optimization, to purposely extend the lifetime of the SSDs. Through a series of simulation experiments with a number of write-intensive disk traces of real-world applications, we conclude that this newly proposed mechanism does work, as expected.
Design and Implementation of Fast Mounting Mechanism for Flash File System

焦磊,张延园

DOI: https://doi.org/10.3969/j.issn.1000-3428.2008.18.100

2008-01-01

Abstract:Based on embedded file system Compact Flash File System(CFFS) which is oriented for large-scale NAND flash chips, this paperproposes a fast mounting mechanism.The mechanism uses the data structures such asstatic super block,reference node,page bit mapandadopts some corresponding algorithms, soit avoids the full scanning of the flash chip when the file system is being mounted.Test shows that themechanism can reduce the mounting time significantly when the file system is mounted on large-scale NAND flash chips.
ParaFS: A Log-Structured File System to Exploit the Internal Parallelism of Flash Devices.

Jiacheng Zhang,Jiwu Shu,Youyou Lu

2016-01-01

Abstract:File system designs are undergoing rapid evolution to exploit the potentials of flash memory. However, the internal parallelism, a key feature of flash devices, is hard to be leveraged in the file system level, due to the semantic gap caused by the flash translation layer (FTL). We observe that even flash-optimized file systems have serious garbage collection problems, which lead to significant performance degradation, for write-intensive workloads on multi-channel flash devices. In this paper, we propose ParaFS to exploit the internal parallelism while ensuring efficient garbage collection. ParaFS is a logstructured file system over a simplified blocklevel FTL that exposes the physical layout. With the knowledge of device information, ParaFS first proposes 2-D data allocation, to maintain the hot/cold data grouping in flash memory while exploiting channel-level parallelism. ParaFS then coordinates the garbage collection in both FS and FTL levels, to make garbage collection more efficient. In addition, ParaFS schedules read/write/erase requests over multiple channels to achieve consistent performance. Evaluations show that ParaFS effectively improves system performance for write-intensive workloads by 1.6× to 3.1×, compared to the flash-optimized F2FS file system.
GC-ARM: Garbage Collection-Aware RAM Management for Flash Based Solid State Drives

Jian Hu,Hong Jiang,Lei Tian,Lei Xu

DOI: https://doi.org/10.1109/NAS.2012.22

2012-01-01

Abstract:Previous on-board RAM management algorithms of SSD are oblivious of garbage collection (GC) efficiency in that they fail to analyze the performance degradation from the perspective of GC efficiency and thus unable to find the true culprit. For some workloads that do not generate enough invalid data, these approaches will suffer from severe performance degradation. Further, the existing write-buffer component in SSD is by and large oblivious of how FTL works in SSD, unable to minimize the address translation overhead. The GC efficiency and FTL obliviousness of SSD RAM buffer management can result in significantly increased GC-induced and address-translation-induced write traffic to the flash memory, which is very harmful to both performance and endurance. To address these performance and endurance issues of SSD, we propose GC-ARM, an SSD RAM management scheme consisting of a write buffer component and an FTL component. On the one hand, the write-buffer design of GC-ARM can improve the garbage collection efficiency by evaluating the benefits of different destaging approaches. On the other hand, the FTL component is designed to interact with the write-buffer component to reduce the address translation overhead. Moreover, GC-ARM optimizes the size ratio of RAM space allocated to the write buffer and the FTL's mapping table based on the varying randomness of workloads. Extensive trace-driven evaluation results show that GC-ARM consistently outperforms the state-of-the-art FTL and buffer management schemes in terms of the number of erasures, average response time, garbage collection efficiency and write traffic reduction.
Niffs: A New Index Flash File System for Network Applications

Yang Ou,Xiaoquan Wu,Nong Xiao,Fang Liu,Wei Chen

DOI: https://doi.org/10.6138/jit.2017.18.4.20160510

2017-01-01

Abstract:Nowadays, big data has been one of the hottest research frontiers. It puts forward higher requirements to network storage systems. Flash memory has become a popular alternative to replace disks in the network storage systems because of its high performance. However, it has characteristics of erase-before-write and limited cycles of erase operations, which introduce new challenges into the design of file system. Conventional file systems do not consider flash memory characteristics, and bring extra writes to flash memory. We propose a new flash file system named NIFFS, to reduce the writes to flash memory and promote the performance on index. To reduce the writes, NIFFS redesigns data layout, inode structure and data organization. NIFFS promotes index performance by hybrid extendable hash-based directory structure (HyEx Hash) and adaptive file data index. In addition, NIFFS also provides metadata log to avoid frequent updating in metadata. Meanwhile, garbage collection with different granularities is used to reclaims obsoletes and a fast recovery which guarantees consistency by shrinking scanning space. The experimental results show that NIFFS reduces the index cost by 25% to 55%, and outperforms the state-of-the-art file systems both in throughput, read/write bandwidth, and endurance.
Research on the Flash Translation Layer Based on Grouping Pages

Li Wang,Min Zhu,Chunling Yang,Xiaoming Qiu,Yang Jiao

DOI: https://doi.org/10.1109/IMCCC.2016.174

2016-01-01

Abstract:Flash Translation Layer (FTL) is a key technology in a Solid-State Disk (SSD) system to manage the data transfer. Different mapping granularity in FTL will cause a change in the read/write performance and the size of mapping table. For the scenario that big capacity storage needs to hold high performance, on the basis of former mapping algorithms, this paper design a mapping method based on grouping pages granularity, and a SSD system architecture based on the parallelism of flash chip array. Besides, considering the features of the mapping method, we implement the corresponding wear-leveling algorithm and garbage collection algorithm. By computer simulation verifying, under four kinds of workload, the method proposed in this paper can decrease the size of mapping table and keep excellent read/write performance at the same time.
BPCLC: an Efficient Write Buffer Management Scheme for Flash-Based Solid State Disks.

Hui Zhao,Peiquan Jin,Puyuan Yang,Lihua Yue

DOI: https://doi.org/10.4156/jdcta.vol4.issue6.15

2010-01-01

International Journal of Digital Content Technology and its Applications

Abstract:Flash memory has been widely used for storage devices in various embedded systems and enterprise computing environment, due to its shock-resistance, low power consumption, non-volatile, and high I/O speed. However, its physical characteristics impose several limitations in the design of flash-based solid state disks (SSDs). For example, its write operation costs much more time than read operation, and data in flash memory can not be overwritten before being erased. In particular, random write operations in flash memory have a very poor performance. To overcome these limitations, we propose a page-clustered LRU write buffer management scheme for flash-based SSDs, which is named BPCLC (Block Padding Cold and Large Cluster first). BPCLC adopts a new block padding technique to improve the write performance of flash-based SSDs. We conduct a trace-driven experiment and use two types of workloads to compare the performance of BPCLC with three competitors including FAB, BPLRU, and CLC. The results show that in both types of workloads, BPCLC outperforms its competitors with respect to write count, erase count, merge count, and overall I/O overhead.
HIFFS: A Hybrid Index for Flash File System.

Yang Ou,Xiaoquan Wu,Nong Xiao,Fang Liu,Wei Chen

DOI: https://doi.org/10.1109/nas.2015.7255241

2015-01-01

Abstract:Flash memory, especially NAND flash memory, has become a popular alternative for the design of storage system. Index schemes of conventional file systems do not take the flash memory characteristics into account and will cause poor performance. The current flash file systems work well only in the case of small capacity. To address the problem, we propose a new hybrid indexing scheme both in directory structure and file data index for NAND flash file system in this paper, which is called HIFFS (a Hybrid Index for Flash File System). HIFFS contains two components: hash tree directory and adaptive file data index. The hash tree directory uses a hash-based index to get better update performance and search efficiency. The adaptive file data index uses different file index strategy according to file size. The experiment results show that HIFFS outperforms the state-of-the-art file systems both in throughput.
Mitigating Synchronous I/O Overhead in File Systems on Open-Channel SSDs

Youyou Lu,Jiwu Shu,Jiacheng Zhang

DOI: https://doi.org/10.1145/3319369

2019-01-01

ACM Transactions on Storage

Abstract:Synchronous I/O has long been a design challenge in file systems. Although open-channel solid state drives (SSDs) provide better performance and endurance to file systems, they still suffer from synchronous I/Os due to the amplified writes and worse hot/cold data grouping. The reason lies in the controversy design choices between flash write and read/erase operations. While fine-grained logging improves performance and endurance in writes, it hurts indexing and data grouping efficiency in read and erase operations. In this article, we propose a flash-friendly data layout by introducing a built-in persistent staging layer to provide balanced read, write, and garbage collection performance. Based on this, we design a new flash file system (FS) named StageFS, which decouples the content and structure updates. Content updates are logically logged to the staging layer in a persistence-efficient way, which achieves better write performance and lower write amplification. The updated contents are reorganized into the normal data area for structure updates, with improved hot/cold grouping and in a page-level indexing way, which is more friendly to read and garbage collection operations. Evaluation results show that, compared to recent flash-friendly file system (F2FS), StageFS effectively improves performance by up to 211.4% and achieves low garbage collection overhead for workloads with frequent synchronization.
A New Type Of Nand Flash-Based File System: Design And Implementation

Tianzhou Chen,Xiangsheng Wang,Wei Hu,Wei Duan

DOI: https://doi.org/10.1109/WiCOM.2006.408

2006-01-01

Abstract:Flash memory has become the primary external storage for embedded systems especially NAND flash for data update. Currently JFFS2 and YAFFS2 are used as the primary file systems for flash memory. But there are two deficiencies in them. One is that their boot time for a large-sized flash memory is too long. They must scan the whole partition to initialize the file system and it's really time-consuming. The other is their high memory consumption rate. A new type of NAND flash-based file system named SMARTFFS (SMART Flash File System) is proposed in this paper, which can reduce both the initializing time and the SRAM memory consumption rate effectively.
An Empirical Study of NVM-based File System

Hongwei Duan,Liang Shi,Qingfeng Zhuge,Edwin Hsing-Mean Sha,Changlong Li,Yujiong Hang

DOI: https://doi.org/10.1109/NVMSA53655.2021.9628430

2021-01-01

Abstract:Emerging byte-addressable. non-volatile memory provides opportunities for preserving files in memory. However, there is no systematic performance study across different file systems. This paper evaluates the performance of modern NVM-based file systems (e.g., PMFS, SIMFS, and NOVA) with a series of preliminary studies. Several interesting findings are concluded with our study, which should be well considered by file system designers during the employment. Furthermore, this paper explores the visualization of NVM-based file systems and develops NVMPlayer. To the best of our knowledge, this is the first graphical tool to display the internal mechanisms of NVM-based file systems. It demonstrates how visualization can help us shed light on the complex phenomena in NVM-based file system and expose new opportunities for optimization.
The Design and Implementation of an Efficient User-Space In-Memory File System

Edwin H. -M. Sha,Yang Jia,Xianzhang Chen,Qingfeng Zhuge,Weiwen Jiang,Jiejie Qin

DOI: https://doi.org/10.1109/nvmsa.2016.7547176

2016-01-01

Abstract:The file accesses of existing in-memory file systems have additional costs for traversing the software stacks of the kernel, such as VFS. To avoid such costs, the existing file systems generally enable user-space file accesses using the memorymapped file (mmap) techniques. The mmap approaches, however, are add-ons of the file systems in the kernel level that have large overhead for mapping the files into the user space. In this paper, we propose the design of a genuine user-space in-memory file system. A user-space in-memory file system is designed and implemented. The software routines of the file operations in the proposed file system are re-designed to enable user-space file accesses and be compatible with the POSIX interfaces. A file can be mapped into the user space in constant time regardless of the file size. The file data of the implemented file system can be accessed in the user space with consistency. Our design achieves high performance utilizing the contiguous virtual address space of the user process and the address translation hardware. Extensive experiments are conducted. The experimental results show that the proposed file system surpasses any of the existing file systems. To the authors' knowledge, our design is the first genuine userspace file system in the literature.
Design and Implementation of a Hybrid Mapping Flash Translation Layer

Zhi-ping YU,Wei LIU,Hu PENG,Yao-hui ZHANG

DOI: https://doi.org/10.3969/j.issn.1000-3428.2014.02.065

2014-01-01

Abstract:Flash Translation Layer(FTL) is always needed when NAND Flash is used in a memory device. Page level translation is the most popular, but needs a large RAM to store mapping table. This pager employs a superblock based hybrid mapping, and realizes a basic FTL on the Solid State Disk(SSD) development board. The test result shows that the hybrid FTL has good sequential read and write performance, and only needs 128 KB SRAM, which is far less than page level mapping. It also does not need to store mapping table. The program runs successfully in solid state disk development board, to achieve the basic functions of solid state disk read and write. Test results show that, the hybrid mapping FTL scheme has better sequential read and write performance.
Adaptive Garbage Collection Mechanism for N-log Block Flash Memory Storage Systems

Yehua Du,Ming Cai,Jinxiang Dong

DOI: https://doi.org/10.1109/ICAT.2006.31

2006-01-01

Abstract:Write operations in flash memory should be preceded by erase operations, which take an order of magnitude longer than writes. Therefore an update of a single byte causes an erasing of the whole block as well as restoration of a large amount of data. In order to avoid erasing during every update, non-in-place update schemes have been used. Obsolete data are later recycled by garbage collection. In this paper, we study a new garbage collection algorithm for the N-log block flash memory storage system, to reduce the recycling cost such as the number of erase operations and the number of data copies. The proposed scheme selects the victims according to the age and utilization. And selection algorithm changes dynamically with the I/O workload. Experimental results show that the proposed scheme reduces the extra erase operations greatly.
Enhancing Endurance of Huge-Capacity Flash Storage Systems by Selectively Replacing Data Blocks.

Wei-Neng Wang,Kai Ni,Jian-She Ma,Zong-Chao Wang,Yi Zhao,Long-Fa Pan

DOI: https://doi.org/10.1587/transinf.e95.d.558

2012-01-01

IEICE Transactions on Information and Systems

Abstract:The wear leveling is a critical factor which significantly impacts the lifetime and the performance of flash storage systems. To extend lifespan and reduce memory requirements, this paper proposed an efficient wear leveling without substantially increasing overhead and without modifying Flash Translation Layer FTL) for huge-capacity flash storage systems, which is based on selective replacement. Experimental results show that our design levels the wear of different physical blocks with limited system overhead compared with previous algorithms.
A Garbage Collection Algorithm for Flash File System Based on Differential Evolution

SHI Zheng,JI Jin-song,CHEN Xiang-lan,GONG Yu-chang

2011-01-01

Abstract:Flash memory based storage systems are becoming increasingly prevalent.Garbage collection plays an important role in such systems.This paper analyzes popular file system overload,and points out the problems of existing GC algorithms:the performance of Garbage Collection decreases dramatically under high capacity utilization,which has a great impact on write speed.Then the paper proposes a new flash memory garbage collection mechanism based on differential evolution algorithm(DEbGC),which considers the speed and wear leveling in garbage collection.The experimental results show that DEbGC could amortize the overhead of garbage collection,decrease erase count and number of page copies while satisfying overall performance and wear leveling.

UBIFS Flash File System Analysis and Research

Embedded File Systems for Large-scale Flash Memory

Journal-based Block Images for Flash Memory Storage Systems.

Fat File System Design and Research

Analysis and comparison of NAND flash specific file systems

Frequent Pattern-Based Mapping at Flash Translation Layer of Solid-State Drives.

Design and Implementation of Fast Mounting Mechanism for Flash File System

ParaFS: A Log-Structured File System to Exploit the Internal Parallelism of Flash Devices.

GC-ARM: Garbage Collection-Aware RAM Management for Flash Based Solid State Drives

Niffs: A New Index Flash File System for Network Applications

Research on the Flash Translation Layer Based on Grouping Pages

BPCLC: an Efficient Write Buffer Management Scheme for Flash-Based Solid State Disks.

HIFFS: A Hybrid Index for Flash File System.

Mitigating Synchronous I/O Overhead in File Systems on Open-Channel SSDs

A New Type Of Nand Flash-Based File System: Design And Implementation

An Empirical Study of NVM-based File System

The Design and Implementation of an Efficient User-Space In-Memory File System

Design and Implementation of a Hybrid Mapping Flash Translation Layer

Adaptive Garbage Collection Mechanism for N-log Block Flash Memory Storage Systems

Enhancing Endurance of Huge-Capacity Flash Storage Systems by Selectively Replacing Data Blocks.

A Garbage Collection Algorithm for Flash File System Based on Differential Evolution