Manuscript of a method for improving wear in intermittently computing file systems

Yeteng Liao,Han wang

DOI: https://doi.org/10.48550/arXiv.2304.05399

2023-04-11

Other Computer Science

Abstract:For the first time, the repeated wear phenomenon of high-frequency power failure on the data block area in intermittent computing file system is found. A method to improve NVM wear in ICFS under high-frequency power failure scenarios is proposed.

What problem does this paper attempt to address?

FPGA Implementation of NAND Flash Wear-Levelling Algorithm

Ju Hong Wen,Wei Jiang Wang,Wei Gao,Fan Xiao

DOI: https://doi.org/10.4028/www.scientific.net/amm.241-244.1209

2012-01-01

Applied Mechanics and Materials

Abstract:NAND flash would generate invalid blocks during its manufacturing and using, and the invalid block management is a key point of NAND flash. By studying the structure and storage rules of NAND flash, this paper put forward a wear-levelling algorithm against the invalid blocks of NAND flash based on FPGA. This algorithm use invalid block table and logical-physical address mapping table to manage the invalid blocks and do wear-levelling. The design is implemented by VHDL, and successfully realized the wear-levelling and the reading and writing operations of NAND flash.
WLVT: A Static Wear-Leveling Algorithm with Variable Threshold

Yuan-Hua Yang,Xian-Bin Xu,Shui-Bing He,Fang Zhen,Yu-Ping Zhang

DOI: https://doi.org/10.4028/www.scientific.net/amr.756-759.3131

2012-01-01

Abstract:NAND flash memory has been successfully employed in storage system due to its advantages such as performance, resistance, and capacity. NAND flash memory based solid state disk (SSD) has started to replace disk in numerous environments. However, the poor endurance offered by these SSDs continues to be their key shortcoming. To improve SSD endurance, we propose a static wear-leveling algorithm with variable threshold (WLVT). In contrast with traditional algorithm with fixed threshold, WLVT adjusts the value of threshold, so that each block can simultaneously reach the erasure times that the manufacturer gives when life of SSD is over. Therefore, available erasure time of each block will be fully utilized when SSD fails. Experimental results show that the endurance of the SSD is significantly improved.
An Efficient NVM based Architecture for Intermittent Computing under Energy Constraints

SatyaJaswanth Badri,Mukesh Saini,Neeraj Goel

DOI: https://doi.org/10.1109/TVLSI.2023.3266555

2023-04-06

Abstract:Battery-less technology evolved to replace battery technology. Non-volatile memory (NVM) based processors were explored to store the program state during a power failure. The energy stored in a capacitor is used for a backup during a power failure. Since the size of a capacitor is fixed and limited, the available energy in a capacitor is also limited and fixed. Thus, the capacitor energy is insufficient to store the entire program state during frequent power failures. This paper proposes an architecture that assures safe backup of volatile contents during a power failure under energy constraints. Using a proposed dirty block table (DBT) and writeback queue (WBQ), this work limits the number of dirty blocks in the L1 cache at any given time. We further conducted a set of experiments by varying the parameter sizes to help the user make appropriate design decisions concerning their energy requirements. The proposed architecture decreases energy consumption by 17.56%, the number of writes to NVM by 18.97% at LLC, and 10.66% at a main-memory level compared to baseline architecture.

Hardware Architecture
Coded worn block mechanism to reduce garbage collection in SSD

Yan Liu,Zaimei Zhang,Jilong Xu,Guoqi Xie,Renfa Li

DOI: https://doi.org/10.1016/j.sysarc.2022.102487

IF: 5.836

2022-05-01

Journal of Systems Architecture

Abstract:Over-provisioning space is a part of storage reserved in the SSD, it is used to replace worn blocks. The reduction of over-provisioning space has negative effects on the performance of SSD. Although worn blocks reach program/erase limit, they can still retain data. A common solution to reuse worn blocks is to periodically read and write back a data before it is unreliable. However, data scrubbing adversely affects SSD lifespan because it incurs extra read and write.In this work, we propose coded worn block FTL (CW-FTL) to maintain performance of SSD. CW-FTL stores cold data in worn blocks, but with added parity to address the higher error rate of worn blocks. A worn block reaches maximum program/erase cycles stipulated by industry can store data. CW-FTL manages worn blocks to store cold data that is not updated frequently, and uses parity-based redundancy to ensure data reliability. The performance and lifespan of SSD are maintained while the data reliability of worn blocks is guaranteed. Our experiments validate that CW-FTL can decrease wear of SSD and maintain its performance without performance degradation compared to existing data correct-and-refresh method.

computer science, software engineering, hardware & architecture
Toss-up Wear Leveling

Xian Zhang,Guangyu Sun

DOI: https://doi.org/10.1145/3061639.3062329

2017-01-01

Abstract:Limited write endurance is one of major obstacles to adopt Phase Change Memories (PCMs) in practice as future main memory. Considering process variation (PV) and non-uniform write intensity, PCM cells with low endurance (i.e. weak cells) can wear out in seconds under intensive writes. To prolong PCMs' lifetime, many PV-aware wear leveling schemes have been proposed following a common idea: intensive writes are predicted and allocated to cells with high endurance (i.e. strong cells) based on the write intensity distribution, which should be consistent at predicted intervals. However, we discover that this idea leaves a serious vulnerability against a malicious program, which is designed to have an inconsistent write intensity distribution. Prior wear-leveling schemes can even be leveraged to speed up wearing out weak cells. To counteract this attack, we propose Toss-up Wear Leveling (TWL), a novel scheme that randomly allocates writes between two bond blocks discounting the consistency of write distribution. Experiment results demonstrate that, compared to prior works, TWL can improve lifetime substantially with negligible overhead in performance and hardware cost.
An Effective Dynamic Wear Leveling In The Application Of Solid State Drives

Wei-Neng Wang,Kai Ni,Jian-She Ma,Zong-Chao Wan,Yi Zhao,Long-Fa Pan

2010-01-01

Abstract:NAND flash memory has become one of the most popular storage media for portable devices, such as MP3 players, MMC cards and solid state drives. Due to erase-before-write characteristics of NAND flash memory, Wear-Leveling strategy, especially dynamic wear-leveling strategy, is very important in deciding the performance and lifetime of flash memory in solid state drives. In this paper, to reduce the map table size and improve the performance of solid state drives, we propose an effective dynamic wear leveling based on a novel "triple-pool" structure for NAND flash memory in solid state drives. Comparing with previous dynamic wear-leveling strategies, theoretical analysis shows that our strategy saves memory space (includes both SDRAM and flash memory) through the novel "triple-pool" structure, and improves the reading and writing speed by reducing the search time.
A Collaborative Defense Against Wear out Attacks in Non-Volatile Processors

Patrick Cronin,Chengmo Yang,Yongpan Liu

DOI: https://doi.org/10.1145/3195970.3196825

2018-01-01

Abstract:While the Internet of Things (IoT) keeps advancing, its full adoption is continually blocked by power delivery problems. One promising solution is Non-Volatile (NV) processors, which harvest energy for themselves and employ a NV memory hierarchy. This allows them to perform computations when power is available, checkpoint and hibernate when power is scarce, and resume their work at a later time. However, utilizing NV memory creates new security vulnerabilities in the form of wear out attacks in the register file. This paper explores the dangers of this design oversight and proposes a mitigation strategy that takes advantage of the unique properties and operating characteristics of NV processors. The proposed defense integrates the power management unit and a two-level register rotation approach, which improves NV processor endurance by 30.1× in attack situations and an average of 7.1× in standard workloads.
Stabilizing and Boosting I/O Performance for File Systems with Journaling on NVMe SSD

State Grid Electric Power Research Institute,Tang Bin,Ye Baoliu,Wu Jianyu,Wang Xiaoliang,Lu Sanglu

DOI: https://doi.org/10.1007/s11432-019-2808-x

2021-01-01

Science China Information Sciences

Abstract:Many journaling file systems currently use non-volatile memory-express (NVMe) solid-state drives (SSDs) as external journal devices to improve the input and output (I/O) performance. However, when facing microwrite workloads, which are typical of many applications, they suffer from severe I/O fluctuations and the NVMe SSD utilization is extremely low. The experimental results indicate that this phenomenon arises mainly because writing back data to backend file systems on hard disk drives is much slower than journal writing, causing journal writing to frequently freeze because of the two-phase mechanism. We, therefore, propose a merging-in-memory (MIM) acceleration architecture to stabilize and boost the I/O performance for such journaling file systems. MIM employs an efficient data structure of hash-table-based multiple linked lists in memory, which not only merges random microwrites into sequential large blocks to speed up writebacks but also provides additional gains in terms of reducing the frequency of write addressing and object opening and closing. Using a prototype implementation in Ceph FileStore, we experimentally show that MIM not only eliminates severe fluctuations but also improves the I/O operations per second by roughly 1×–12× and reduces the write latency by 75%–98%.
Relieving Compression-Induced Local Wear on Non-Volatile Memory Block via Sliding Writes

Kailun Jin,Yajuan Du,Mingzhe Zhang,Zhenghao Yin,Rachata Ausavarungnirun

DOI: https://doi.org/10.3390/mi14030568

2023-02-27

Abstract:Due to its non-volatility and large capacity, NVM devices gradually take place at various levels of memories. However, their limited endurance is still a big concern for large-scale data centres. Compression algorithms have been used to save NVM space and enhance the efficiency of those lifetime extension methods. However, their own influence on the NVM lifetime is not clear. In order to fully investigate the impact of compression on NVM, this paper first studies bit flips involved in several typical compression algorithms. It is found that more bit flips would happen in the shrunken area of a memory block. This induces the phenomenon of intra-block wear unevenness, which sacrifices NVM lifetime. We propose a new metric called local bit flips to describe this phenomenon. In order to relieve the intra-block wear unevenness caused by compression, this paper proposes a sliding write method named SlidW to distribute the compressed data across the whole memory block. We first divide the memory block into several areas, and then consider five cases about the relationship between new data size and left space. Then, we place the new data according to the case. Comprehensive experimental results show that SlidW can efficiently balance wear and enhance NVM lifetime.
An Efficient Dynamic Wear Leveling for Huge-Capacity Flash Storage Systems with Cache.

Wei-Neng Wang,Kai Ni,Jian-She Ma,Yi Zhao,Zong-Chao Wang,Long-Fa Pan

DOI: https://doi.org/10.1142/s0218126612500302

2012-01-01

Abstract:Flash memory won its edge than other storage media for its advantages, such as shock resistance, low power consumption and high data transmission speed. However, new data is written out-of-place due to the characteristics of flash memory, which is diverse from traditional magnetic media. Out-of-place update results in the wear-leveling issue over flash memory for erasing blocks to reclaim invalid pages. This paper proposed a dynamic wear (DW)-leveling design without substantially increasing overhead and without modifying Flash Translation Layer (FTL) for huge-capacity flash storage systems with cache, which is based on segmentation threshold and Least Recently Used (LRU). Experimental results show that our design levels the wear of different physical blocks, reduces extra page coping and block erasing, and improves the read/write performance. Additionally, different thresholds impacting wear leveling are also discussed.
NICFS:a File System Based on Persistent Memory and SmartNIC

Yitian Yang,Youyou Lu

DOI: https://doi.org/10.1631/fitee.2200469

2023-01-01

Abstract:Emergence of new hardware,including persistent memory and smart network interface card(SmartNIC),has brought new opportunities to file system design.In this paper,we design and implement a new file system named NICFS based on persistent memory and SmartNIC.We divide the file system into two parts:the front end and the back end.In the front end,data writes are appended to the persistent memory in a log-structured way,leveraging the fast persistence advantage of persistent memory.In the back end,the data in logs are fetched,processed,and patched to files in the background,leveraging the processing capacity of SmartNIC.Evaluation results show that NICFS outperforms Ext4 by about 21％/10％and about 19％/50％on large and small reads/writes,respectively.
Enhancing Endurance of Huge-Capacity Flash Storage Systems by Selectively Replacing Data Blocks.

Wei-Neng Wang,Kai Ni,Jian-She Ma,Zong-Chao Wang,Yi Zhao,Long-Fa Pan

DOI: https://doi.org/10.1587/transinf.e95.d.558

2012-01-01

IEICE Transactions on Information and Systems

Abstract:The wear leveling is a critical factor which significantly impacts the lifetime and the performance of flash storage systems. To extend lifespan and reduce memory requirements, this paper proposed an efficient wear leveling without substantially increasing overhead and without modifying Flash Translation Layer FTL) for huge-capacity flash storage systems, which is based on selective replacement. Experimental results show that our design levels the wear of different physical blocks with limited system overhead compared with previous algorithms.
Protect Non-Volatile Memory from Wear-out Attack Based on Timing Difference of Row Buffer Hit/miss.

Haiyu Mao,Xian Zhang,Guangyu Sun,Jiwu Shu

DOI: https://doi.org/10.23919/date.2017.7927251

2017-01-01

Abstract:Non-volatile Memories (NVMs), such as PCM and ReRAM, have been widely proposed for future main memory design because of their low standby power, high storage density, fast access speed. However, these NVMs suffer from the write endurance problem. In order to prevent a malicious program from wearing out NVMs deliberately, researchers have proposed various wear-leveling methods, which remap logical addresses to physical addresses randomly and dynamically. However, we discover that side channel leakage based on NVM row buffer hit information can reveal details of address remappings. Consequently, it can be leveraged to side-step the wear-leveling. Our simulation shows that the proposed attack method in this paper can wear out a NVM within 137 seconds, even with the protection of state-of-the-art wear-leveling schemes. To counteract this attack, we further introduce an effective countermeasure named Intra-Row Swap (IRS) to hide the wear-leveling details. The basic idea is to enable an additional intrarow block swap when a new logical address is remapped to the memory row. Experiments demonstrate that IRS can secure NVMs with negligible timing/energy overhead, compared with previous works.
NIS: A New Index Scheme for Flash File System

Yang Ou,Xiaoquan Wu,Nong Xiao,Fang Liu,Wei Chen

DOI: https://doi.org/10.1109/CBD.2015.17

2015-01-01

Abstract:NAND flash memory has become a popular alternative to replace disks in a storage system because of its non-volatility, high I/O performance, shock resistance, and low power consumption. However, NAND flash memory has characteristics of erase-before-write and limited cycles of write and erase operations, which introduce new challenges into the design of file system. Index schemes of conventional file systems do not consider flash memory characteristics, which results in poor performance. We propose a new index scheme both in directory structure and file data for NAND flash file system in this paper, which is called NIS. NIS has two features: hybrid extendable hash-based directory structure, HyEx Hash and adaptive file data index. The HyEx Hash integrates the static hashing that has the fixed number of hash items and dynamic hashing that can create overflow bucket at run-time to achieve better update performance and search efficiency. The adaptive file data index also uses hybrid scheme that includes traditional indirect index for large files and direct index for small files to reduce locating cost in terms of file size. To further reduce cost of locating small files, we separate direct index from indirect index and store it together with files themselves. The experimental results show that NIS reduces the index cost by 25% to 55%, and outperforms the state-of-the-art file systems both in throughput and in read/write bandwidth.
Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory

Wei Liu,Kai Wu,Jialin Liu,Feng Chen,Dong Liu

DOI: https://doi.org/10.1109/nas.2017.8026869

2017-01-01

Abstract:HPC applications pose high demands on I/O performance and storage capability. The emerging non-volatile memory (NVM) techniques offer low- latency, high bandwidth, and persistence for HPC applications. However, the existing I/O stack are designed and optimized based on an assumption of disk-based storage. To effectively use NVM, we must re-examine the existing high performance computing (HPC) I/O sub-system to properly integrate NVM into it. Using NVM as a fast storage, the previous assumption on the inferior performance of storage (e.g., hard drive) is not valid any more. The performance problem caused by slow storage may be mitigated; the existing mechanisms to narrow the performance gap between storage and CPU may be unnecessary and result in large overhead. Thus fully understanding the impact of introducing NVM into the HPC software stack demands a thorough performance study. In this paper, we analyze and model the performance of I/O intensive HPC applications with NVM as a block device. We study the performance from three perspectives: (1) the impact of NVM on the performance of traditional page cache; (2) a performance comparison between MPI individual I/O and POSIX I/O; and (3) the impact of NVM on the performance of collective I/O. We reveal the diminishing effects of page cache, minor performance difference between MPI individual I/O and POSIX I/O, and performance disadvantage of collective I/O on NVM due to unnecessary data shuffling. We also model the performance of MPI collective I/O and study the complex interaction between data shuffling, storage performance, and I/O access patterns.
Extending the lifetime of flash-based storage through reducing write amplification from file systems.

Youyou Lu,Jiwu Shu,Weimin Zheng

DOI: https://doi.org/10.5555/2591272.2591299

2013-01-01

Abstract:Flash memory has gained in popularity as storage devices for both enterprise and embedded systems because of its high performance, low energy and reduced cost. The endurance problem of flash memory, however, is still a challenge and is getting worse as storage density increases with the adoption of multi-level cells (MLC). Prior work has addressed wear leveling and data reduction, but there is significantly less work on using the file system to improve flash lifetimes. Some common mechanisms in traditional file systems, such as journaling, metadata synchronization, and page-aligned update, can induce extra write operations and aggravate the wear of flash memory. This problem is called write amplification from file systems. In order to mitigate write amplification, we propose an object-based flash translation layer design (OFTL), in which mechanisms are co-designed with flash memory. By leveraging page metadata, OFTL enables lazy persistence of index metadata and eliminates journals while keeping consistency. Coarse-grained block state maintenance reduces persistent free space management overhead. With byte-unit access interfaces, OFTL is able to compact and co-locate the small updates with metadata to further reduce updates. Experiments show that an OFTL-based system, OFSS, offers a write amplification reduction of 47.4%-89.4% in SYNC mode and 19.8%-64.0% in ASYNC mode compared with ext3, ext2, and btrfs on an up-to-date page-level FTL.
A low hardware cost wear-leveling algorithm for application of smart mobile terminals

Hongfei Zou,Liyang Pan

DOI: https://doi.org/10.1109/ICSESS.2014.6933750

2014-01-01

Abstract:NAND flash memory has become a widely-used data storage media. With the scaling down of the cell size, the limited endurance of flash memory is becoming a critical issue. Wear-leveling is employed to evenly distribute program/erase and extend the reliability and lifetime of flash memory. In this paper, a novel wear-leveling algorithm is proposed based on three ideas: firstly, a Block Status Table instead of block erase cycle is constructed to record the status of blocks with lower SRAM consumption; secondly, the heavily worn blocks are screened to involve in garbage collection and free page allocation during dynamic wear-leveling; thirdly, an adjustable threshold is employed to improve the performance of static wear-leveling. Compared to three other state-of-the-art wear-leveling algorithms, the simulation results show that the proposed algorithm features with well wear-leveling performance and larger maximum writable data for five different applications and can reduce the SRAM consumption by 54-60%.
NVMFS-IOzone

Shengke Li,Dagang Li,Dennis Wu,Xiaogang Chen

DOI: https://doi.org/10.1145/3383669.3398281

2020-01-01

Abstract:With the emerging of NVM (Non-Volatile Memories) technologies, NVMM-based (Non-Volatile Main Memories) file systems have attracted more and more attention. Compared to traditional file systems, most NVMM-based file systems bypass the page cache and the I/O software stack. With the new mmap interface known as the DAX-mmap interface (DAX: direct access), the CPU can access the NVMM much faster by loading from/storing to it directly. However, the existing file system benchmark tools are designed for traditional file systems and do not support the new features of NVMM-based file systems, so the returned results are very often not accurate. In this paper, a new benchmark tool called NVMFS-IOzone is proposed. The behavior of the tool is redesigned to reflect the new features of NVMM-based file systems. The NVM-lib from Intel is used instead of traditional msync() to keep data consistent when evaluating the performance of the DAX-mmap interface. Experimental results show that the new benchmark tool can reveal a hidden improvement of 1.4~2.1 times in NVMM-based file systems, which cannot be seen by the traditional evaluation tools. The data paths of direct load/store to NVMM and bypassing CPU cache are also provided to support the new ##features of NVMM-based file systems for multidimensional evaluation. Furthermore, embedded cleaning-ups has also been added to NVMFS-IOzone to support convenient evaluation consistency, which benefits both NVMM-based and non-NVMM-based file system benchmarking even for quick and casual tests. The whole experimental evaluation is based on real physical NVMs rather than simulated NVMs, and the experimental results confirm the effectiveness of our design.
A Software-hardware Collaborating Framework for Wear Leveling on Phase Change Memory

Licheng Yu,Tianzhou Chen,JianZhong Wu

DOI: https://doi.org/10.1109/hpcc.2012.200

2012-01-01

Abstract:DRAM has been used as main memory in most systems, but its scalability and energy consumption are difficult to improve because of its architecture nature. Phase change memory (PCM) is a new non-volatile memory, which addresses these problems and is a promising candidate to replace DRAM as main memory. Since PCM cell has a very limited lifetime, many hardware methods have been proposed to improve its endurance with only low-level information about physical memory operations. Meanwhile, operating system manages physical page mapping, and it has the knowledge of memory layout as well as memory requirements of each process. This paper investigates write behaviors of different memory areas of processes, and proposes a software-hardware collaborating framework that captures process write behavior with simple hardware to enable process write behavior predication by operating system. The framework combines operating system and PCM controller that exploits write behaviors of processes to aid in PCM wear leveling. The results show this framework helps reduce PCM page swaps for wear leveling by 63% on average. And it also lowers the writes of the most worn page by 12% with single process, and by 21% with two parallel processes sharing the PCM.
Adaptive Prefetching for Accelerating Read and Write in NVM-Based File Systems

Shengan Zheng,Hong Mei,Linpeng Huang,Yanyan Shen,Yanmin Zhu

DOI: https://doi.org/10.1109/iccd.2017.17

2017-01-01

Abstract:The byte-addressable Non-Volatile Memory (NVM) offers fast, fine-grained access to persistent storage. While DRAM and NVM have similar read performance, the write operations of existing NVM materials incur longer latency and lower bandwidth than DRAM. This read-write asymmetry nature of NVM causes two bottlenecks for accessing read-and write-intensive file data: expensive data block lookups via file inner structure and high-latency direct writes to data blocks in NVM. However, existing NVM-based file systems fail to address both bottlenecks well. This paper presents WARP, an adaptive prefetching module designed for NVM-based file systems, which aims to deal with two bottlenecks effectively. WARP employs two acceleration approaches: 1) mapping data blocks into kernel virtual address space to bypass the indirection of file inner structure for read-intensive file data; and 2) allocating DRAM buffer to absorb frequent writes for write-intensive file data. We design a WARP benefit model to identify read-and write-intensive access patterns for file data, and use a successor prediction model to predict future data access based on historical file access traces. With WARP, we are able to prefetch file data according to both file access patterns and traces with consistency guarantee. WARP can be implemented on various NVM-based file systems, and we choose HMVFS for the experiments. The evaluation results show that HMVFS with WARP provides high prefetching accuracy and up to 32%-83% improvement compared with the state-of-the-art NVM-based file systems.

Manuscript of a method for improving wear in intermittently computing file systems

FPGA Implementation of NAND Flash Wear-Levelling Algorithm

WLVT: A Static Wear-Leveling Algorithm with Variable Threshold

An Efficient NVM based Architecture for Intermittent Computing under Energy Constraints

Coded worn block mechanism to reduce garbage collection in SSD

Toss-up Wear Leveling

An Effective Dynamic Wear Leveling In The Application Of Solid State Drives

A Collaborative Defense Against Wear out Attacks in Non-Volatile Processors

Stabilizing and Boosting I/O Performance for File Systems with Journaling on NVMe SSD

Relieving Compression-Induced Local Wear on Non-Volatile Memory Block via Sliding Writes

An Efficient Dynamic Wear Leveling for Huge-Capacity Flash Storage Systems with Cache.

NICFS:a File System Based on Persistent Memory and SmartNIC

Enhancing Endurance of Huge-Capacity Flash Storage Systems by Selectively Replacing Data Blocks.

Protect Non-Volatile Memory from Wear-out Attack Based on Timing Difference of Row Buffer Hit/miss.

NIS: A New Index Scheme for Flash File System

Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory

Extending the lifetime of flash-based storage through reducing write amplification from file systems.

A low hardware cost wear-leveling algorithm for application of smart mobile terminals

NVMFS-IOzone

A Software-hardware Collaborating Framework for Wear Leveling on Phase Change Memory

Adaptive Prefetching for Accelerating Read and Write in NVM-Based File Systems