Abstract:ABSTRACTScientific applications use checkpointing for failure recovery. The existing checkpointing approaches were proposed for storing persistent states of applications as checkpoints in disk-based file systems via the block interface. As non-volatile main memory (NVMM) will be included in high-performance computing systems, storing the checkpoints in NVMM-based file systems can significantly waste the performance benefits of NVMM. This is because it under-utilizes memory resources and it does not take advantage of the byte-addressability of NVMM. In this paper, we propose an NVMM-aware checkpointing approach, named NV-Checkpoint. It uses a compiler-aided technique to automatically generate multi-version data structures, which consist of both the persistent version of data stored in NVMM for failure recovery and the ephemeral version of data placed across DRAM and NVMM. Because of the byte-addressability of NVMM, any versions can be accessed via the memory interface. The multiple versions may share data that are not mutated during the program's execution to reduce data redundancy. NV-Checkpoint provides the same level of guarantee of failure recovery compared to the conventional checkpointing approaches proposed for file systems. Furthermore, its runtime system manages the layout of the data structures to reduce the number of writes to NVMM. It also manages the checkpointing frequency to reduce persistence overhead using machine learning models. Our experimental results with real-world scientific applications show that the performance of annotated programs with NV-Checkpoint using a hybrid of DRAM and NVMM matches the performance of best-effort hand-written versions. It achieves similar scalability as those with ephemeral data structures using only DRAM. It offers up to 121X speedup of execution time compared to the conventional checkpointing approaches using the Atlas parallel file system on the Titan supercomputer.

Efficient Incremental Checkpoint Based on Hybrid Page

Hybrid Full/incremental Checkpoint/restart for MPI Jobs in HPC Environments

Parallelizing Checkpoint for Faster Fault Tolerance

A Hot-Page Aware Hybrid-Copy Migration Method.

AdapCK: Optimizing I/O for Checkpointing on Large-Scale High Performance Computing Systems.

A Study on the Method of Adaptive Time Intervals Checkpointing

Improving Bank-Level Parallelism for In-Memory Checkpointing in Hybrid Memory Systems

Design and Implementation of a Low-Overhead File Checkpointing Approach

Dual-Page Checkpointing

Mitigating I/O Impact of Checkpointing on Large Scale Parallel Systems

Self-Checkpoint

The Checkpoint Interval Optimization of Kernel-Level Rollback Recovery Based on the Embedded Mobile Computing System

An Improved Scheme Of Index-Based Checkpointing

Optimization of kernel-level checkpoint mechanism for wearable computer systems

Research on Optimum Checkpoint Interval for Hybrid Fault Tolerance.

Lightweight checkpoint of vi rtual machine memory

A New Adaptive Checkpointing Strategy for Mobile Computing

Compiler aided checkpointing using crash-consistent data structures in NVMM systems

Parallel Compression Checkpointing for Socket-Level Heterogeneous Systems

FITDOC: fast virtual machines checkpointing with delta memory compression