Abstract:With the emergence of cutting-edge hardware systems such as cloud computing, edge computing, and on-chip neural network accelerators, how to design advanced memory strategies to substitute the traditional ones for maximizing the potential performance of non-volatile memory (NVM) under the existing hardware conditions, has become an urgent research issue for both academia and industrial communities. It is promising and innovative to improve computer systems in the layer of data exchanging with the emerging advanced semiconductor devices. In the paper, to address the inefficiencies of write-intensive, high power consumption, low hit rate and so on, which exist in hybrid Magnetic Random Access Memory (MRAM) cache systems, three novel cache replacement strategies and two cache prefetching strategies are put forward. The proposed triple novel replacement strategies, including historical frequency and time judgments, duplicate data-aware deletion, and dynamic relevance factors computing, can be utilized to compensate for the shortcomings of the traditional Least Recently Used (LRU) replacement strategy, respectively. In the two novel prefetching strategies, region distribution parameters and Listnet ranking network are imported into the caching process, respectively, to achieve optimized hitting performance. The simulation results demonstrate that the proposed replacement strategies can achieve up to 61.76%, 84.91%, 56.49%, and 53.21% optimization of write count, hit rate, dynamic power, and IPC compared to the conventional one. The proposed prefetching strategy can achieve up to 91.27%, 49.25% hit rate and IPC optimization. Meanwhile, the synthetic evaluation of the replacement and prefetching strategies are elaborated in the paper, including multi-core characteristics, information entropy, interplays and the performance constraints between replacement and prefetching mechanism, which would facilitate more credible ideas for future memory inefficiencies management and strategy design.

An Efficient Data Prefetch Strategy for Deep Learning Based on Non-volatile Memory

The Impact of Non-linear NVM Devices on In-Memory Computing

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

Optimizing Off-Chip Memory Access for Deep Neural Network Accelerator

Optimizing for In-memory Deep Learning with Emerging Memory Technology

Learning Memory Access Patterns

Exploring DRAM Cache Prefetching for Pooled Memory

LIRS: Enabling efficient machine learning on NVM-based storage via a lightweight implementation of random shuffling

OnSRAM: Efficient Inter-Node On-Chip Scratchpad Management in Deep Learning Accelerators

Flash Memory Array for Efficient Implementation of Deep Neural Networks

Cognitive Ssd: A Deep Learning Engine For In-Storage Data Retrieval

Exploration and optimization of novel replacement and prefetching strategies for inefficiencies of advanced MRAM-based hybrid cache systems

DLV: Exploiting Device Level Latency Variations for Performance Improvement on Flash Memory Storage Systems

RecNMP: Accelerating Personalized Recommendation with Near-Memory Processing

Adaptive Prefetching for Accelerating Read and Write in NVM-Based File Systems

Attention, Distillation, and Tabularization: Towards Practical Neural Network-Based Prefetching

Data Allocation Optimization for Hybrid Scratch Pad Memory with SRAM and Nonvolatile Memory

Improving Memory Access Performance of In-Memory Key-Value Store Using Data Prefetching Techniques

PENDRAM: Enabling High-Performance and Energy-Efficient Processing of Deep Neural Networks through a Generalized DRAM Data Mapping Policy

Dynamic Adaptive Replacement Policy in Shared Last-Level Cache of DRAM/PCM Hybrid Memory for Big Data Storage

Architectural Support for NVRAM Persistence in GPUs