Abstract:While the CBEA (Cell Broadband Engine Architecture) offers substantial computational power, its explicit multilevel memory hierarchy poses significant challenges to traditional programming, especially in performance and programmability. Software-managed cache is a technique that attempts to address such issues. But there still remain some limitations in current software-managed cache technologies. First, a complex managing logic of the full implementation of the software-managed cache which is not suitable for SPU designed as a vector computational unit influences computation significantly. Second, the external managing code of the software-managed cache causes the amount of computing code explosion. Besides increasing the computing burden of the accelerator, the external code occupies precious room of local storage which is shared by computing code and data. Finally, its inconvenient user interface presents significant obstacles for it to be widely applied. Based on the locality of memory access, this paper proposes an efficient software-managed cache named ECellS cache. In the paper, several customized library interfaces were designed respectively to simplify the cache implementation and reduce cache code size. On the other hand, the code segment of the application which accesses data residing in main memory frequently is defined as a cache section. Several of these types of cache sections could be combined into a cache bind and be managed in parallel by using SIMD technology. By this type of coarse-grain managing method and additional simplifying the construction of software cache, ECellS cache reduces both the burden of SPU to manage the cache buffer and the size of the cache managing code. Finally, based on local address remapping technology, a more convenient programming interface which is similar to OpenMP directive is presented to facilitate programming. By this technology, requesting for data residing in the main memory will be automatically mapped to cache buffer in local storage of SPE, and there needs to be no extra modifying for the computing source code inside the cache section except for inserting the directive outside of it. Experimental results of this paper based on the Cell processor demonstrate that our proposed software-managed cache improves performance by 15-35% over the CBE SDK software-managed cache in most test cases. With ECellS cache it could be more convenient for the user to develop and port applications based on CBE architecture.

FLeeC: a Fast Lock-Free Application Cache

Put an Elephant into a Fridge

Reo: Enhancing Reliability and Efficiency of Object-based Flash Caching

DEAM：Decoupled, Expressive, Area-Efficient Metadata Cache

FastCache: A Write-Optimized Edge Storage System Via Concurrent Merging Cache for IoT Applications

DartCache:a HashMap-Based Distributed Cache

FrozenHot Cache: Rethinking Cache Management for Modern Hardware.

FLORIA: A Fast and Featherlight Approach for Predicting Cache Performance.

Acar: An Adaptive Cost Aware Cache Replacement Approach For Flash Memory

Fast and Scalable In-network Lock Management Using Lock Fission.

SEA Cache: A Performance-Efficient Countermeasure for Contention-based Attacks

ALFE: A replacement policy to cache elephant flows in the presence of mice flooding

Learning Cache Replacement with CACHEUS

Lightweight and Accurate Memory Allocation in Key-Value Cache

Cache-Aware Lock-Free Concurrent Hash Tries

FASTA: Revisiting Fully Associative Memories in Computer Microarchitecture

LAMA: Optimized Locality-aware Memory Allocation for Key-value Cache.

An Efficient Software-Managed Cache Based on Cell Broadband Engine Architecture.

Optimizing Locality-Aware Memory Management of Key-Value Caches.

Falcon: Fast OLTP Engine for Persistent Cache and Non-Volatile Memory

wCQ: A Fast Wait-Free Queue with Bounded Memory Usage