Abstract:The Sunway TaihuLight supercomputer has been installed for several years and many applications have been ported or built for TaihuLight. Initially most applications running on TaihuLight are with regular memory access patterns, such as dense linear algebra, structured grids and dynamic programming. At the year of 2018, developers have published a general purpose graph processing framework, a ported version of LAMMPS and a sparse triangular solver. These applications are with irregular memory access patterns which need a lot of special processings to make use of the computing processing elements (CPEs) of TaihuLight. While those strategies are efficient, doing such processing may be difficult for wider range of applications, especially for the constantly changing molecular dynamics applications or dynamic unstructured grids. In this paper, we present our work of designing a general purpose software cache library, SWCache, for simplifying the work of applying software cache in kernels, as well as a series of tools for tuning and modelling the performance of our software cache. After a series of optimizations including reordering branches for better branch prediction, hand-tuning register allocation, we evaluate our implementation in two mini-apps: miniFE and miniMD. Experiments show that our tuned software cache library can be applied in these applications, and can provide 20% speedup in miniMD compared to the strategies in a previous port of LAMMPS. Also, the workload of writing code can be reduced by using our library. Besides, the experience of efficient macro-based programming should be valuable for further application development on CPEs which are lack of C++ support.

CacheBit: A Multisource-Multitarget Cache Instrumentation Tool

Cache Miss Reduction Through Hardware-Assisted Loop Optimization

A Light-weight Code Cache Design for Dynamic Binary Translation

Code Cache Management Based on Working Set in Dynamic Binary Translator

MTCrossBit: A Dynamic Binary Translation System Based on Multithreaded Optimization

Using Pcache to Speedup Interpretation in Dynamic Binary Translation.

Static Analysis for Fast and Accurate Design Space Exploration of Caches

An Analytical Approach for Fast and Accurate Design Space Exploration of Instruction Caches

CINDA: Don't Ignore Instructions when Cloning Memory Access Behavior

Instruction High-speed Cache Optimization Techniques Based on Statistic Analysis

Cache Access Simulation of MPI Programs Under Heterogeneous Environment Using Single Computer

MTCrossBit: A Dynamic Binary Translation System Using Multithreaded Optimization Framework

Crossbit: A Multi-Sources And Multi-Targets Dbt

An Improved Block Based Trace Cache

Vscp: A Cache Controlling Method for Improving Single Thread Performance in Multicore System

A Utility Based Cache Optimization Mechanism for Multi-Thread Workloads

Hardware/Software Co-Simulation for Last Level Cache Exploration

B-Cache: A Behavior-Level Caching Framework for the Programmable Data Plane

Tuning a General Purpose Software Cache Library for TaihuLight’s SW26010 Processor

Data Cache Parameter Measurements

A Benchmark Suite for Evaluating Caches' Vulnerability to Timing Attacks