Abstract:Performance and scalability requirements have a fundamental role in most large-scale software applications. To satisfy such requirements, caching is often used at various levels and infrastructure layers. Application-level caching -- or memoization -- is an increasingly used form of caching within the application boundaries, which consists of storing the results of computations in memory to avoid re-computing them. This is typically manually done by developers, who identify caching opportunities in the code and write additional code to manage the cache content. The task of identifying caching opportunities is a challenge because it requires the analysis of workloads and code locations where it is feasible and beneficial to cache objects. To aid developers in this task, there are approaches that automatically identify cacheable methods. Although such approaches have been individually evaluated, their effectiveness has not been compared. We thus in this paper present an empirical evaluation to compare the method recommendations made by the two existing application-level caching approaches at the method level, namely APLCache and MemoizeIt, using seven open-source web applications. We analyse the recommendations made by each approach as well as the hits, misses and throughput achieved with their valid caching recommendations. Our results show that the effectiveness of both approaches largely depends on the specific application, the presence of invalid recommendations and additional configurations, such as the time-to-live. By inspecting the obtained results, we observed in which cases the recommendations of each approach fail and succeed, which allowed us to derive a set of seven lessons learned that give directions for future approaches to support developers in the adoption of this type of caching.

Performance Model for Similarity Caching

Computing the Hit Rate of Similarity Caching

Optimizing Timer-based Policies for General Cache Networks.

Fast Miss Ratio Curve Modeling For Storage Cache

On the Convergence of the TTL Approximation for an LRU Cache under Independent Stationary Request Processes

Content Placement in Networks of Similarity Caches

What, When and Where to Cache: A Unified Optimization Approach.

Optimal Model of Web Caching

On the Analysis of Cache Invalidation With LRU Replacement

Kinetic Modeling Of Data Eviction In Cache

A Comparative Study of Application-level Caching Recommendations at the Method Level

Caching with Time Domain Buffer Sharing

On the Impact of Network Delays on Time-to-Live Caching

SwiftCache: Model-Based Learning for Dynamic Content Caching in CDNs

A novel cache replacement policy for Web content delivery

Accurate Learning or Fast Mixing? Dynamic Adaptability of Caching Algorithms.

The Exact Rate-Memory Tradeoff for Caching with Uncoded Prefetching

Network cache design under stationary requests: Exact analysis and Poisson approximation

Show me the Cache: Optimizing Cache-Friendly Recommendations for Sequential Content Access

RL-Cache: an Efficient Reinforcement Learning Based Cache Partitioning Approach for Multi-Tenant CDN Services

An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guarantees