Abstract:In this paper, we investigate 'optimistic' online caching policies, distinguished by their use of future request predictions derived, for example, from machine learning models. Traditional online optimistic policies, grounded in the Follow-The-Regularized-Leader (FTRL) algorithm, incur a higher computational cost compared to classic policies like Least Frequently Used (LFU) and Least Recently Used (LRU). This is due to each cache state update necessitating the resolution of a constrained optimization problem. To address this problem, we introduce and analyze the 'batched' version of two distinct FTRL-based optimistic policies. In this approach, the cache updates occur less frequently, thereby amortizing the update cost over time or over multiple requests. Rather than updating the cache with each new request, the system accumulates a batch of requests before modifying the cache content. First, we present a batched version of the Optimistic Bipartite Caching (OBC) algorithm, that works for single requests, then we introduce a new optimistic batched caching policy, the Per-Coordinate Optimistic Caching (PCOC) algorithm, derived from the per-coordinate-based FTRL. We demonstrate that these online algorithms maintain 'vanishing regret' in the batched case, meaning their average performance approaches over time that of an optimal static file allocation, regardless of the sequence of file requests. We then compare the performance of these two strategies with each other and against optimistic versions of LFU and LRU. Our experimental results indicate that this batched optimistic approach outperforms traditional caching policies on both stationary and real-world file request traces.

Optimal Caching for Partial-observation Regime and Beyond

Learning to Caching under the Partial-Feedback Regime

Online Caching With Switching Cost and Operational Long-Term Constraints: An Online Learning Approach.

Caching in Dynamic Environments: A Near-Optimal Online Learning Approach

Online Caching with Optimal Switching Regret

An Online Gradient-Based Caching Policy with Logarithmic Complexity and Regret Guarantees

Delay-Optimal Edge Caching with Imperfect Content Fetching Via Stochastic Learning

Frame-Level Video Caching and Transmission Scheduling Via Stochastic Learning

Optimistic online caching for batched requests

On the Regret of Online Coded Caching

No-Regret Caching via Online Mirror Descent

Delay-Optimal Edge Cache Replacement with Non-Markovian Content Fetching

User Preference Learning Based Edge Caching for Fog Radio Access Network

Clustered Popularity Prediction for Content Caching

On the Regret of Coded Caching with Adversarial Requests

Practical Bounds on Optimal Caching with Variable Object Sizes

Reinforcement Learning-Based Optimal Computing and Caching in Mobile Edge Network

Learning from Optimal Caching for Content Delivery.

Near-Optimal Bounds for Online Caching with Machine Learned Advice

Caching With Personalized and Incumbent-Aware Recommendation: Modeling and Optimization