Abstract:Function-as-a-Service (FaaS) introduces a lightweight, function-based cloud execution model that finds its relevance in applications like IoT-edge data processing and anomaly detection. While CSP offer a near-infinite function elasticity, these applications often experience fluctuating workloads and stricter performance constraints. A typical CSP strategy is to empirically determine and adjust desired function instances, "autoscaling", based on monitoring-based thresholds such as CPU or memory, to cope with demand and performance. However, threshold configuration either requires expert knowledge, historical data or a complete view of environment, making autoscaling a performance bottleneck lacking an adaptable solution.RL algorithms are proven to be beneficial in analysing complex cloud environments and result in an adaptable policy that maximizes the expected objectives. Most realistic cloud environments usually involve operational interference and have limited visibility, making them partially observable. A general solution to tackle observability in highly dynamic settings is to integrate Recurrent units with model-free RL algorithms and model a decision process as a POMDP. Therefore, in this paper, we investigate a model-free Recurrent RL agent for function autoscaling and compare it against the model-free Proximal Policy Optimisation (PPO) algorithm. We explore the integration of a LSTM network with the state-of-the-art PPO algorithm to find that under our experimental and evaluation settings, recurrent policies were able to capture the environment parameters and show promising results for function autoscaling. We further compare a PPO-based autoscaling agent with commercially used threshold-based function autoscaling and posit that a LSTM-based autoscaling agent is able to improve throughput by 18%, function execution by 13% and account for 8.4% more function instances.

Application of Proximal Policy Optimization for Resource Orchestration in Serverless Edge Computing

SimuScale: Optimizing Parameters for Autoscaling of Serverless Edge Functions Through Co-Simulation

On-demand Cold Start Frequency Reduction with Off-Policy Reinforcement Learning in Serverless Computing

Optimizing simultaneous autoscaling for serverless cloud computing

QoS-aware offloading policies for serverless functions in the Cloud-to-Edge continuum

A Deep Reinforcement Learning based Algorithm for Time and Cost Optimized Scaling of Serverless Applications

Intent-driven orchestration of serverless applications in the computing continuum

A Deep Recurrent-Reinforcement Learning Method for Intelligent AutoScaling of Serverless Functions

Optimized Container Scheduling for Data-Intensive Serverless Edge Computing

On the Analysis of Inter-Relationship between Auto-Scaling Policy and QoS of FaaS Workloads

FaaSConf: QoS-aware Hybrid Resources Configuration for Serverless Workflows

EdgeOrcher: Predictive Function Orchestration for Serverless-Based Edge Native Applications.

Spatio-Temporal Resource Meshes for Serverless Computing

Optimization of Task-Scheduling Strategy in Edge Kubernetes Clusters Based on Deep Reinforcement Learning

Performance Optimization in Serverless Edge Computing Environment Using DRL-Based Function Offloading

Kubernetes distributions for the edge: serverless performance evaluation

Exploiting Wide-Area Resource Elasticity with Fine-Grained Orchestration for Serverless Analytics

Tiny Autoscalers for Tiny Workloads: Dynamic CPU Allocation for Serverless Functions

Heterogeneity-aware Proactive Elastic Resource Allocation for Serverless Applications

Context-aware Container Orchestration in Serverless Edge Computing

Proactive Autoscaling for Edge Computing Systems with Kubernetes