Abstract:Serverless computing has seen rapid growth due to the ease-of-use and cost-efficiency it provides. However, function scheduling, a critical component of serverless systems, has been overlooked. In this paper, we take a first-principles approach toward designing a scheduler that caters to the unique characteristics of serverless functions as seen in real-world deployments. We first create a taxonomy of scheduling policies along three dimensions. Next, we use simulation to explore the scheduling policy space for the function characteristics in a 14-day trace of Azure functions and conclude that frequently used features such as late binding and random load balancing are sub-optimal for common execution time distributions and load ranges. We use these insights to design Hermes, a scheduler for serverless functions with three key characteristics. First, to avoid head-of-line blocking due to high function execution time variability, Hermes uses a combination of early binding and processor sharing for scheduling at individual worker machines. Second, Hermes uses a hybrid load balancing approach that improves consolidation at low load while employing least-loaded balancing at high load to retain high performance. Third, Hermes is both load and locality-aware, reducing the number of cold starts compared to pure load-based policies. We implement Hermes for Apache OpenWhisk and demonstrate that, for the case of the function patterns observed both in the Azure and in other real-world traces, it achieves up to 85% lower function slowdown and 60% higher throughput compared to existing policies.

Formally Verifying Function Scheduling Properties in Serverless Applications

On the Complexity of Reachability Properties in Serverless Function Scheduling

Affinity-aware Serverless Function Scheduling

Allocation Priority Policies for Serverless Function-Execution Scheduling Optimisation

Energy Efficient Scheduling for Serverless Systems

Data-driven scheduling in serverless computing to reduce response time

Serverless Scheduling Policies based on Cost Analysis

QoS-aware offloading policies for serverless functions in the Cloud-to-Edge continuum

SFSM: A Serverless Function Scheduling Method for FaaS Applications over Edge Computing

In Serverless, OS Scheduler Choice Costs Money: A Hybrid Scheduling Approach for Cheaper FaaS

Practical Scheduling for Real-World Serverless Computing

Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider

A framework for offloading and migration of serverless functions in the Edge-Cloud Continuum

A FaaS File System for Serverless Computing

Orchestrating the Execution of Serverless Functions in Hybrid Clouds

QoS aware FaaS platform

gFaaS: Enabling Generic Functions in Serverless Computing

FaaSched: A Jitter-Aware Serverless Scheduler

Benchmarking Parallelism in FaaS Platforms

The State of FaaS: An analysis of public Functions-as-a-Service providers

On the Analysis of Inter-Relationship between Auto-Scaling Policy and QoS of FaaS Workloads