Abstract:Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this paper, we propose an approach namely FaaSLight to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph, and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform - and language-agnostic . In practice, FaaSLight can be effectively applied to FaaS applications developed in different programming languages (Python and JavaScript), and can be seamlessly deployed on popular serverless platforms such as AWS Lambda and Google Cloud Functions, without having to modify the underlying OSes or hypervisors, nor introducing any additional manual engineering efforts to developers. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25 × improvement in reducing the average total response latency.

Characterization and Reclamation of Frozen Garbage in Managed FaaS Workloads

Defuse: A Dependency-Guided Function Scheduler to Mitigate Cold Starts on FaaS Platforms

COCOA: Cold Start Aware Capacity Planning for Function-as-a-Service Platforms

FaaSLight : General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

Architecture-Specific Performance Optimization of Compute-Intensive FaaS Functions

How Low Can You Go? Practical cold-start performance limits in FaaS

FaaSMem: Improving Memory Efficiency of Serverless Computing with Memory Pool Architecture

FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

GreenFaaS: Maximizing Energy Efficiency of HPC Workloads with FaaS

Has Your FaaS Application Been Decommissioned Yet? -- A Case Study on the Idle Timeout in Function as a Service Infrastructure

Improving the interoperability of a Function‐as‐a‐Service platform using an orchestration framework with a cloud‐agnostic approach

MAFF: Self-adaptive Memory Optimization for Serverless Functions

Flock: Towards Multitasking Virtual Machines for Function-as-a-Service

GPU-enabled Function-as-a-Service for Machine Learning Inference

gFaaS: Enabling Generic Functions in Serverless Computing

When Edge Meets FaaS: Opportunities and Challenges

In Serverless, OS Scheduler Choice Costs Money: A Hybrid Scheduling Approach for Cheaper FaaS

GeoFF: Federated Serverless Workflows with Data Pre-Fetching

A Framework for SLO, Carbon, and Wastewater-Aware Sustainable FaaS Cloud Platform Management

Faa$T: A Transparent Auto-Scaling Cache for Serverless Applications

SLO-Aware Function Placement for Serverless Workflows With Layer-Wise Memory Sharing