Abstract:Function-as-service (FaaS) platforms promise a simpler programming model for cloud computing, given that providers take care of the overall resource management while the developers can concentrate only on writing their applications in the scope of a function, not having to care about installing or scaling resources. As FaaS users are billed based on the execution of the functions, platform providers have a natural incentive not to keep idle resources running at the platform's expense. However, this strategy may lead to the cold start issue, in which the execution of a function is delayed because there are no ready resources to host the execution. Despite the time to provision the computational resources, starting the runtime environment that manages the function execution can take hundreds of milliseconds to seconds, a prohibitive non-deterministic overhead to latency-critical applications. This work describes a practical technique, Prebaking , to reduce the function start-up time based on restoring snapshots of previously executed processes. The foundation of the Prebaking technique is that deciding when to create a snapshot of a function is essential. For example, based on a prototype we developed using the CRIU checkpoint/restore Linux tool, the performance improvement on the start-up of a properly snapshotted function is up to 25 times. Fortunately, generating a good function snapshot is easy: One only needs to checkpoint a warm function, that is, a function that has processed a request. To show the feasibility of using the Prebaking technique, we discussed integrating it into OpenFaaS, an open-source FaaS platform, including how to generate and restore function snapshots. We also evaluated our prototype by running a comprehensive set of experiments that compare the function start-up duration and cold start latency against the standard fork-exec procedure. We analyze the JVM, CPython, and Node.js runtimes. The results indicate that the technique can improve the function replica start-up time even for no-warmed functions: we improved the function replica start-up time from 3.5 times for a "do-nothing" function running in Node.js up to 12 times when considering an Image Resizer function running in CPython. Finally, we reinforce the practicability of the proposed technique by comparing our proposal to another snapshot-based technique called SEUSS. That evaluation shows that Prebaking provides better cold start latency even for slightly complex functions like the Markdown Renderer.

Performance best practices using Java and AWS Lambda

A Review: Cold Start Latency in Serverless Computing

Mitigating Cold Starts in Serverless Platforms: A Pool-Based Approach

Fusionize++: Improving Serverless Application Performance Using Dynamic Task Inlining and Infrastructure Optimization

Function-as-a-Service performance evaluation: A multivocal literature review

Comprehensive Review of Performance Optimization Strategies for Serverless Applications on AWS Lambda

On-demand Container Loading in AWS Lambda

Performance Evaluation of Snapshot Methods to Warm the Serverless Cold Start

FaaSLight : General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

Architecture-Specific Performance Optimization of Compute-Intensive FaaS Functions

MLLess: Achieving Cost Efficiency in Serverless Machine Learning Training

Prebaking runtime environments to improve the FaaS cold start latency

Performance considerations on execution of large scale workflow applications on cloud functions

Fusionize: Improving Serverless Application Performance through Feedback-Driven Function Fusion

Linux-Tomcat Application Performance on Amazon AWS

Data-driven scheduling in serverless computing to reduce response time

MAFF: Self-adaptive Memory Optimization for Serverless Functions

Strategies for Big Data Analytics through Lambda Architectures in Volatile Environments

How Low Can You Go? Practical cold-start performance limits in FaaS

Serverless architecture efficiency: an exploratory study

Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider