Abstract:The emerging serverless computing has become a captivating paradigm for deploying cloud applications, alleviating developers' concerns about infrastructure resource management by configuring necessary parameters such as latency and memory constraints. Existing resource configuration solutions for cloud-based serverless applications can be broadly classified into modeling based on historical data or a combination of sparse measurements and interpolation/modeling. In pursuit of service response and conserving network bandwidth, platforms have progressively expanded from the traditional cloud to the edge. Compared to cloud platforms, serverless edge platforms often lead to more running overhead due to their limited resources, resulting in undesirable financial costs for developers when using the existing solutions. Meanwhile, it is extremely challenging to handle the heterogeneity of edge platforms, characterized by distinct pricing owing to their varying resource preferences. To tackle these challenges, we propose an adaptive and efficient approach called FireFace, consisting of prediction and decision modules. The prediction module extracts the internal features of all functions within the serverless application and uses this information to predict the execution time of the functions under specific configuration schemes. Based on the prediction module, the decision module analyzes the environment information and uses the Adaptive Particle Swarm Optimization algorithm and Genetic Algorithm Operator (APSO-GA) algorithm to select the most suitable configuration plan for each function, including CPU, memory, and edge platforms. In this way, it is possible to effectively minimize the financial overhead while fulfilling the Service Level Objectives (SLOs). Extensive experimental results show that our prediction model obtains optimal results under all three metrics, and the prediction error rate for real-world serverless applications is in the range of 4.25∼9.51%. Our approach can find the optimal resource configuration scheme for each application, which saves 7.2∼44.8% on average compared to other classic algorithms. Moreover, FireFace exhibits rapid adaptability, efficiently adjusting resource allocation schemes in response to dynamic environments.

Optimizing serverless computing: A comparative analysis of multi-output regression models for predictive function invocations

Design and implementation of efficient distributed deep learning model inference architecture on serverless computation

Optimizing simultaneous autoscaling for serverless cloud computing

A Deep Reinforcement Learning based Algorithm for Time and Cost Optimized Scaling of Serverless Applications

Revisiting the Performance of Serverless Computing: an Analysis of Variance

Analyzing Open-Source Serverless Platforms: Characteristics and Performance

Performance Modeling of Metric-Based Serverless Computing Platforms

Understanding Cost Dynamics of Serverless Computing: An Empirical Study

Smartpick: Workload Prediction for Serverless-enabled Scalable Data Analytics Systems

Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider

FireFace: Leveraging Internal Function Features for Configuration of Functions on Serverless Edge Platforms

Serverless architecture efficiency: an exploratory study

Optimal Resource Allocation for Serverless Queries

Costless: Optimizing Cost of Serverless Computing through Function Fusion and Placement

SPES: Towards Optimizing Performance-Resource Trade-Off for Serverless Functions

A Survey of Serverless Machine Learning Model Inference

Input-Based Ensemble-Learning Method for Dynamic Memory Configuration of Serverless Computing Functions

Improving the Efficiency of Serverless Computing Via Core-Level Power Management

Latency-Sensitive Function Placement among Heterogeneous Nodes in Serverless Computing

FIRST: Exploiting the Multi-Dimensional Attributes of Functions for Power-Aware Serverless Computing.

Prediction-driven resource provisioning for serverless container runtimes