Incorporating principles and examples from art/design and film/video into a CS computer graphics course

G. Owen

DOI: https://doi.org/10.1145/311625.311686

1999-07-01

Abstract:

What problem does this paper attempt to address?

FaaS for IoT: Evolving Serverless towards Deviceless in I/Oclouds

Giovanni Merlino,Giuseppe Tricomi,Luca D’Agati,Zakaria Benomar,Francesco Longo,Antonio Puliafito

DOI: https://doi.org/10.1016/j.future.2023.12.029

IF: 7.307

2024-01-03

Future Generation Computer Systems

Abstract:The burgeoning paradigms of Fog and Edge computing propose delegating Cloud-related tasks to the network's periphery, thus placing computational resources closer to data producers. This shift promises to boost the performance of IoT-based services, providing swift response times while conserving bandwidth. Despite their potential, the current Edge/Fog computing platforms must provide the required flexibility for dynamic service orchestration within a data-oriented context. Addressing this gap, the Function-as-a-Service (FaaS) model emerges as an exceptional strategy for Edge/Fog deployments. Its ability to manage an ever-expanding ecosystem of devices with remarkable flexibility and efficiency holds considerable promise. This paper articulates a novel approach to enhancing the adaptability of IoT Edge/Fog deployments. We propose an innovative extension to OpenStack, an open-source Cloud management system, which pushes its functionality towards the network Edge. Our approach empowers OpenStack to facilitate FaaS services within a distributed IoT infrastructure, thus infusing unprecedented adaptability and efficiency into the Edge/Fog computing paradigms.

computer science, theory & methods
Microservices and serverless functions – lifecycle, performance, and resource utilisation of edge based real-time IoT analytics

Francesco Tusa,Stuart Clayman,Alina Buzachis,Maria Fazio

DOI: https://doi.org/10.1016/j.future.2024.02.006

IF: 7.307

2024-02-14

Future Generation Computer Systems

Abstract:Edge Computing harnesses resources close to the data sources to reduce end-to-end latency and allow real-time process automation for verticals such as Smart City, Healthcare and Industry 4.0. Edge resources are limited when compared to traditional Cloud data centres; hence the choice of proper resource management strategies in this context becomes paramount. Microservice and Function as a Service architectures support modular and agile patterns, compared to a monolithic design, through lightweight containerisation, continuous integration / deployment and scaling. The advantages brought about by these technologies may initially seem obvious, but we argue that their usage at the Edge deserves a more in-depth evaluation. By analysing both the software development and deployment lifecycle, along with performance and resource utilisation, this paper explores microservices and two alternative types of serverless functions to build edge real-time IoT analytics. In the experiments comparing these technologies, microservices generally exhibit slightly better end-to-end processing latency and resource utilisation than serverless functions. One of the serverless functions and the microservices excel at handling larger data streams with auto-scaling. Whilst serverless functions natively offer this feature, the choice of container orchestration framework may determine its availability for microservices. The other serverless function, while supporting a simpler lifecycle, is more suitable for low-invocation scenarios and faces challenges with parallel requests and inherent overhead, making it less suitable for real-time processing in demanding IoT settings.

computer science, theory & methods
ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

Muhammed Golec,Sukhpal Singh Gill,Felix Cuadrado,Ajith Kumar Parlikad,Minxian Xu,Huaming Wu,Steve Uhlig

DOI: https://doi.org/10.1109/tsusc.2023.3348157

2023-01-01

IEEE Transactions on Sustainable Computing

Abstract:Serverless edge computing decreases unnecessary resource usage on end devices with limited processing power and storage capacity. Despite its benefits, serverless edge computing's zero scalability is the major source of the cold start delay, which is yet unsolved. This latency is unacceptable for time-sensitive Internet of Things (IoT) applications like autonomous cars. Most existing approaches need containers to idle and use extra computing resources. Edge devices have fewer resources than cloud-based systems, requiring new sustainable solutions. Therefore, we propose an AI-powered, sustainable resource management framework called ATOM for serverless edge computing. ATOM utilizes a deep reinforcement learning model to predict exactly when cold start latency will happen. We create a cold start dataset using a heart disease risk scenario and deploy using Google Cloud Functions. To demonstrate the superiority of ATOM, its performance is compared with two different baselines, which use the warm-start containers and a two-layer adaptive approach. The experimental results showed that although the ATOM required more calculation time of 118.76 seconds, it performed better in predicting cold start than baseline models with an RMSE ratio of 148.76. Additionally, the energy consumption and $CO_{2}$ emission amount of these models are evaluated and compared for the training and prediction phases.
Serverless Platforms on the Edge: A Performance Analysis

Hamza Javed,Adel N. Toosi,Mohammad S. Aslanpour

DOI: https://doi.org/10.48550/arXiv.2111.06563

2021-11-12

Abstract:The exponential growth of Internet of Things (IoT) has given rise to a new wave of edge computing due to the need to process data on the edge, closer to where it is being produced and attempting to move away from a cloud-centric architecture. This provides its own opportunity to decrease latency and address data privacy concerns along with the ability to reduce public cloud costs. The serverless computing model provides a potential solution with its event-driven architecture to reduce the need for ever-running servers and convert the backend services to an as-used model. This model is an attractive prospect in edge computing environments with varying workloads and limited resources. Furthermore, its setup on the edge of the network promises reduced latency to the edge devices communicating with it and eliminates the need to manage the underlying infrastructure. In this book chapter, first, we introduce the novel concept of serverless edge computing, then, we analyze the performance of multiple serverless platforms, namely, OpenFaaS, AWS Greengrass, Apache OpenWhisk, when set up on the single-board computers (SBCs) on the edge and compare it with public cloud serverless offerings, namely, AWS Lambda and Azure Functions, to deduce the suitability of serverless architectures on the network edge. These serverless platforms are set up on a cluster of Raspberry Pis and we evaluate their performance by simulating different types of edge workloads. The evaluation results show that OpenFaaS achieves the lowest response time on the SBC edge computing infrastructure while serverless cloud offerings are the most reliable with the highest success rate.

Distributed, Parallel, and Cluster Computing
Serverless data pipeline approaches for IoT data in fog and cloud computing

Shivananda R Poojara,Chinmaya Kumar Dehury,Pelle Jakovits,Satish Narayana Srirama

DOI: https://doi.org/10.48550/arXiv.2112.09974

2021-12-19

Abstract:With the increasing number of Internet of Things (IoT) devices, massive amounts of raw data is being generated. The latency, cost, and other challenges in cloud-based IoT data processing have driven the adoption of Edge and Fog computing models, where some data processing tasks are moved closer to data sources. Properly dealing with the flow of such data requires building data pipelines, to control the complete life cycle of data streams from data acquisition at the data source, edge and fog processing, to Cloud side storage and analytics. Data analytics tasks need to be executed dynamically at different distances from the data sources and often on very heterogeneous hardware devices. This can be streamlined by the use of a Serverless (or FaaS) cloud computing model, where tasks are defined as virtual functions, which can be migrated from edge to cloud (and vice versa) and executed in an event-driven manner on data streams. In this work, we investigate the benefits of building Serverless data pipelines (SDP) for IoT data analytics and evaluate three different approaches for designing SDPs: 1) Off-the-shelf data flow tool (DFT) based, 2) Object storage service (OSS) based and 3) MQTT based. Further, we applied these strategies on three fog applications (Aeneas, PocketSphinx, and custom Video processing application) and evaluated the performance by comparing their processing time (computation time, network communication and disk access time), and resource utilization. Results show that DFT is unsuitable for compute-intensive applications such as video or image processing, whereas OSS is best suitable for this task. However, DFT is nicely fit for bandwidth-intensive applications due to the minimum use of network resources. On the other hand, MQTT-based SDP is observed with increase in CPU and Memory usage as the number of...<truncted to fit character limit in Arxiv>

Distributed, Parallel, and Cluster Computing
Light weight serverless computing at fog nodes for internet of things systems

Mohamed Elkholy,Marwa A. Marzok

DOI: https://doi.org/10.11591/ijeecs.v26.i1.pp394-403

2022-04-01

Indonesian Journal of Electrical Engineering and Computer Science

Abstract:Internet of things (IoT) systems collect large size of data from huge numbers of sensors. A wide rage of IoT systems relies on cloud resources to process and analyze the collected data. However, passing large amount of data to the cloud affects the overall performance and cannot support real-time requirements. Serverless computing is a promising technique that allows developer to write an application code, in any programming language, and specify an event to start its execution. Thus, IoT system can get a good benefit of serverless environment. The proposed work introduces a framework to allow Serverless computing to take place on the Fog nodes near the data collectors. The proposed framework is implemented as an extension to a Kubernetes cluster that manages a set of Docker containers at the fog layer. A prototype of the proposed solution was implemented using Node.Js for coding and YAML files to transfer data. The proposed framework was evaluated against traditional cloud Serverless execution. The experimental results proved the significant enhancement of the framework by dcreasing the respond time especially for data intensive IoT applications.
Performance Evaluation of Serverless Edge Computing for Machine Learning Applications

Quoc Lap Trieu,Bahman Javadi,Jim Basilakis,Adel N. Toosi

DOI: https://doi.org/10.48550/arXiv.2210.10331

2022-10-19

Abstract:Next generation technologies such as smart healthcare, self-driving cars, and smart cities require new approaches to deal with the network traffic generated by the Internet of Things (IoT) devices, as well as efficient programming models to deploy machine learning techniques. Serverless edge computing is an emerging computing paradigm from the integration of two recent technologies, edge computing and serverless computing, that can possibly address these challenges. However, there is little work to explore the capability and performance of such a technology. In this paper, a comprehensive performance analysis of a serverless edge computing system using popular open-source frameworks, namely, Kubeless, OpenFaaS, Fission, and funcX is presented. The experiments considered different programming languages, workloads, and the number of concurrent users. The machine learning workloads have been used to evaluate the performance of the system under different working conditions to provide insights into the best practices. The evaluation results revealed some of the current challenges in serverless edge computing and open research opportunities in this emerging technology for machine learning applications.

Distributed, Parallel, and Cluster Computing,Performance
A Review: Cold Start Latency in Serverless Computing

Neetu Rani,Parikshit Verma,Paurav Goel

DOI: https://doi.org/10.1109/CCICT62777.2024.00034

2024-04-19

Abstract:The worldview of serverless computing addresses a significant evolutionary leap to smooth out the designer experience. Serverless computing, a feature of the cloud computing, seeks to ease the devlopers from the weights related with the server organization and essential infrastructure choices. Generally, it endeavors to satisfy its essential responsibility by releiving the designers from worries connected with server arrangement, setup, and scaling. The integration of FaaS plays a vital part in understanding the execution of serverless computing. This state of the art approach of the cloud computing works on application configuration, offering designers the capacity to evade server management through the reception of the ongoing Serverless Computing Paradigm. Working on a computational architecture that uses discrete functions as executables. These functions are sent exclusively on a serverless stage, giving quick adaptability per request to the clients. However, this adaptability frequently leads to the test known as the “Cold Starts”, where the delays happen during the task allocation to a runtime container. Presented by Amazon in 2014, AWS Lambda is one of the noticeable illustration of serverless computing architecture. Post-launch, different entities, incorporating both open-source and for benefit associations, embraced and popularized this innovation. Eminently, every platform tends to cold starts uniquely, provoking broad examination of every platforms performance under conditions comparable to the cold start in the recent years. This paper offers a top to bottom survey of the most recent progressions and cutting edge examinations in the space of serverless engineering for cold start interval reduction. By digging into the complexities of different platform performance and their ways to deal with the mitigation of the cold start challenge, this review aims to contribute significant insights to the continuous talk in the field of serverless computing.

Engineering,Computer Science
FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

Xuanzhe Liu,Jinfeng Wen,Zhenpeng Chen,Ding Li,Junkai Chen,Yi Liu,Haoyu Wang,Xin Jin

DOI: https://doi.org/10.48550/arXiv.2207.08175

2023-02-06

Abstract:Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this paper, we propose an approach namely FaaSLight to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph, and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform- and language-agnostic. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25X improvement in reducing the average total response latency.

Distributed, Parallel, and Cluster Computing,Software Engineering
FaaSLight : General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

Xuanzhe Liu,Jinfeng Wen,Zhenpeng Chen,Ding Li,Junkai Chen,Yi Liu,Haoyu Wang,Xin Jin

DOI: https://doi.org/10.1145/3585007

IF: 3.685

2023-02-22

ACM Transactions on Software Engineering and Methodology

Abstract:Serverless computing is a popular cloud computing paradigm that frees developers from server management. Function-as-a-Service (FaaS) is the most popular implementation of serverless computing, representing applications as event-driven and stateless functions. However, existing studies report that functions of FaaS applications severely suffer from cold-start latency. In this paper, we propose an approach namely FaaSLight to accelerating the cold start for FaaS applications through application-level optimization. We first conduct a measurement study to investigate the possible root cause of the cold start problem of FaaS. The result shows that application code loading latency is a significant overhead. Therefore, loading only indispensable code from FaaS applications can be an adequate solution. Based on this insight, we identify code related to application functionalities by constructing the function-level call graph, and separate other code (i.e., optional code) from FaaS applications. The separated optional code can be loaded on demand to avoid the inaccurate identification of indispensable code causing application failure. In particular, a key principle guiding the design of FaaSLight is inherently general, i.e., platform - and language-agnostic . In practice, FaaSLight can be effectively applied to FaaS applications developed in different programming languages (Python and JavaScript), and can be seamlessly deployed on popular serverless platforms such as AWS Lambda and Google Cloud Functions, without having to modify the underlying OSes or hypervisors, nor introducing any additional manual engineering efforts to developers. The evaluation results on real-world FaaS applications show that FaaSLight can significantly reduce the code loading latency (up to 78.95%, 28.78% on average), thereby reducing the cold-start latency. As a result, the total response latency of functions can be decreased by up to 42.05% (19.21% on average). Compared with the state-of-the-art, FaaSLight achieves a 21.25 × improvement in reducing the average total response latency.

computer science, software engineering
Making Serverless Not So Cold in Edge Clouds: A Cost-Effective Online Approach

Ke Xiao,Song Yang,Fan Li,Liehuang Zhu,Xu Chen,Xiaoming Fu

DOI: https://doi.org/10.1109/tmc.2024.3355118

IF: 6.075

2024-01-01

IEEE Transactions on Mobile Computing

Abstract:Applying the serverless paradigm to edge computing improves edge resource utilization while bringing the benefits of flexible scaling and pay-as-you-go to latency-sensitive applications. This extends the boundaries of serverless computing and improves the quality of service for Function-as-a-Service users. However, as an emerging cloud computing paradigm, serverless edge computing faces pressing challenges, with one of the biggest obstacles being delay caused by excessively long container cold starts. Cold start delay is defined as the time between when a serverless function is triggered and when it begins to execute, and its existence seriously impacts resource utilization and Quality of Service (QoS). In this paper, we study how to minimize the total system cost by caching function containers and selecting routes for neighboring functions via edge or public clouds. We prove that the proposed problem is NP-hard even in the special case where the user request contains only one function, and that the unpredictability of user requests and the impact between adjacent time decisions require that the problem to be solved in an online fashion. We then design the Online Lazy Caching algorithm, an online algorithm with a worst-case competitive ratio using a randomized dependent rounding algorithm to solve the problem. Extensive simulation results show that the proposed online algorithm can achieve close-to-optimal performance in terms of both total cost and cold start cost compared to other existing algorithms, with average improvements of 31.6% and 51.7%.

computer science, information systems,telecommunications
LaSS: Running Latency Sensitive Serverless Computations at the Edge

Bin Wang,Ahmed Ali-Eldin,Prashant Shenoy

DOI: https://doi.org/10.1145/3431379.3460646

2021-04-29

Abstract:Serverless computing has emerged as a new paradigm for running short-lived computations in the cloud. Due to its ability to handle IoT workloads, there has been considerable interest in running serverless functions at the edge. However, the constrained nature of the edge and the latency sensitive nature of workloads result in many challenges for serverless platforms. In this paper, we present LaSS, a platform that uses model-driven approaches for running latency-sensitive serverless computations on edge resources. LaSS uses principled queuing-based methods to determine an appropriate allocation for each hosted function and auto-scales the allocated resources in response to workload dynamics. LaSS uses a fair-share allocation approach to guarantee a minimum of allocated resources to each function in the presence of overload. In addition, it utilizes resource reclamation methods based on container deflation and termination to reassign resources from over-provisioned functions to under-provisioned ones. We implement a prototype of our approach on an OpenWhisk serverless edge cluster and conduct a detailed experimental evaluation. Our results show that LaSS can accurately predict the resources needed for serverless functions in the presence of highly dynamic workloads, and reprovision container capacity within hundreds of milliseconds while maintaining fair share allocation guarantees.

Distributed, Parallel, and Cluster Computing
Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider

Mohammad Shahrad,Rodrigo Fonseca,Íñigo Goiri,Gohar Chaudhry,Paul Batum,Jason Cooke,Eduardo Laureano,Colby Tresness,Mark Russinovich,Ricardo Bianchini

DOI: https://doi.org/10.48550/arXiv.2003.03423

2020-06-06

Abstract:Function as a Service (FaaS) has been gaining popularity as a way to deploy computations to serverless backends in the cloud. This paradigm shifts the complexity of allocating and provisioning resources to the cloud provider, which has to provide the illusion of always-available resources (i.e., fast function invocations without cold starts) at the lowest possible resource cost. Doing so requires the provider to deeply understand the characteristics of the FaaS workload. Unfortunately, there has been little to no public information on these characteristics. Thus, in this paper, we first characterize the entire production FaaS workload of Azure Functions. We show for example that most functions are invoked very infrequently, but there is an 8-order-of-magnitude range of invocation frequencies. Using observations from our characterization, we then propose a practical resource management policy that significantly reduces the number of function coldstarts,while spending fewerresources than state-of-the-practice policies.

Distributed, Parallel, and Cluster Computing
Fog Function: Serverless Fog Computing for Data Intensive IoT Services

Bin Cheng,Jonathan Fürst,Gurkan Solmaz,Takuya Sanada

DOI: https://doi.org/10.48550/arXiv.1907.08278

2019-07-19

Abstract:Fog computing can support IoT services with fast response time and low bandwidth usage by moving computation from the cloud to edge devices. However, existing fog computing frameworks have limited flexibility to support dynamic service composition with a data-oriented approach. Function-as-a-Service (FaaS) is a promising programming model for fog computing to enhance flexibility, but the current event- or topic-based design of function triggering and the separation of data management and function execution result in inefficiency for data-intensive IoT services. To achieve both flexibility and efficiency, we propose a data-centric programming model called Fog Function and also introduce its underlying orchestration mechanism that leverages three types of contexts: data context, system context, and usage context. Moreover, we showcase a concrete use case for smart parking where Fog Function allows service developers to easily model their service logic with reduced learning efforts compared to a static service topology. Our performance evaluation results show that the Fog Function can be scaled to hundreds of fog nodes. Fog Function can improve system efficiency by saving 95% of the internal data traffic over cloud function and it can reduce service latency by 30% over edge function.

Distributed, Parallel, and Cluster Computing
Migrating from Microservices to Serverless: An IoT Platform Case Study

Mohak Chadha,Victor Pacyna,Anshul Jindal,Jianfeng Gu,Michael Gerndt

DOI: https://doi.org/10.48550/arXiv.2210.04212

2022-10-09

Abstract:Microservice architecture is the common choice for developing cloud applications these days since each individual microservice can be independently modified, replaced, and scaled. As a result, application development and operating cloud infrastructure were bundled together into what is now commonly called DevOps. However, with the increasing popularity of the serverless computing paradigm and its several advantages such as no infrastructure management, a pay-per-use billing policy, and on-demand fine-grained autoscaling, there is a growing interest in utilizing FaaS and serverless CaaS technologies for refactoring microservices-based applications. Towards this, we migrate a complex IoT platform application onto OpenWhisk (OW) and Google Cloud Run (GCR). We comprehensively evaluate the performance of the different deployment strategies, i.e., Google Kubernetes Engine (GKE)-Standard, OW, and GCR for the IoT platform using different load testing scenarios. Results from our experiments show that while GKE standard performs best for most scenarios, GCR is always cheaper wrt costs.

Distributed, Parallel, and Cluster Computing,Performance,Software Engineering
Kubernetes distributions for the edge: serverless performance evaluation

Vojdan Kjorveziroski,Sonja Filiposka

DOI: https://doi.org/10.1007/s11227-022-04430-6

IF: 3.3

2022-03-24

The Journal of Supercomputing

Abstract:Serverless computing, especially when deployed at the edge of the network, is seen as an enabling technology for the future development of more complex Internet of Things systems. However, special care must be taken when deploying new edge infrastructures for serverless workloads in terms of resource usage and network connectivity. Inefficient utilization of the available computing resources might easily cancel out the benefits acquired by moving the equipment closer to the edge, namely the reduced communication latency. Containers, together with the Kubernetes container orchestrator, are used by many serverless platforms today. We evaluate the performance of three different Kubernetes distributions—full-fledged Kubernetes, K3s, and MicroK8s when deployed in a resource constrained environment at the edge. We use the OpenFaaS serverless platform and employ 14 different benchmarks divided into three separate categories to evaluate various aspects of the execution performance of the distributions. Four different test types are performed focusing on cold start latency, serial execution performance, parallel execution using a single replica, and parallel execution utilizing different autoscaling strategies. Our results show that the edge-oriented K3s and MicroK8s distributions offer better performance in the majority of the tests, while a full-fledged deployment exhibits noticeable advantages for sustained loads such as parallel function invocation using a single replica.
Cold Start Latency in Serverless Computing: A Systematic Review, Taxonomy, and Future Directions

Muhammed Golec,Guneet Kaur Walia,Mohit Kumar,Felix Cuadrado,Sukhpal Singh Gill,Steve Uhlig

DOI: https://doi.org/10.1145/3700875

2024-10-23

Abstract:Recently, academics and the corporate sector have paid attention to serverless computing, which enables dynamic scalability and an economic model. In serverless computing, users only pay for the time they actually use resources, enabling zero scaling to optimise cost and resource utilisation. However, this approach also introduces the serverless cold start problem. Researchers have developed various solutions to address the cold start problem, yet it remains an unresolved research area. In this article, we propose a systematic literature review on clod start latency in serverless computing. Furthermore, we create a detailed taxonomy of approaches to cold start latency, which we use to investigate existing techniques for reducing the cold start time and frequency. We have classified the current studies on cold start latency into several categories such as caching and application-level optimisation-based solutions, as well as Artificial Intelligence (AI)/Machine Learning (ML)-based solutions. Moreover, we have analyzed the impact of cold start latency on quality of service, explored current cold start latency mitigation methods, datasets, and implementation platforms, and classified them into categories based on their common characteristics and features. Finally, we outline the open challenges and highlight the possible future directions.

Distributed, Parallel, and Cluster Computing
Expanding the cloud-to-edge continuum to the IoT in serverless federated learning

Davide Loconte,Saverio Ieva,Agnese Pinto,Giuseppe Loseto,Floriano Scioscia,Michele Ruta

DOI: https://doi.org/10.1016/j.future.2024.02.024

IF: 7.307

2024-02-29

Future Generation Computer Systems

Abstract:Serverless computing enables greater flexibility and efficiency in the cloud-to-edge continuum. Artificial Intelligence and Machine Learning (AI/ML) applications benefit greatly from this paradigm, as they need to gather, preprocess, aggregate and analyze data at various scales. In such contexts, the increasing hardware/software resource availability of Internet of Things (IoT) devices provides the opportunity to exploit them not only as data sources in AI/ML infrastructures, but also as computational nodes for model training and inference; nevertheless, comprehensive frameworks are still mostly missing. This work introduces an innovative serverless computing architecture which expands the cloud-to-edge continuum toward IoT devices. The same functions can run on IoT, edge and cloud nodes with minimal to no code modification and they can be invoked through a uniform interface. A federated learning framework is defined based on the proposed architecture, exploiting an existing IoT-oriented ML algorithm in a novel way. Notably, IoT nodes are used for both federated training and local inference tasks. A full prototype implementation has been built with off-the-shelf technologies and devices. A case study on federated machine learning for activity recognition and experiments have been conducted to validate key elements of the proposal.

computer science, theory & methods
Efficient Serverless Function Scheduling at the Network Edge

Jiong Lou,Zhiqing Tang,Shijing Yuan,Jie Li,Chengtao Wu,Weijia Jia

DOI: https://doi.org/10.48550/arXiv.2310.16475

2023-10-31

Abstract:Serverless computing is a promising approach for edge computing since its inherent features, e.g., lightweight virtualization, rapid scalability, and economic efficiency. However, previous studies have not studied well the issues of significant cold start latency and highly dynamic workloads in serverless function scheduling, which are exacerbated at the resource-limited network edge. In this paper, we formulate the Serverless Function Scheduling (SFS) problem for resource-limited edge computing, aiming to minimize the average response time. To efficiently solve this intractable scheduling problem, we first consider a simplified offline form of the problem and design a polynomial-time optimal scheduling algorithm based on each function's weight. Furthermore, we propose an Enhanced Shortest Function First (ESFF) algorithm, in which the function weight represents the scheduling urgency. To avoid frequent cold starts, ESFF selectively decides the initialization of new function instances when receiving requests. To deal with dynamic workloads, ESFF judiciously replaces serverless functions based on the function weight at the completion time of requests. Extensive simulations based on real-world serverless request traces are conducted, and the results show that ESFF consistently and substantially outperforms existing baselines under different settings.

Distributed, Parallel, and Cluster Computing
Energy-Efficient Deployment of Stateful FaaS Vertical Applications on Edge Data Networks

Claudio Cicconetti,Raffaele Bruno,Andrea Passarella

2024-05-07

Abstract:5G and beyond support the deployment of vertical applications, which is particularly appealing in combination with network slicing and edge computing to create a logically isolated environment for executing customer services. Even if serverless computing has gained significant interest as a cloud-native technology its adoption at the edge is lagging, especially because of the need to support stateful tasks, which are commonplace in, e.g., cognitive services, but not fully amenable to being deployed on limited and decentralized computing infrastructures. In this work, we study the emerging paradigm of stateful Function as a Service (FaaS) with lightweight task abstractions in WebAssembly. Specifically, we assess the implications of deploying inter-dependent tasks with an internal state on edge computing resources using a stateless vs. stateful approach and then derive a mathematical model to estimate the energy consumption of a workload with given characteristics, considering the power used for both processing and communication. The model is used in extensive simulations to determine the impact of key factors and assess the energy trade-offs of stateless vs. stateful.

Networking and Internet Architecture

Incorporating principles and examples from art/design and film/video into a CS computer graphics course

FaaS for IoT: Evolving Serverless towards Deviceless in I/Oclouds

Microservices and serverless functions – lifecycle, performance, and resource utilisation of edge based real-time IoT analytics

ATOM: AI-Powered Sustainable Resource Management for Serverless Edge Computing Environments

Serverless Platforms on the Edge: A Performance Analysis

Serverless data pipeline approaches for IoT data in fog and cloud computing

Light weight serverless computing at fog nodes for internet of things systems

Performance Evaluation of Serverless Edge Computing for Machine Learning Applications

A Review: Cold Start Latency in Serverless Computing

FaaSLight: General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

FaaSLight : General Application-Level Cold-Start Latency Optimization for Function-as-a-Service in Serverless Computing

Making Serverless Not So Cold in Edge Clouds: A Cost-Effective Online Approach

LaSS: Running Latency Sensitive Serverless Computations at the Edge

Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider

Fog Function: Serverless Fog Computing for Data Intensive IoT Services

Migrating from Microservices to Serverless: An IoT Platform Case Study

Kubernetes distributions for the edge: serverless performance evaluation

Cold Start Latency in Serverless Computing: A Systematic Review, Taxonomy, and Future Directions

Expanding the cloud-to-edge continuum to the IoT in serverless federated learning

Efficient Serverless Function Scheduling at the Network Edge

Energy-Efficient Deployment of Stateful FaaS Vertical Applications on Edge Data Networks