Cost-Efficient Cloud-Edge Video Analytics with Hybird IaaS and FaaS Resources

Jing Peng,Zhi Zhou,Kongyange Zhao,Huirong Ma,Xu Chen

DOI: https://doi.org/10.1109/icpads60453.2023.00335

2023-01-01

Abstract:Video analytics services are extensively employed in various real-time applications, including crime monitoring, business intelligence, and traffic flow control. These applications typically depend on cloud data centers to aggregate video stream tasks using Infrastructure as a Service (IaaS). However, the conventional approach of employing limited-term leased virtual machines (VMs) often leads to leads to high costs and idle time. Serverless computing or Function as a Service (FaaS) offers a more adaptable, pay-as-you-go solution but at a higher price, introducing latency challenges. Edge servers can reduce latency and costs, but limited physical resources affect accuracy. Opting for high-quality analytic services with better frame rates and resolutions can maintain accuracy but may not control costs. Therefore, the key challenge in video analytics is choosing the right configuration and computing methods for high accuracy, low cost, and low latency in edge, IaaS and FaaS environments. To address the challenge, we consider a scenario where the video analytics task is offloaded by combining the above three placements (i.e., VM, serverless, and edge node) to optimize the cost and latency while keeping the accuracy. The optimization problem can be formulated as an Integer Programming (IP) problem of which the NP-hardness is proved. To further deal with it, we propose an efficient online algorithm, which can optimize cost and latency using the Lyapunov optimization analysis while ensuring accuracy over long periods. Finally, the multi-angle simulation experiment results show that OCPA can effectively reduce the cost and delay compared with the benchmarks. At the same time, the achieved accuracy is close to the set long-term time-averaged value.