Edge Computing Technologies for Streaming Video Analytics
Zheng YANG,Xiaowu HE,Jiahang WU,Xu WANG,Yi ZHAO
DOI: https://doi.org/10.1360/ssi-2021-0133
2022-01-01
Scientia Sinica Informationis
Abstract:Real-time streaming video analytics is important in applications such as intelligent surveillance, smart city, and autonomous driving. However, large-scale streaming video analytics is impractical on the cloud, due to its high computation demand, large bandwidth consumption and stringent latency requirement.The emerging edge computing paradigm can effectively solve these problems by pushing computation from the cloud to devices and servers at the network edge.To this end, this article conducts a comprehensive survey on edge computing technologies for real-time streaming video analytics.Firstly, it introduces the background of video analytics and edge computing, as well as the typical application of edge-based steaming video analytics.Then, it proposes the performance indicators and challenges faced by the existing systems.Afterwards, the key technologies in this field are introduced in detail from the device level, collaboration level, and edge/cloud server level, including model compression and selection, local caching, frame filtering, task offloading, streaming protocol, privacy protection, query optimization, inference acceleration, and edge caching.Based on the integration of above core technologies, this article proposes an edge-based large-scale video analytics platform, Argus, which provides systematic support for the real-time video stream analytics on video collection, model inference, data mining, and log management.Argus has been successfully deployed in the smart oilfield scenario.Last but not least, this article discusses the open issues on edge-based streaming video analytics, in the hope of inspiring future research ideas.