Abstract:As deep learning, virtual reality, and other technologies become mature, real-time data processing applications running on intelligent terminals are emerging endlessly; meanwhile, edge computing has developed rapidly and has become a popular research direction in the field of distributed computing. Edge computing network is a network computing environment composed of multi-edge computing nodes and data centers. First, the edge computing framework and key technologies are analyzed to improve the performance of real-time data processing applications. In the system scenario where the collaborative deployment tasks of multi-edge nodes and data centers are considered, the stream processing task deployment process is formally described, and an efficient multi-edge node-computing center collaborative task deployment algorithm is proposed, which solves the problem of copy-free task deployment in the task deployment problem. Furthermore, a heterogeneous edge collaborative storage mechanism with tight coupling of computing and data is proposed, which solves the contradiction between the limited computing and storage capabilities of data and intelligent terminals, thereby improving the performance of data processing applications. Here, a Feasible Solution (FS) algorithm is designed to solve the problem of placing copy-free data processing tasks in the system. The FS algorithm has excellent results once considering the overall coordination. Under light load, the V value is reduced by 73% compared to the Only Data Center-available (ODC) algorithm and 41% compared to the Hash algorithm. Under heavy load, the V value is reduced by 66% compared to the ODC algorithm and 35% compared to the Hash algorithm. The algorithm has achieved good results after considering the overall coordination and cooperation and can more effectively use the bandwidth of edge nodes to transmit and process data stream, so that more tasks can be deployed in edge computing nodes, thereby saving time for data transmission to the data centers. The end-to-end collaborative real-time data processing task scheduling mechanism proposed here can effectively avoid the disadvantages of long waiting times and unable to obtain the required data, which significantly improves the success rate of the task and thus ensures the performance of real-time data processing.

Application-Grained Block I/O Analysis for Edge Computational Intelligent

AGBS: Application-grained Block I/O Workload Simulation for Edge Computation

AI-oriented Workload Allocation for Cloud-Edge Computing.

An In-Depth Comparative Analysis of Cloud Block Storage Workloads: Findings and Implications

Edge AIBench: Towards Comprehensive End-to-End Edge Computing Benchmarking.

Data Based Application Partitioning and Workload Balance in Distributed Environment

Superblock: An Application-Aware Dynamic Partition Strategy for Large-Scale Graph

Understanding Big Data Analytic Workloads on Modern Processors

Blockchain-based Collaborative Edge Computing: Efficiency, Incentive and Trust

High Performance and Scalable Virtual Machine Storage I/O Stack for Multicore Systems

An End-to-end and Adaptive I/O Optimization Tool for Modern HPC Storage Systems

Weight-based strategy for an I/O-intensive application at a cloud data center.

I/O Bottleneck Detection and Tuning: Connecting the Dots using Interactive Log Analysis

AI-enabled IoT-Edge Data Analytics for Connected Living

Efficient I/O characteristics collection method on cloud storage

Quantitative Analysis of Real-Time Performance and Hardware Requirements for Edge Computing Platform

Performance Evaluation and Modeling of HPC I/O on Non-Volatile Memory

-IO: A Unified IO Stack for Computational Storage

Optimal Workload Allocation for Edge Computing Network Using Application Prediction

IOTune: A G-states Driver for Elastic Performance of Block Storage

Dissecting the Workload of Cloud Storage System