Abstract:With recent advancements in artificial intelligence (AI), wireless sensing has recently been accepted as an attractive solution to enable accurate detection of human activities by analyzing the radio signal variations of sensor devices (SDs) using a well-trained AI model. However, due to the limited communication and computation resources at SDs, it is impractical to support energy- and delay-sensitive sensing services by solely processing the massive computation workload at local or offloading it to the edge server (ES) for edge inference. To address this problem, we consider in this paper device-edge co-inference in a wireless sensing system where multiple users collaboratively perform a common inference task. In particular, the AI model deployed at each SD can be split into two sequential parts. Each SD executes the former part of AI model at local, and leaves the remaining part computed at the ES. We aim to minimize the energy consumption of SDs subject to a prescribed inference latency requirement. To this end, we formulate a mixed integer non-linear programming (MINLP) to jointly optimize the model splitting point and system resource allocation, where the major difficulty lies in the tight couplings among splitting decisions of collaborative SDs. To solve the problem, we propose an integrated learning and optimization algorithm named LOP, which tackles the combinatorial model splitting by using a deep reinforcement learning (DRL)-based method, and deals with the remaining resource allocation problem via convex optimization. To gain some engineering insights, we study the optimal model splitting design in a practical wireless indoor crowd counting system, where the optimal splitting point exhibits a threshold-based structure related to the user channel gain. Simulation results demonstrate that the proposed LOP algorithm can achieve a near-optimal energy performance with on average 0.8% optimality gap while enjoying a hundredfold reduction in computation delay.

Study on Optimal Allocation of Inference Nodes for Distributed Inference in Smart Environment

A Distributed Algorithm for Resource Allocation in Smart Grid

An Information Architecture for Distributed Inference in Ad Hoc Sensor Networks

When CPN Meets AI: Resource Provisioning for Inference Query Upon Computing Power Network

Collaborative Inference for Deep Neural Networks in Edge Environments

Dynamic Inference Approach Based on Rules Engine in Intelligent Edge Computing for Building Environment Control

Heuristic Routing Algorithm Toward Scalable Distributed Generalized Assignment Problem

Parallel Processing of Sensor Data in a Distributed Rules Engine Environment through Clustering and Data Flow Reconfiguration

Hybrid Sensor Network with Edge Computing for AI Applications of Connected Vehicles

A Budget-Adaptive Allocation Rule for Optimal Computing Budget Allocation

Automated Deep Neural Network Inference Partitioning for Distributed Embedded Systems

MoEI: Mobility-Aware Edge Inference Based on Model Partition and Service Migration

Optimal AI Model Splitting and Resource Allocation for Device-Edge Co-Inference in Multi-User Wireless Sensing Systems

Towards Real-Time Inference Offloading with Distributed Edge Computing: the Framework and Algorithms

Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks

A distributed architecture for rule engine to deal with big data

Distributed Inferencing with Ambient and Wearable Sensors.

Energy-Aware Selective Inference Task Offloading for Real-Time Edge Computing Applications

HBD: Towards Efficient Reactive Rule Dispatching in Software-Defined Networks

An Efficient Computation Offloading and Resource Allocation Algorithm in RIS Empowered MEC