Abstract:Video streaming perception ability is critical for AI applications on resource-constrained devices (agents), which prefers to offload video streams from devices to edge servers for real-time inference by deep neural networks (DNNs). Meanwhile, the multi-agent system (MAS) community is attempting to run DNNs on multiple cooperative agents to enable improved swarm intelligence-based tasks (e.g., drone swarm intelligence, self-driving fleet collaboration, and multi-agent robot cooperation). However, transferring video streaming perception capability from single-agent systems to MASs is extremely difficult due to spontaneous competition-induced trade-offs between the desired goals of accuracy, consistency, and capacity, which are three critical but conflicting measuring indexes. In this paper, we present the design and implementation of MASSIVE, an edge-assisted cooperative multi-agent video streaming perception system that simultaneously achieves all three desired goals. In our design, we consider the performance characteristics of video streaming perception and the insight of its periodic offloading pattern. On this basis, we develop a Pareto improvement scheduler to eliminate spontaneous competition among agents, allowing multi-objective optimization to achieve an ideal Pareto optimal state. Finally, we propose a virtual traffic shaper based on the mainstream 802.11 MAC protocol to ensure deterministic periodic video stream offloading in an uncertain wireless network. Our experiments demonstrate that MASSIVE achieves 122.7% accuracy and 1.8x capacity compared to the closest baseline on multiple actual cooperative vision tasks with even better consistency, and achieves an ideal Pareto optimal state in a wireless environment.

Age of Incorrect Information-Aware Data Dissemination for Distributed Multi-Agent Systems

Harmony or Involution: Game Inspiring Age-of-Information Optimization for Edge Data Gathering in Internet of Things

Importance-Aware Message Exchange and Prediction for Multi-Agent Reinforcement Learning

Collaborative Information Dissemination with Graph-based Multi-Agent Reinforcement Learning

Age of Information Minimization using Multi-agent UAVs based on AI-Enhanced Mean Field Resource Allocation

Enhancing Information Freshness: An AoI Optimized Markov Decision Process Dedicated In the Underwater Task

Collaborative Optimization of the Age of Information under Partial Observability

AoI-Oriented Resource Allocation for NOMA-Based Wireless Powered Cognitive Radio Networks Based on Multi-Agent Deep Reinforcement Learning

Optimizing Age of Information in Wireless Uplink Networks with Partial Observations

Asynchronous Fractional Multi-Agent Deep Reinforcement Learning for Age-Minimal Mobile Edge Computing

HA-MARL: Heuristic and APF Assisted Multi-Agent Reinforcement Learning for Wireless Data Sharing in AUV Swarms

Optimal Status Updates for Minimizing Age of Correlated Information in IoT Networks with Energy Harvesting Sensors

Toward Cooperative Multi-Agent Video Streaming Perception

Learning Task-Oriented Channel Allocation for Multi-Agent Communication

Age of Semantics in Cooperative Communications: To Expedite Simulation Towards Real via Offline Reinforcement Learning

Efficient Distributed Framework for Collaborative Multi-Agent Reinforcement Learning

Cooperative Data Collection with Multiple UAVs for Information Freshness in the Internet of Things

A Distributed Deployment Strategy for Multi-Agent Systems Subject to Health Degradation and Communication Delays

Distributed Optimization of Age of Incorrect Information with Dynamic Epistemic Logic

Joint Communication Resource Allocation and Velocity Optimization in Advanced Air Mobility via Multi-Agent Reinforcement Learning