Abstract:In coordinated robotic learning, multiple robots share the same wireless channel for communication, and bring together latency-sensitive (LS) network flows for control and bandwidth-hungry (BH) flows for distributed learning. Unfortunately, existing wireless network supporting systems cannot coordinate these two network flows to meet their own requirements: 1) prioritized contention systems (e.g., EDCA) prevent LS messages from timely acquiring the wireless channel because multiple wireless network interface cards (WNICs) with BH messages are contending for the channel 2) global planning systems (e.g., SchedWiFi) have to reserve a notable time window in the shared channel for each LS flow, suffering from severe bandwidth degradation (up to 42%). We present the coordinated preemption method to meet both requirements for LS flows and BH flows. Globally (among multiple robots), coordinated preemption eliminates unnecessary contention of BH flows by making them transmit in a round-robin manner, such that LS flows have the highest chance to win the contention against BH flows, without sacrificing overall bandwidth from the perspective of coordinated robotic learning applications. Locally (within the same robot), coordinated preemption in real time predicts the periodic transmission of LS flows from the upper application and conservatively limits packets of BH flows buffered in the WNIC only before LS packets arriving, reducing the bandwidth devoted to preemption. COORP, our implementation of coordinated preemption, reduced the violation of latency requirements from 53.9% (EDCA) to 8.8% (comparable to SchedWiFi). Regarding learning quality, COORP achieved a comparable (at times the same) learning reward with EDCA, which grew up to 76% faster than SchedWiFi.

Event-Triggered Communication Network with Limited-Bandwidth Constraint for Multi-Agent Reinforcement Learning

Event-Triggered Multi-agent Reinforcement Learning with Communication under Limited-bandwidth Constraint

Consensus of First-Order Multi-Agent Systems under Event-Triggered Communication

Coorp: Satisfying Low-Latency and High-Throughput Requirements of Wireless Network for Coordinated Robotic Learning

Learning Intra-group Cooperation in Multi-agent Systems.

Learning Efficient Multi-agent Communication: An Information Bottleneck Approach

Distributed Event-Triggered Circle Formation Control for Multi-Agent Systems with Limited Communication Bandwidth

CGIBNet: Bandwidth-constrained Communication with Graph Information Bottleneck in Multi-Agent Reinforcement Learning

Learning to Schedule Communication in Multi-agent Reinforcement Learning

Learning Multi-agent Communication under Limited-bandwidth Restriction for Internet Packet Routing

Event-triggered Learning for Resource-efficient Networked Control

Learning Agent Communication under Limited Bandwidth by Message Pruning.

CCNet : Cluster-Coordinated Net for Learning Multi-agent Communication Protocols with Reinforcement Learning

An Efficient Distributed Nash Equilibrium Seeking with Compressed and Event-triggered Communication

Efficient Communications for Multi-Agent Reinforcement Learning in Wireless Networks

Event-Triggered Communication Mechanism for Distributed Flocking Control of Nonholonomic Multi-agent System.

Multi-agent Communication with Graph Information Bottleneck under Limited Bandwidth.

Effective Multi-Agent Communication under Limited Bandwidth

Deep Reinforcement Learning Based Massive Access Management for Ultra-Reliable Low-Latency Communications

Event-Triggered Control for Consensus of Multiagent Systems with Fixed/Switching Topologies

Toward Multi-Agent Reinforcement Learning for Distributed Event-Triggered Control