Abstract:In coordinated robotic learning, multiple robots share the same wireless channel for communication, and bring together latency-sensitive (LS) network flows for control and bandwidth-hungry (BH) flows for distributed learning. Unfortunately, existing wireless network supporting systems cannot coordinate these two network flows to meet their own requirements: 1) prioritized contention systems (e.g., EDCA) prevent LS messages from timely acquiring the wireless channel because multiple wireless network interface cards (WNICs) with BH messages are contending for the channel 2) global planning systems (e.g., SchedWiFi) have to reserve a notable time window in the shared channel for each LS flow, suffering from severe bandwidth degradation (up to 42%). We present the coordinated preemption method to meet both requirements for LS flows and BH flows. Globally (among multiple robots), coordinated preemption eliminates unnecessary contention of BH flows by making them transmit in a round-robin manner, such that LS flows have the highest chance to win the contention against BH flows, without sacrificing overall bandwidth from the perspective of coordinated robotic learning applications. Locally (within the same robot), coordinated preemption in real time predicts the periodic transmission of LS flows from the upper application and conservatively limits packets of BH flows buffered in the WNIC only before LS packets arriving, reducing the bandwidth devoted to preemption. COORP, our implementation of coordinated preemption, reduced the violation of latency requirements from 53.9% (EDCA) to 8.8% (comparable to SchedWiFi). Regarding learning quality, COORP achieved a comparable (at times the same) learning reward with EDCA, which grew up to 76% faster than SchedWiFi.

C2: Co-design of Robots Via Concurrent-Network Coupling Online and Offline Reinforcement Learning

C^2:Co-design of Robots via Concurrent Networks Coupling Online and Offline Reinforcement Learning

Coorp: Satisfying Low-Latency and High-Throughput Requirements of Wireless Network for Coordinated Robotic Learning

Cooperative Flocking And Learning In Multi-Robot Systems For Predator Avoidance

Decomposing Shared Networks for Separate Cooperation with Multi-Agent Reinforcement Learning

C3F: Constant Collaboration and Communication Framework for Graph-Representation Dynamic Multi-Robotic Systems

Deep Reinforcement Learning Based Co-Optimization of Morphology and Gait for Small-Scale Legged Robot

A Deep Reinforcement Learning Approach Combined with Model-Based Paradigms for Multiagent Formation Control with Collision Avoidance

Soft Robots Learn to Crawl: Jointly Optimizing Design and Control with Sim-to-Real Transfer

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces

Integrating Online Learning and Connectivity Maintenance for Communication-Aware Multi-Robot Coordination

Simultaneous Optimization of Discrete and Continuous Parameters Defining a Robot Morphology and Controller

DESIGN OF SELF-ORGANIZING SYSTEMS USING MULTI-AGENT REINFORCEMENT LEARNING AND THE COMPROMISE DECISION SUPPORT PROBLEM CONSTRUCT

Pre-Train-Based Neural-Learning Control of a Novel Parallel Robot by Local Model Approximation

Pretraining-finetuning Framework for Efficient Co-design: A Case Study on Quadruped Robot Parkour

Sim-to-real transfer of co-optimized soft robot crawlers

Curriculum Design and Sim2Real Transfer for Reinforcement Learning in Robotic Dual-Arm Assembly

Multi-Objective Network Congestion Control Via Constrained Reinforcement Learning.

A Distributed Competitive and Collaborative Coordination for Multirobot Systems

Dual Models to Facilitate Learning of Policy Network

An Offline-Transfer-Online Framework for Cloud-Edge Collaborative Distributed Reinforcement Learning