Abstract:Critical robotic tasks such as rescue and disaster response are more prevalently leveraging ML (Machine Learning) models deployed on a team of wireless robots, on which data parallel (DP) training over Internet of Things of these robots (robotic IoT) can harness the distributed hardware resources to adapt their models to changing environments as soon as possible. Unfortunately, due to the need for DP synchronization across all robots, the instability in wireless networks (i.e., fluctuating bandwidth due to occlusion and varying communication distance) often leads to severe stall of robots, which affects the training accuracy within a tight time budget and wastes energy stalling. Existing methods to cope with the instability of datacenter networks are incapable of handling such straggler effect. That is because they are conducting model-granulated transmission scheduling, which is much more coarse-grained than the granularity of transient network instability in real-world robotic IoT networks, making a previously reached schedule mismatch with the varying bandwidth during transmission. We present ROG, the first ROw-Granulated distributed training system optimized for ML training over unstable wireless networks. ROG confines the granularity of transmission and synchronization to each row of a layer’s parameters and schedules the transmission of each row adaptively to the fluctuating bandwidth. In this way the ML training process can update partial and the most important gradients of a stale robot to avoid triggering stalls, while provably guaranteeing convergence. The evaluation shows that, given the same training time, ROG achieved about 4.9%~6.5% training accuracy gain compared with the baselines and saved 20.4%~50.7% of the energy to achieve the same training accuracy.

Early experience of remote and hot service deployment with trustworthiness in CROWN grid

ROST: Remote and hot service deployment with trustworthiness in CROWN Grid

A New Trust Framework for Resource-Sharing in the Grid Environment

Access Control Policy Negotiation for Remote Hot-deployed Grid Services.

OpenSPACE: an open service provisioning and consuming environment for grid computing

CROWN Node Server: An Enhanced Grid Service Container Based on GT4 WSRF Core

ROG: A High Performance and Robust Distributed Training System for Robotic IoT

Supporting secure collaborative computing in grid environments

Netslab-based remote hybrid testing in current hierarchical network environment

Scheduling Remote Access to Scientific Instruments in Cyberinfrastructure for Education and Research

Resource management and organization in CROWN grid.

Using Trust and Risk in Access Control for Grid Environment

A Framework to Provide Trust and Incentive in CROWN Grid for Dynamic Resource Management

Distributed access control in CROWN groups

Efficient information service management using service club in CROWN Grid

Research of Trust Quantification Based on Grid System

TruGrid: A Self-Sustaining Trustworthy Grid.

S-Club: an overlay-based efficient service discovery mechanism in CROWN Grid

S-Club: an overlay based efficient service discovery mechanism in CROWN grid

Edge In-Network Computing Meets Blockchain: A Multi-Domain Heterogeneous Resource Trust Management Architecture

Using trust for restricted delegation in grid environments