Abstract:Intelligent robots are designed to effectively navigate dynamic and unpredictable environments laden with moving mechanical elements and objects. Such environment-induced dynamics, including moving obstacles, can readily alter the computational demand (e.g., the creation of new tasks) and the structure of workloads (e.g., precedence constraints among tasks) during runtime, thereby adversely affecting overall system performance. This challenge is amplified when multi-task inference is expected on robots operating under stringent resource and real-time constraints. To address such a challenge, we introduce RED, a systematic real-time scheduling approach designed to support multi-task deep neural network workloads in resource-limited robotic systems. It is designed to adaptively manage the Robotic Environmental Dynamics (RED) while adhering to real-time constraints. At the core of RED lies a deadline-based scheduler that employs an intermediate deadline assignment policy, effectively managing to change workloads and asynchronous inference prompted by complex, unpredictable environments. This scheduling framework also facilitates the flexible deployment of MIMONet (multi-input multi-output neural networks), which are commonly utilized in multi-tasking robotic systems to circumvent memory bottlenecks. Building on this scheduling framework, RED recognizes and leverages a unique characteristic of MIMONet: its weight-shared architecture. To further accommodate and exploit this feature, RED devises a novel and effective workload refinement and reconstruction process. This process ensures the scheduling framework's compatibility with MIMONet and maximizes efficiency.

Dynamic modulation of multi-task priority for controlling redundancy insufficient robots

Motion Control Strategy of Redundant Manipulators Based on Dynamic Task-Priority.

An Autonomous Task Allocation Method Of The Multi-Robot System

Multi-Robot Coordination In Complex Environment With Task And Communication Constraints

A lower dimensional task function method for point-to-point control of non-redundant manipulators

Prioritized Multitask Flow Optimization of Redundant Hydraulic Manipulator

A unified dynamic control method for a redundant dual arm robot

A Set-Theoretic Approach to Multi-Task Execution and Prioritization

Beyond Jacobian-based tasks: Extended set-based tasks for multi-task execution and prioritization

An Overview of Multi-task Control for Redundant Robot Based on Quadratic Programming

A Multi-Priority Control of Asymmetric Coordination for Redundant Dual-Arm Robot

Hybrid Dynamical Moving Task Allocation Methodology For Distributed Multi-Robot Coordination System

Multi-Layered Safety of Redundant Robot Manipulators via Task-Oriented Planning and Control

Prioritized Optimal Control

An Inverse Kinematics Algorithm With Smooth Task Switching for Redundant Robots

A nine-degree-of-freedom modular redundant robotic manipulator: Development and experimentation

Adaptive Task Allocation for Heterogeneous Multi-Robot Teams with Evolving and Unknown Robot Capabilities

Efficient Performance Impact Algorithms for Multirobot Task Assignment With Deadlines

RED: A Systematic Real-Time Scheduling Approach for Robotic Environmental Dynamics

Kinetostatic Optimization for Kinematic Redundancy Planning of Nimbl'Bot Robot

An Optimal Task Allocation Strategy for Heterogeneous Multi-Robot Systems