Abstract:The aim of this work is to produce and test a robustness module (ROB-M) that can be generally applied to distributed, multi-agent task allocation algorithms, as robust versions of these are scarce and not well-documented in the literature. ROB-M is developed using the Performance Impact (PI) algorithm, as this has previously shown good results in deterministic trials. Different candidate versions of the module are thus bolted on to the PI algorithm and tested using two different task allocation problems under simulated uncertain conditions, and results are compared with baseline PI. It is shown that the baseline does not handle uncertainty well; the task-allocation success rate tends to decrease linearly as degree of uncertainty increases. However, when PI is run with one of the candidate robustness modules, the failure rate becomes very low for both problems, even under high simulated uncertainty, and so its architecture is adopted for ROB-M and also applied to MIT's baseline Consensus Based Bundle Algorithm (CBBA) to demonstrate its flexibility. Strong evidence is provided to show that ROB-M can work effectively with CBBA to improve performance under simulated uncertain conditions, as long as the deterministic versions of the problems can be solved with baseline CBBA. Furthermore, the use of ROB-M does not appear to increase mean task completion time in either algorithm, and only 100 Monte Carlo samples are required compared to 10,000 in MIT's robust version of the CBBA algorithm. PI with ROB-M is also tested directly against MIT's robust algorithm and demonstrates clear superiority in terms of mean numbers of solved tasks.

Method for System Robustness Testing Method Based on Operational Profiling

Study on Fault-Tolerant Based on Modular Method in the Development of Test and Control System Software

Method of Test Case Auto-generation Based on Operational Profile

A Workload Model Based Approach to Evaluate the Robustness of Real-time Operating System

STUDY AND APPLICATION OF OPERATIONAL PROFILE ESTIMATION BASED ON AOP

Designing an Efficient and Extensible Robustness Benchmark of a Real-Time Operating System

An Approach to Evaluate the Robustness of Real Time Operating System

Robustness testing for software components

State Based Robustness Testing for Components

Robustness Testing for Components Based on State Machine Model

RobOT: Robustness-Oriented Testing for Deep Learning Systems

Optimizing design method of operational profile in statistical testing

Robust Dynamic Selection of Tested Modules in Software Testing for Maximizing Delivered Reliability

Ttcn-3 Based Robustness Test Generation and Automation

Adaptive Random Testing by Exclusion Through Test Profile

Probability Analysis to Improve the Confidence in Profiling Accuracy

Acceleration Testing Method of Safety-critical Software with Testing Resource Constraint

A Systematic Study of Failure Proximity

Functional Test-Cost Reduction Based on Fault Tree Analysis and Binary Optimization

A Path-Oriented Tool Supporting for Testing

Addressing Robustness in Time-Critical, Distributed, Task Allocation Algorithms