Distributionally Robust Inverse Reinforcement Learning for Identifying Multi-Agent Coordinated Sensing

Luke Snow,Vikram Krishnamurthy
2024-09-23
Abstract:We derive a minimax distributionally robust inverse reinforcement learning (IRL) algorithm to reconstruct the utility functions of a multi-agent sensing system. Specifically, we construct utility estimators which minimize the worst-case prediction error over a Wasserstein ambiguity set centered at noisy signal observations. We prove the equivalence between this robust estimation and a semi-infinite optimization reformulation, and we propose a consistent algorithm to compute solutions. We illustrate the efficacy of this robust IRL scheme in numerical studies to reconstruct the utility functions of a cognitive radar network from observed tracking signals.
Machine Learning,Multiagent Systems,Signal Processing
What problem does this paper attempt to address?