Abstract:We consider the problem of optimal unsignalized intersection management, wherein we seek to obtain safe and optimal trajectories, for a set of robots that arrive randomly and continually. This problem involves repeatedly solving a mixed integer program (with robot acceleration trajectories as decision variables) with different parameters, for which the computation time using a naive optimization algorithm scales exponentially with the number of robots and lanes. Hence, such an approach is not suitable for real-time implementation. In this paper, we propose a solution framework that combines learning and sequential optimization. In particular, we propose an algorithm for learning a shared policy that given the traffic state information, determines the crossing order of the robots. Then, we optimize the trajectories of the robots sequentially according to that crossing order. This approach inherently guarantees safety at all times. We validate the performance of this approach using extensive simulations and compare our approach against $5$ different heuristics from the literature in $9$ different simulation settings. Our approach, on average, significantly outperforms the heuristics from the literature in various metrics like objective function, weighted average of crossing times and computation time. For example, in some scenarios, we have observed that our approach offers up to $150\%$ improvement in objective value over the first come first serve heuristic. Even on untrained scenarios, our approach shows a consistent improvement (in objective value) of more than $30\%$ over all heuristics under consideration. We also show through simulations that the computation time for our approach scales linearly with the number of robots (assuming all other factors are constant). Learnt policies are implemented on physical robots with slightly modified framework to address real-world challenges.

RoSSO: A High-Performance Python Package for Robotic Surveillance Strategy Optimization Using JAX

ROG: A High Performance and Robust Distributed Training System for Robotic IoT

ROSO: Improving Robotic Policy Inference via Synthetic Observations

From Simulations to Reality: Enhancing Multi-Robot Exploration for Urban Search and Rescue

Receding Horizon Optimization Method for Solving the Cops and Robbers Problems in a Complex Environment with Obstacles

Markov Chain-Based Stochastic Strategies for Robotic Surveillance

SoRTS: Learned Tree Search for Long Horizon Social Robot Navigation

Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agent

PYROBOCOP : Python-based Robotic Control & Optimization Package for Manipulation and Collision Avoidance

PARCO: Learning Parallel Autoregressive Policies for Efficient Multi-Agent Combinatorial Optimization

Reinforcement Learning Aided Sequential Optimization for Unsignalized Intersection Management of Robot Traffic

Stochastic Online Optimization for Cyber-Physical and Robotic Systems

RoCUS: Robot Controller Understanding via Sampling

FogROS: An Adaptive Framework for Automating Fog Robotics Deployment

An Upper Confidence Bound for Simultaneous Exploration and Exploitation in Heterogeneous Multi-Robot Systems

Multi-Agent Reinforcement Learning for Joint Police Patrol and Dispatch

Graph-based Simultaneous Coverage and Exploration Planning for Fast Multi-robot Search

Bayesian Optimization Framework for Efficient Fleet Design in Autonomous Multi-Robot Exploration

Socially-Aware Navigation: A Non-linear Multi-Objective Optimization Approach

RSOME in Python: An Open-Source Package for Robust Stochastic Optimization Made Easy

Scaling Robust Optimization for Multi-Agent Robotic Systems: A Distributed Perspective