Abstract:Ensuring safety and meeting temporal specifications are critical challenges for long-term robotic tasks. Signal temporal logic (STL) has been widely used to systematically and rigorously specify these requirements. However, traditional methods of finding the control policy under those STL requirements are computationally complex and not scalable to high-dimensional or systems with complex nonlinear dynamics. Reinforcement learning (RL) methods can learn the policy to satisfy the STL specifications via hand-crafted or STL-inspired rewards, but might encounter unexpected behaviors due to ambiguity and sparsity in the reward. In this paper, we propose a method to directly learn a neural network controller to satisfy the requirements specified in STL. Our controller learns to roll out trajectories to maximize the STL robustness score in training. In testing, similar to Model Predictive Control (MPC), the learned controller predicts a trajectory within a planning horizon to ensure the satisfaction of the STL requirement in deployment. A backup policy is designed to ensure safety when our controller fails. Our approach can adapt to various initial conditions and environmental parameters. We conduct experiments on six tasks, where our method with the backup policy outperforms the classical methods (MPC, STL-solver), model-free and model-based RL methods in STL satisfaction rate, especially on tasks with complex STL specifications while being 10X-100X faster than the classical methods.

Funnel-based Cooperative Control of Leader-follower Multi-agent Systems under Signal Temporal Logic Specifications.

Signal Temporal Logic Control Synthesis among Uncontrollable Dynamic Agents with Conformal Prediction

Multiple Subformulae Cooperative Control for Multiagent Systems Under Conflicting Signal Temporal Logic Tasks

Decentralized Control Barrier Functions for Coupled Multi-Agent Systems under Signal Temporal Logic Tasks

Controller Synthesis of Collaborative Signal Temporal Logic Tasks for Multi-Agent Systems via Assume-Guarantee Contracts

Distributed Sequential Receding Horizon Control of Multi-Agent Systems under Recurring Signal Temporal Logic

Control of Multi-Agent Systems with Finite Time Control Barrier Certificates and Temporal Logic

Probabilistic Tube-based Control Synthesis of Stochastic Multi-Agent Systems under Signal Temporal Logic

Cooperative control of heterogeneous multi-agent systems under spatiotemporal constraints

Continuous-time Control Synthesis Under Nested Signal Temporal Logic Specifications

Funnel-based Reward Shaping for Signal Temporal Logic Tasks in Reinforcement Learning

Modularized Control Synthesis for Complex Signal Temporal Logic Specifications

Multi-Agent Control Synthesis from Global Temporal Logic Tasks with Synchronous Satisfaction Requirements

Multiple tasks control of nonlinear systems under signal temporal logic and its application to mobile robots

Control Synthesis for Multi-Agent Systems under Metric Interval Temporal Logic Specifications

Multi-Agent Motion Planning From Signal Temporal Logic Specifications

Combined Left and Right Temporal Robustness for Control under STL Specifications

Event-Based Signal Temporal Logic Synthesis for Single and Multi-Robot Tasks

Signal Temporal Logic Neural Predictive Control

Synthesis of Distributed Control and Communication Schemes from Global LTL Specifications