Reactive and human-in-the-loop planning and control of multi-robot systems under LTL specifications in dynamic environments

Pian Yu,Gianmarco Fedeli,Dimos V. Dimarogonas
2023-07-12
Abstract:This paper investigates the planning and control problems for multi-robot systems under linear temporal logic (LTL) specifications. In contrast to most of existing literature, which presumes a static and known environment, our study focuses on dynamic environments that can have unknown moving obstacles like humans walking through. Depending on whether local communication is allowed between robots, we consider two different online re-planning approaches. When local communication is allowed, we propose a local trajectory generation algorithm for each robot to resolve conflicts that are detected on-line. In the other case, i.e., no communication is allowed, we develop a model predictive controller to reactively avoid potential collisions. In both cases, task satisfaction is guaranteed whenever it is feasible. In addition, we consider the human-in-the-loop scenario where humans may additionally take control of one or multiple robots. We design a mixed initiative controller for each robot to prevent unsafe human behaviors while guarantee the LTL satisfaction. Using our previous developed ROS software package, several experiments are conducted to demonstrate the effectiveness and the applicability of the proposed strategies.
Robotics,Systems and Control
What problem does this paper attempt to address?
This paper attempts to solve the planning and control problems of multi - robot systems when performing Linear Temporal Logic (LTL) tasks in dynamic environments. Specifically, the paper mainly focuses on the following aspects: 1. **Online replanning in dynamic environments**: Most of the existing literature assumes that the environment is static and known, but this research focuses on dynamic environments where there may be unknown moving obstacles (such as pedestrians crossing). Therefore, online replanning becomes necessary to ensure the safe operation of robots in dynamic environments and the satisfaction of tasks. 2. **Replanning methods in the cases of local communication and no communication**: - **Case where local communication is allowed**: A local trajectory generation algorithm is proposed to solve the conflicts detected online. - **Case where communication is not allowed**: A Model Predictive Controller (MPC) is designed to reactively avoid potential collisions. 3. **Human - robot collaboration scenarios**: Scenarios where humans may be involved in controlling one or more robots are considered. To prevent unsafe human behaviors and ensure the satisfaction of LTL tasks, a Mixed - Initiative Controller (MIC) is designed. ### Specific problem descriptions - **Challenges in dynamic environments**: Since the environment is dynamic, robots need to perform online replanning based on real - time sensed information to deal with unforeseen situations, such as the appearance of moving obstacles. - **The impact of local communication**: When robots can communicate locally, they can better coordinate their actions by sharing information, thus more effectively avoiding conflicts. When there is no communication, each robot needs to rely on its own sensing and decision - making abilities to respond to environmental changes. - **The safety of human - machine interaction**: In human - robot collaboration scenarios, human operations may bring safety hazards. Therefore, a mechanism needs to be designed to balance the relationship between human instructions and the automatic control system to ensure the safety of the overall system. ### Main contributions 1. **Online replanning algorithms for dynamic environments**: Two different online replanning methods are proposed, which are applicable to the cases of local communication and no communication respectively, and ensure the feasibility of tasks. 2. **Design of the mixed - initiative controller**: The existing Mixed - Initiative Controller (MIC) is extended to adapt to multi - robot systems and ensure that in the case of human - involved control, both human instructions can be followed and the completion of tasks and safety can be guaranteed. 3. **Experimental verification**: The effectiveness and applicability of the proposed strategies are demonstrated through a series of experiments, especially the application potential in fields such as agriculture. In summary, this paper aims to develop a planning and control algorithm for multi - robot systems that can operate efficiently in dynamic environments, while considering the safety and effectiveness of human - robot collaboration.