Distributed Perception Aware Safe Leader Follower System via Control Barrier Methods

Richie R. Suganda,Tony Tran,Miao Pan,Lei Fan,Qin Lin,Bin Hu
2024-09-18
Abstract:This paper addresses a distributed leader-follower formation control problem for a group of agents, each using a body-fixed camera with a limited field of view (FOV) for state estimation. The main challenge arises from the need to coordinate the agents' movements with their cameras' FOV to maintain visibility of the leader for accurate and reliable state estimation. To address this challenge, we propose a novel perception-aware distributed leader-follower safe control scheme that incorporates FOV limits as state constraints. A Control Barrier Function (CBF) based quadratic program is employed to ensure the forward invariance of a safety set defined by these constraints. Furthermore, new neural network based and double bounding boxes based estimators, combined with temporal filters, are developed to estimate system states directly from real-time image data, providing consistent performance across various environments. Comparison results in the Gazebo simulator demonstrate the effectiveness and robustness of the proposed framework in two distinct environments.
Systems and Control,Robotics
What problem does this paper attempt to address?
The paper aims to address the vision-based leader-follower formation control problem in multi-agent systems, particularly in scenarios where each agent relies solely on a limited field of view (FOV) camera fixed on the body for state estimation. The main challenge lies in the need to coordinate the agents' movements with the camera's FOV to maintain visibility of the leader, thereby achieving accurate and reliable state estimation. To this end, the authors propose a novel perception-aware distributed leader-follower safety control scheme that incorporates FOV constraints as state constraints. By using control barrier function (CBF)-based quadratic programming, the forward invariance of the safe sets defined by these constraints is ensured. Additionally, a new estimation algorithm based on neural networks and dual bounding boxes is developed, combined with a time filter, to estimate the system state directly from real-time image data, demonstrating consistent performance in various environments. Simulation results show that the proposed framework is effective and robust in two different environments.