Christopher R. Hayner,John M. Carson III,Behçet Açıkmeşe,Karen Leung
Abstract:Perception algorithms are ubiquitous in modern autonomy stacks, providing necessary environmental information to operate in the real world. Many of these algorithms depend on the visibility of keypoints, which must remain within the robot's line-of-sight (LoS), for reliable operation. This paper tackles the challenge of maintaining LoS on such keypoints during robot movement. We propose a novel method that addresses these issues by ensuring applicability to various sensor footprints, adaptability to arbitrary nonlinear dynamics, and constant enforcement of LoS throughout the robot's path. Through our experiments, we show that the proposed approach achieves significantly reduced LoS violation and runtime compared to existing state-of-the-art methods in several representative and challenging scenarios.
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to ensure that key points (such as landmarks in visual - inertial odometry, shooting objects in drone shooting, or potential landing points of planetary landers) are always within the line - of - sight (LoS) of the robot during its movement. Specifically, the paper proposes a new method to address the following three core challenges:
1. **Applicability**: This method needs to be applicable to different sensor fields of view (such as cameras, LiDAR, etc.) to ensure universality.
2. **Adaptability**: This method needs to be able to adapt to any nonlinear dynamic system to ensure flexibility.
3. **Persistence**: Keep key points within the line of sight throughout the entire trajectory, not just at discrete time points.
### Problem Background
In modern autonomous systems, perception algorithms are essential. They provide the necessary environmental information, enabling robots to operate reliably in the real world. Many of these algorithms rely on the visibility of key points, which must always be within the robot's line of sight to ensure reliable operation. If key points lose sight during the robot's movement, the perception performance may be affected, leading to mission failure.
### Limitations of Existing Methods
The existing LoS guidance methods have the following limitations:
- Lack of universality for different sensor fields of view.
- Unable to adapt to any nonlinear dynamics.
- Only enforce LoS constraints at discrete time points, rather than throughout the entire trajectory.
### Paper Contributions
To solve the above problems, the paper makes the following three main contributions:
1. **Sensor - field - of - view - independent line - of - sight constraints**: This method does not depend on a specific type of sensor and has wide applicability.
2. **Continuous - time line - of - sight guidance method (CT - LoS)**: A computationally feasible continuous - time line - of - sight guidance method is proposed and compared with the discrete - time line - of - sight guidance method (DT - LoS).
3. **Experimental verification**: Through experiments on multiple key - point tracking problems, the effectiveness of CT - LoS is demonstrated and compared with DT - LoS.
### Mathematical Model and Method
The paper models the LoS guidance problem as a constrained optimal control problem and proposes a six - degree - of - freedom dynamic model and non - convex line - of - sight constraints. Specifically, the line - of - sight constraints ensure that key points are always within the sensor's view cone, which is defined by the sensor's position, direction vector, and viewing angle.
### Experimental Results
The experimental results show that the CT - LoS method is significantly superior to the existing discrete - time method (DT - LoS) in maintaining LoS constraints and also performs well in computational efficiency. Specifically:
- **LoS constraint violation**: The LoS constraint violation of CT - LoS is significantly reduced throughout the entire trajectory.
- **Computation time**: As the problem scale increases, the computation time of CT - LoS grows more slowly and has better scalability.
In conclusion, this paper proposes a new continuous - time line - of - sight guidance method, which solves the deficiencies of existing methods in terms of universality, adaptability, and persistence, and provides strong support for reliable navigation of robots in complex environments.