Abstract:Multi-robot simultaneous localization and mapping (SLAM) enables a robot team to achieve coordinated tasks by relying on a common map of the environment. Constructing a map by centralized processing of the robot observations is undesirable because it creates a single point of failure and requires pre-existing infrastructure and significant communication throughput. This paper formulates multi-robot object SLAM as a variational inference problem over a communication graph subject to consensus constraints on the object estimates maintained by different robots. To solve the problem, we develop a distributed mirror descent algorithm with regularization enforcing consensus among the communicating robots. Using Gaussian distributions in the algorithm, we also derive a distributed multi-state constraint Kalman filter (MSCKF) for multi-robot object SLAM. Experiments on real and simulated data show that our method improves the trajectory and object estimates, compared to individual-robot SLAM, while achieving better scaling to large robot teams, compared to centralized multi-robot SLAM.
What problem does this paper attempt to address?
### Problems the paper attempts to solve
This paper aims to solve the problem of simultaneous localization and mapping (SLAM) of multi - robot systems in unknown environments. Specifically, the paper focuses on how to use the Distributed Variational Inference method to enable multiple robots to work collaboratively without a central server, jointly construct the environment map, and maintain a consistent estimate of the object positions in the map.
### Background and challenges
1. **Limitations of traditional centralized SLAM**:
- Centralized SLAM requires a central server or a leading robot to process the observation data of all robots. This not only requires pre - existing infrastructure but also introduces latency and potential estimation inconsistency problems.
- A single - point failure of the central server will seriously affect the performance of the entire robot team.
2. **Advantages of distributed SLAM**:
- Distributed SLAM allows robots to work in a decentralized manner, communicate with other robots through an ad - hoc network without the need for multi - hop communication protocols.
- This method can flexibly add or remove robots, improve the scalability of the algorithm, thereby covering a larger area and improving the accuracy of localization and mapping.
### Solutions
1. **Problem modeling**:
- Model the multi - robot object SLAM problem as a variational inference problem on a communication graph, where each robot node maintains a probability distribution about the environmental state.
- Introduce consensus constraints to ensure that different robots maintain consistent estimates of common objects.
2. **Distributed mirror descent algorithm**:
- Develop a distributed mirror descent algorithm with a regularization term, which is used to couple the marginal densities of adjacent nodes.
- Using the Gaussian distribution, derive a Distributed MSCKF (Multi - State Constraint Kalman Filter), and add a consensus averaging step in the update step to enforce the consensus of common variables.
3. **Algorithm application**:
- Apply the Distributed MSCKF algorithm for collaborative object SLAM, using only the stereo - camera observation data of each robot.
- In the prediction step, each robot uses visual odometry to locally estimate its trajectory.
- In the update step, the robot uses visual features and object detection results to correct its trajectory estimate.
### Experimental results
- **Experimental setup**:
- Experiments were carried out on the KITTI dataset and the simulated dataset, using an i9 - 11980HK CPU, 16 GB RAM and an RTX 3080 GPU.
- Sequences 00, 05, 06 and 08 in the KITTI dataset were divided into three sub - sequences, representing three different robots respectively.
- **Experimental results**:
- Compared with single - robot SLAM, the Distributed MSCKF method significantly improves the accuracy of trajectory and object estimation.
- Compared with centralized multi - robot SLAM, the distributed method shows better scalability in large - scale robot teams.
### Main contributions
1. **Problem modeling**:
- Model the multi - robot landmark SLAM problem as a variational inference problem with consensus constraints.
2. **Algorithm development**:
- Develop a distributed mirror descent algorithm with a regularization term for coupling the marginal densities of adjacent nodes.
- Derive a Distributed MSCKF algorithm using the Gaussian distribution.
3. **Experimental verification**:
- Verify the effectiveness of the Distributed MSCKF algorithm on real and simulated datasets, demonstrating its advantages in improving the accuracy of trajectory and object estimation.
### Formula examples
- **Variational inference objective function**:
\[
\text{KL}(q_i \| p_i)=\mathbb{E}_{q_i}[-\log p_i(s_i, z_i, u_i)]-\mathbb{E}_{q_i}[-\log q_i(s_i)]+\log p_i(u_i, z_i)
\]
- **Distributed mirror descent iteration**: