Online Relational Inference for Evolving Multi-agent Interacting Systems

Beomseok Kang,Priyabrata Saha,Sudarshan Sharma,Biswadeep Chakraborty,Saibal Mukhopadhyay

2024-11-07

Abstract:We introduce a novel framework, Online Relational Inference (ORI), designed to efficiently identify hidden interaction graphs in evolving multi-agent interacting systems using streaming data. Unlike traditional offline methods that rely on a fixed training set, ORI employs online backpropagation, updating the model with each new data point, thereby allowing it to adapt to changing environments in real-time. A key innovation is the use of an adjacency matrix as a trainable parameter, optimized through a new adaptive learning rate technique called AdaRelation, which adjusts based on the historical sensitivity of the decoder to changes in the interaction graph. Additionally, a data augmentation method named Trajectory Mirror (TM) is introduced to improve generalization by exposing the model to varied trajectory patterns. Experimental results on both synthetic datasets and real-world data (CMU MoCap for human motion) demonstrate that ORI significantly improves the accuracy and adaptability of relational inference in dynamic settings compared to existing methods. This approach is model-agnostic, enabling seamless integration with various neural relational inference (NRI) architectures, and offers a robust solution for real-time applications in complex, evolving systems.

Artificial Intelligence,Machine Learning,Multiagent Systems

What problem does this paper attempt to address?

### What problem does this paper attempt to solve?

This paper aims to solve the problem of how to efficiently identify hidden interaction graphs in real - time from observed trajectory data in a dynamically evolving multi - agent interaction system. Specifically, the main challenges of the research include:

1. **Limitations of traditional methods**: Most of the existing Neural Relational Inference (NRI) methods rely on offline training and assume that the training and test data distributions are the same. However, in practical applications, the test conditions may change, leading to a decline in model performance.

2. **The need for online learning**: In order to adapt to the changing environment, a method that can update the model in real - time when new data arrives, that is, online learning, is required. Existing online learning methods have not been fully explored when dealing with interaction reasoning in multi - agent systems.

3. **Model flexibility**: Existing online learning methods usually have specific requirements for the model structure, which limits their universality and flexibility. Therefore, a model - agnostic method that can be seamlessly integrated into different NRI architectures is needed.

To solve these problems, the author proposes a new framework - **Online Relational Inference (ORI)**. ORI achieves efficient online relational reasoning in the following ways:

- **Online back - propagation**: Use streaming data for real - time updates to ensure that the model can adapt to environmental changes.
- **Trainable adjacency matrix**: Treat the adjacency matrix representing the interaction relationship as a trainable parameter and optimize it directly through the predicted trajectory.
- **Adaptive learning rate technique (AdaRelation)**: Adjust the learning rate according to historical sensitivity to adapt to sudden changes in the interaction graph or dynamics.
- **Data augmentation technique (Trajectory Mirror)**: Generate multiple trajectory patterns by flipping the coordinate axes to improve the generalization ability of the model.

The experimental results show that ORI significantly improves the accuracy and adaptability of relational reasoning on synthetic datasets and real - world datasets (such as CMU MoCap human motion data), outperforming existing NRI models.