MetaTrading: An Immersion-Aware Model Trading Framework for Vehicular Metaverse Services

Hongjia Wu,Hui Zeng,Zehui Xiong,Jiawen Kang,Zhiping Cai,Tse-Tin Chan,Dusit Niyato,Zhu Han

2024-10-26

Abstract:Updates of extensive Internet of Things (IoT) data are critical to the immersion of vehicular metaverse services. However, providing high-quality and sustainable data in unstable and resource-constrained vehicular networks remains a significant challenge. To address this problem, we put forth a novel immersion-aware model trading framework that incentivizes metaverse users (MUs) to contribute learning models trained by their latest local data for augmented reality (AR) services in the vehicular metaverse, while preserving their privacy through federated learning. To comprehensively evaluate the contribution of locally trained learning models provided by MUs to AR services, we design a new immersion metric that captures service immersion by considering the freshness and accuracy of learning models, as well as the amount and potential value of raw data used for training. We model the trading interactions between metaverse service providers (MSPs) and MUs as an equilibrium problem with equilibrium constraints (EPEC) to analyze and balance their costs and gains. Moreover, considering dynamic network conditions and privacy concerns, we formulate the reward decisions of MSPs as a multi-agent Markov decision process. Then, a fully distributed dynamic reward method based on deep reinforcement learning is presented, which operates without any private information about MUs and other MSPs. Experimental results demonstrate that the proposed framework can effectively provide higher-value models for object detection and classification in AR services on real AR-related vehicle datasets compared to benchmark schemes.

Machine Learning,Cryptography and Security,Computer Science and Game Theory

What problem does this paper attempt to address?

The problem that this paper attempts to solve is: in vehicle meta - universe services, how to provide high - quality and sustainable data updates to enhance the sense of immersion. Specifically, due to the instability and resource limitations of vehicle networks, providing high - quality and continuous data updates is a major challenge. To this end, the author proposes a new immersion - aware model trading framework (MetaTrading), which aims to encourage meta - universe users (MUs) to contribute learning models trained by their latest local data for augmented reality (AR) services while protecting privacy through federated learning.

### Main problems
1. **Data quality and real - time performance**:
- It is very difficult to provide high - quality and continuous data updates in an unstable vehicle network environment.
- The value of real - time data will decay over time, and latency will affect the user experience and even cause motion sickness.

2. **Privacy protection**:
- The transmitted data may contain sensitive information (such as location, movement, biometrics, etc.), increasing the user's privacy risk.

3. **Data sharing and competition**:
- There is competition among different meta - universe service providers (MSPs), and it is difficult to share data, resulting in resource waste and redundancy.

4. **Incentive mechanism**:
- How to encourage users to be willing to share valuable local learning models in the face of computing, communication, and energy costs.

### Solutions
To solve the above problems, the paper proposes the following solutions:

1. **Immersion - aware model trading framework (MetaTrading)**:
- Use federated learning (FL) to enable users to train models locally and upload them to MSPs, thereby protecting privacy.
- Design a new immersion degree metric (IoM), which comprehensively considers the freshness, accuracy of the model, and the quantity and potential value of the training data.

2. **Equilibrium problems and multi - agent reinforcement learning**:
- Model the interaction between MSPs and MUs as an equilibrium problem with equilibrium constraints (EPEC), and analyze and balance the costs and benefits of both parties.
- Adopt the multi - agent Markov decision process (MAMDP) to formulate the reward decisions of MSPs, and develop a fully distributed dynamic reward method based on deep reinforcement learning (MDDR) to ensure adaptation to complex reward decisions in a dynamic environment.

### Formula representation
- **Immersion degree metric (IoM)**:
\[
V_{mn} = I_{mn}(\tau_n - \Delta_{mn})
\]
where:
- \( I_{mn} \) is the contribution prediction of MU \( m \) to MSP \( n \).
- \( \Delta_{mn} \) is the age of information (AoI), representing the freshness of the model.
- \( \tau_n \) is the virtual deadline of the task.

- **Contribution prediction \( I_{mn} \)**:
\[
I_{mn}=\omega_{mn}\epsilon\ln(1 + \eta\left\lfloor\frac{T}{\tau_n}\right\rfloor|X_{mn}|)\theta_m
\]
where:
- \( \omega_{mn} \) is the potential value of local data.
- \( \left\lfloor\frac{T}{\tau_n}\right\rfloor \) is the number of iterations that the task can be executed within time \( T \).
- \( |X_{mn}| \) is the size of the training data set.
- \( \theta_m \) is the accuracy threshold of local training.

- **Age of information \( \Delta_{mn} \)**:
\[
\Delta_{mn}=\frac{1}{2\tau_n}+\frac{x_m\tau_n\log(1 / \theta_m)}{f_{mn}}+\frac{b_{mn}}{B_{mn}\log_2(1 + \varsigma_{mn})}