Distributed Online Life-Long Learning (DOL3) for Multi-agent Trust and Reputation Assessment in E-commerce

Hariprasauth Ramamoorthy,Shubhankar Gupta,Suresh Sundaram
DOI: https://doi.org/10.6084/m9.figshare.25719180.v1
2024-10-22
Abstract:Trust and Reputation Assessment of service providers in citizen-focused environments like e-commerce is vital to maintain the integrity of the interactions among agents. The goals and objectives of both the service provider and service consumer agents are relevant to the goals of the respective citizens (end users). The provider agents often pursue selfish goals that can make the service quality highly volatile, contributing towards the non-stationary nature of the environment. The number of active service providers tends to change over time resulting in an open environment. This necessitates a rapid and continual assessment of the Trust and Reputation. A large number of service providers in the environment require a distributed multi-agent Trust and Reputation assessment. This paper addresses the problem of multi-agent Trust and Reputation Assessment in a non-stationary environment involving transactions between providers and consumers. In this setting, the observer agents carry out the assessment and communicate their assessed trust scores with each other over a network. We propose a novel Distributed Online Life-Long Learning (DOL3) algorithm that involves real-time rapid learning of trust and reputation scores of providers. Each observer carries out an adaptive learning and weighted fusion process combining their own assessment along with that of their neighbour in the communication network. Simulation studies reveal that the state-of-the-art methods, which usually involve training a model to assess an agent's trust and reputation, do not work well in such an environment. The simulation results show that the proposed DOL3 algorithm outperforms these methods and effectively handles the volatility in such environments. From the statistical evaluation, it is evident that DOL3 performs better compared to other models in 90% of the cases.
Artificial Intelligence,Multiagent Systems
What problem does this paper attempt to address?
This paper attempts to solve the problem of trust and reputation assessment in multi - agent systems in the e - commerce environment, especially the assessment between transaction providers and service consumers in non - stationary environments. Specifically: 1. **Trust and Reputation Assessment in Non - stationary Environments**: Due to the change in the number of service providers over time and their self - interested behavior, the service quality is highly volatile, which makes the environment non - stationary. Therefore, it is necessary to quickly and continuously assess trust and reputation. 2. **Distributed Multi - agent Trust and Reputation Assessment**: In the e - commerce environment, there are a large number of service providers, so a distributed multi - agent system is required to conduct trust and reputation assessment. 3. **Real - time and Adaptability**: Traditional machine - learning methods usually train models in a static environment to assess the trust and reputation of agents, but they perform poorly in non - stationary environments. The paper proposes a new Distributed Online Lifelong Learning (DOL3) algorithm, which can achieve real - time and fast learning and fuse trust scores through information sharing among observers. 4. **Observer Role**: Observer agents are introduced. They are responsible for assessing the trust and reputation of service providers and sharing these assessment results with other observers. Each observer performs weighted fusion based on its own assessment and that of its neighbors to obtain the final trust score. 5. **Dealing with Malicious Behaviors and New Entrants**: The DOL3 algorithm can also effectively handle the deceptive behaviors of malicious agents and agents newly entering the environment, ensuring the accuracy and reliability of the assessment. In summary, this paper aims to solve the problem of trust and reputation assessment of multi - agent systems in non - stationary environments in e - commerce, proposes a new DOL3 algorithm, and improves the accuracy and robustness of the assessment through a distributed, real - time and adaptive learning framework.