Abstract:Learning is crucial for automated negotiation, and recent years have witnessed a remarkable achievement in application of reinforcement learning (RL) for various negotiation tasks. Conventional RL methods focus generally on learning from active interactions with opposing negotiators. However, collecting online data is expensive in many realistic negotiation scenarios. While previous studies partially mitigate this problem through the use of opponent simulators (i.e., agents following known strategies), in reality it is usually hard to fully capture an opponent's negotiation strategy. Moreover, a further challenge lies in an agent's capability of adapting to dynamic variations of an opponent's preferences or strategies, which may happen from time to time for different reasons in subsequent negotiations. In response to these challenges, this article proposes a novel Deep Offline Reinforcement learning Negotiating Agent framework that allows to learn an effective strategy using previously collected negotiation datasets without requiring interaction with an opponent. This is in contrast to existing RL-based negotiation approaches that all rely on active interaction with opponents. Furthermore, the strategy fine-tuning mechanism is included to adjust the learned strategy in response to the preferences or strategy changes of the opponent. The performance of the proposed framework is evaluated based on a diverse set of state-of-the-art baselines under different settings. Experimental results show that the framework allows to learn effective strategies exclusively with offline datasets, and is also capable of effectively adapting to changes of an opponent's preferences or strategy.

A Reinforcement Learning Optimized Negotiation Method Based on Mediator Agent

Optimized negotiation strategy based on reinforcement learning

Bilateral Multi-issue Parallel Negotiation Model Based on Reinforcement Learning

Research on Reinforcement Learning Negotiation Strategy and Its Optimization

Adaptive Multi-Issue Agent-Based Negotiation Model

Reinforcement Learning Negotiation Strategy Based on Opponent Classification

PREFERENCE-BASED BILATERAL MULTI-ISSUE NEGOTIATION OPTIMIZATION

A Deep Reinforcement Learning-Based Agent for Negotiation with Multiple Communication Channels

An Agent Bilateral Multi-issue Alternate Bidding Negotiation Protocol Based on Reinforcement Learning and Its Application in E-commerce.

An Effective Negotiating Agent Framework Based on Deep Offline Reinforcement Learning.

Research on adaptive optimization strategy in intelligent argumentation-based negotiation

Offer with Choices and Accept with Delay: A Win-Win Strategy Model for Agent Based Automated Negotiation.

Strategy and Algorithm of Multi-Agent Negotiation Based on Q-reinforcement Learning

Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games.

An Efficient and Robust Negotiating Strategy in Bilateral Negotiations over Multiple Items.

A Negotiation Optimization Strategy of Collaborative Procurement with Supply Chain Based on Multi-Agent System

A bilateral price negotiation strategy based on Bayesian classification and Q-learning

Transfer Reinforcement Learning Based Negotiating Agent Framework.

ANOTO: Improving Automated Negotiation Via Offline-to-Online Reinforcement Learning.

AUTOMATED NEGOTIATION BASED ON ENSEMBLE LEARNING AND OPTIMAL COUNTER PROPOSAL

A pareto optimal model for automated multi-attribute negotiations