Abstract:Learning is crucial for automated negotiation, and recent years have witnessed a remarkable achievement in application of reinforcement learning (RL) for various negotiation tasks. Conventional RL methods focus generally on learning from active interactions with opposing negotiators. However, collecting online data is expensive in many realistic negotiation scenarios. While previous studies partially mitigate this problem through the use of opponent simulators (i.e., agents following known strategies), in reality it is usually hard to fully capture an opponent's negotiation strategy. Moreover, a further challenge lies in an agent's capability of adapting to dynamic variations of an opponent's preferences or strategies, which may happen from time to time for different reasons in subsequent negotiations. In response to these challenges, this article proposes a novel Deep Offline Reinforcement learning Negotiating Agent framework that allows to learn an effective strategy using previously collected negotiation datasets without requiring interaction with an opponent. This is in contrast to existing RL-based negotiation approaches that all rely on active interaction with opponents. Furthermore, the strategy fine-tuning mechanism is included to adjust the learned strategy in response to the preferences or strategy changes of the opponent. The performance of the proposed framework is evaluated based on a diverse set of state-of-the-art baselines under different settings. Experimental results show that the framework allows to learn effective strategies exclusively with offline datasets, and is also capable of effectively adapting to changes of an opponent's preferences or strategy.

Optimized negotiation strategy based on reinforcement learning

Research on Reinforcement Learning Negotiation Strategy and Its Optimization

Reinforcement Learning Negotiation Strategy Based on Opponent Classification

A Reinforcement Learning Optimized Negotiation Method Based on Mediator Agent

Strategy and Algorithm of Multi-Agent Negotiation Based on Q-reinforcement Learning

A bilateral price negotiation strategy based on Bayesian classification and Q-learning

An Effective Negotiating Agent Framework Based on Deep Offline Reinforcement Learning.

Transfer Reinforcement Learning Based Negotiating Agent Framework.

Conflict Resolution of Production-marketing Collaborative Planning Based on Multi-Agent Self-adaptation Negotiation.

Transfer Learning based Agent for Automated Negotiation

A Deep Reinforcement Learning-Based Agent for Negotiation with Multiple Communication Channels

ANOTO: Improving Automated Negotiation Via Offline-to-Online Reinforcement Learning.

Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games.

Bilateral Multi-issue Parallel Negotiation Model Based on Reinforcement Learning

Research on adaptive optimization strategy in intelligent argumentation-based negotiation

Optimal Exploration Algorithm of Multi-Agent Reinforcement Learning Methods (Student Abstract)

A Q-learning Approach to Generating Behavior of Emotional Persuasion with Adaptive Time Belief in Decision-making of Agent-based Negotiation

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

Towards General Negotiation Strategies with End-to-End Reinforcement Learning

Research on conflict resolution of supply chain production-marketing collaborative planning based on RBF and Q-reinforcement

An Agent Bilateral Multi-issue Alternate Bidding Negotiation Protocol Based on Reinforcement Learning and Its Application in E-commerce.