Abstract:Learning is crucial for automated negotiation, and recent years have witnessed a remarkable achievement in application of reinforcement learning (RL) for various negotiation tasks. Conventional RL methods focus generally on learning from active interactions with opposing negotiators. However, collecting online data is expensive in many realistic negotiation scenarios. While previous studies partially mitigate this problem through the use of opponent simulators (i.e., agents following known strategies), in reality it is usually hard to fully capture an opponent's negotiation strategy. Moreover, a further challenge lies in an agent's capability of adapting to dynamic variations of an opponent's preferences or strategies, which may happen from time to time for different reasons in subsequent negotiations. In response to these challenges, this article proposes a novel Deep Offline Reinforcement learning Negotiating Agent framework that allows to learn an effective strategy using previously collected negotiation datasets without requiring interaction with an opponent. This is in contrast to existing RL-based negotiation approaches that all rely on active interaction with opponents. Furthermore, the strategy fine-tuning mechanism is included to adjust the learned strategy in response to the preferences or strategy changes of the opponent. The performance of the proposed framework is evaluated based on a diverse set of state-of-the-art baselines under different settings. Experimental results show that the framework allows to learn effective strategies exclusively with offline datasets, and is also capable of effectively adapting to changes of an opponent's preferences or strategy.

A Deep Reinforcement Learning-Based Agent for Negotiation with Multiple Communication Channels

An autonomous agent for negotiation with multiple communication channels using parametrized deep Q-network *

Deep reinforcement learning with emergent communication for coalitional negotiation games

An Effective Negotiating Agent Framework Based on Deep Offline Reinforcement Learning.

Transfer Reinforcement Learning Based Negotiating Agent Framework.

Transfer Learning based Agent for Automated Negotiation

Negotiating Team Formation Using Deep Reinforcement Learning

Prosocial or Selfish? Agents with Different Behaviors for Contract Negotiation Using Reinforcement Learning

An Agent Bilateral Multi-issue Alternate Bidding Negotiation Protocol Based on Reinforcement Learning and Its Application in E-commerce.

An Intelligent Chatbot for Negotiation Dialogues.

Toward Efficient Agreements In Real-Time Multilateral Agent-Based Negotiations

ANOTO: Improving Automated Negotiation Via Offline-to-Online Reinforcement Learning.

Robustness Analysis of Negotiation Strategies through Multiagent Learning in Repeated Negotiation Games.

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

A Reinforcement Learning Optimized Negotiation Method Based on Mediator Agent

Deal or no deal? end-to-end learning for negotiation dialogues

Negotiating with Unknown Opponents Toward Multi-lateral Agreement in Real-Time Domains

Cooperative Multi-Agent Reinforcement Learning With Conversation Knowledge For Dialogue Management

MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation

Reaching Good Agreements in Multilateral Agent-based Negotiations ∗

Deep Multi-Agent Reinforcement Learning with Discrete-Continuous Hybrid Action Spaces