Abstract:Deep Reinforcement Learning (DRL) has achieved remarkable success in perfect information games. However, when applied to imperfect information games like Contract Bridge, DRL faces challenges not only from unobservable partial information but also from the lack of efficient exploration. Although several Evolutionary Reinforcement Learning algorithms (ERLs) have harnessed Evolutionary Algorithms (EAs) to enhance exploration capabilities, the practical performance of EAs is limited either by the high-dimensional parameter space or possibly inaccurate guidance from value networks. In this paper, we introduce a novel ERL algorithm that employs the Particle Swarm Optimization (PSO) algorithm to search for superior action sequences, thereby aiding agents in exploring uncharted territory. We conduct the search in action space and evaluate action sequences through interactions with the environment to avoid the limitations of parameter space and value networks, respectively. The diverse experiences collected in the search and evaluation can boost the learning of the DRL agent. In addition, the action sequence search is executed only when the agent converges in local optima, which can reduce the overall cost of action evaluation and avoid influencing the optimization process of DRL. Through experimental comparisons conducted on Contract Bridge, our method demonstrates superior performance when compared with several state-of-the-art DRL and ERL algorithms. Furthermore, we utilize our method in the Bridge Competition of AAMAS 2023 Imperfect Information Card Games Competition and rank the first.

Automatic Bridge Bidding Using Deep Reinforcement Learning

Competitive Bridge Bidding with Deep Neural Networks

AI Enabled Bridge Bidding Supporting Interactive Visualization

Deep Reinforcement Learning for Strategic Bidding in Electricity Markets

Alternate inference-decision reinforcement learning with generative adversarial inferring for bridge bidding

A Simple, Solid, and Reproducible Baseline for Bridge Bidding AI

AlphaDou: High-Performance End-to-End Doudizhu AI Integrating Bidding

Full DouZero+: Improving DouDizhu AI by Opponent Modeling, Coach-Guided Training and Bidding Learning

Intelligent Decision-Making and Human Language Communication Based on Deep Reinforcement Learning in a Wargame Environment

Evolutionary Reinforcement Learning with Action Sequence Search for Imperfect Information Games

Learning to Design and Construct Bridge Without Blueprint

LADDER: A Human-Level Bidding Agent for Large-Scale Real-Time Online Auctions

An Intelligent Bidding Strategy Based on Model-Free Reinforcement Learning for Real-Time Bidding in Display Advertising

Playing Card-Based RTS Games with Deep Reinforcement Learning.

Deep Reinforcement Learning for Sequential Combinatorial Auctions

Applying Opponent Modeling for Automatic Bidding in Online Repeated Auctions

Economic span selection of bridge based on deep reinforcement learning

Learning Best Response Policies in Dynamic Auctions via Deep Reinforcement Learning

Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertising

Learn to Bet: Using Reinforcement Learning to Improve Vehicle Bids in Auction-Based Smart Intersections

Strategic bidding in freight transport using deep reinforcement learning