An adaptive deep reinforcement learning framework enables curling robots with human-like performance in real-world conditions

Dong-Ok Won,Klaus-Robert Müller,Seong-Whan Lee

DOI: https://doi.org/10.1126/scirobotics.abb9764

IF: 25

2020-09-30

Science Robotics

Abstract:An AI curling robot can compete and win against top-ranked human teams in the game of curling.

robotics

What problem does this paper attempt to address?

Mastering Curling with RL-revised Decision Tree

Junjie Lin,Yuhao Gong,Jian Zhao,Wengang Zhou,Houqiang Li

DOI: https://doi.org/10.1109/cog57401.2023.10333135

2023-01-01

Abstract:Curling, also known as "chess on ice", is a popular worldwide sport, which not only tests the physical and mental strength of the participants but also showcases the beauty of movement and stillness and the wisdom of trade-offs. Previously, AI for curling was usually based on decision trees, which required strict artificial prior knowledge and often led to unexpected bugs on extreme occasions. In recent years, however, more and more reinforcement learning algorithms have been proposed in competitive games. Nevertheless, AI derived from RL is very unstable when playing against unseen opponents. In this work, we develop an AI for curling in a novel way, utilizing both decision trees and reinforcement learning. The policy of our AI is defined by a decision tree, and we detect the flaws of it through reinforcement learning. Training a policy model against the decision tree not only helps to mend the flaws of the tree but also provides a way to examine the strength and stability of the tree itself. This approach successfully combines the advantages of RL and decision trees, enhancing the strength and generalization capacity of the policy. Our AI ranked the first among 67 teams in the 2022 RLChina 1 spring competition.
Towards High Level Skill Learning: Learn to Return Table Tennis Ball Using Monte-Carlo Based Policy Gradient Method.

Yifeng Zhu,Yongsheng Zhao,Lisen Jin,Jun Wu,Rong Xiong

DOI: https://doi.org/10.1109/rcar.2018.8621776

2018-01-01

Abstract:Deep learning has achieved a great success in both visual and acoustic recognition and classification tasks. The accuracy of many state-of-the-art methods have surpassed that of human beings. However, in the field of robotics, it remains to be a big challenge for a real robot to master a high-level skill using deep learning methods, even though human can easily learn the task from demonstration, imitation and practice. Compared to Go and Atari games, this kind of tasks is usually continuous in both state space and action space, which makes value based reinforcement learning methods unavailable. Making a robot learn to return a ball to a desired point in table tennis is such a typical task. It would be a promising step if a robot can learn to play table tennis without the exact knowledge of the models in this sport just as human players do. In this paper, we consider such a kind of motion decision skill learning, a one-step decision making process, and give a Monte-Carlo based reinforcement learning method in the framework of Deep Deterministic Policy Gradient. Then we apply this method in robotic table tennis and test it on two tasks. The first one is to return balls to a desired point first, and the second one is to return balls to randomly selected landing points. The experimental results demonstrate that the trained policy can successfully return balls of random motion state to both a designated point and randomly selected landing points with high accuracy.
An AI-Based Curling Game System for Winter Olympics

Xuanke Shi,Quan Wang,Chao Wang,Rui Wang,Longshu Zheng,Chen Qian,Wei Tang

DOI: https://doi.org/10.34133/2022/9805054

IF: 11

2022-10-27

Research

Abstract:The real-time application of artificial intelligence (AI) technologies in sports is a long-standing challenge owing to large spatial sports field, complexity, and uncertainty of real-world environment, etc. Although some AI-based systems have been applied to sporting events such as tennis, basketball, and football, they are replayed after the game rather than applied in real time. Here, we present an AI-based curling game system, termed CurlingHunter, which can display actual trajectories, predicted trajectories, and house regions of curling during the games via a giant screen in curling stadiums and a live streaming media platform on the internet in real time, so as to assist the game, improve the interest of watching game, help athletes train, etc. We provide a complete description of CurlingHunter' architecture and a thorough evaluation of its performances and demonstrate that CurlingHunter possesses remarkable real-time performance (~9.005 ms), high accuracy ( cm under measurement m), and good stability. CurlingHunter is the first, to the best of our knowledge, real-time system that can assist athletes to compete during the games in the history of sports and has been successfully applied in Winter Olympics and Winter Paralympics. Our work highlights the potential of AI-based systems for real-time applications in sports.

multidisciplinary sciences
CURLing the Dream: Contrastive Representations for World Modeling in Reinforcement Learning

Victor Augusto Kich,Jair Augusto Bottega,Raul Steinmetz,Ricardo Bedin Grando,Ayano Yorozu,Akihisa Ohya

2024-09-01

Abstract:In this work, we present Curled-Dreamer, a novel reinforcement learning algorithm that integrates contrastive learning into the DreamerV3 framework to enhance performance in visual reinforcement learning tasks. By incorporating the contrastive loss from the CURL algorithm and a reconstruction loss from autoencoder, Curled-Dreamer achieves significant improvements in various DeepMind Control Suite tasks. Our extensive experiments demonstrate that Curled-Dreamer consistently outperforms state-of-the-art algorithms, achieving higher mean and median scores across a diverse set of tasks. The results indicate that the proposed approach not only accelerates learning but also enhances the robustness of the learned policies. This work highlights the potential of combining different learning paradigms to achieve superior performance in reinforcement learning applications.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition
Deep Q-Network for AI Soccer

Curie Kim,Yewon Hwang,Jong-Hwan Kim

DOI: https://doi.org/10.48550/arXiv.2209.09491

2022-09-21

Abstract:Reinforcement learning has shown an outstanding performance in the applications of games, particularly in Atari games as well as Go. Based on these successful examples, we attempt to apply one of the well-known reinforcement learning algorithms, Deep Q-Network, to the AI Soccer game. AI Soccer is a 5:5 robot soccer game where each participant develops an algorithm that controls five robots in a team to defeat the opponent participant. Deep Q-Network is designed to implement our original rewards, the state space, and the action space to train each agent so that it can take proper actions in different situations during the game. Our algorithm was able to successfully train the agents, and its performance was preliminarily proven through the mini-competition against 10 teams wishing to take part in the AI Soccer international competition. The competition was organized by the AI World Cup committee, in conjunction with the WCG 2019 Xi'an AI Masters. With our algorithm, we got the achievement of advancing to the round of 16 in this international competition with 130 teams from 39 countries.

Artificial Intelligence
Learning to Play Precision Ball Sports from scratch: a Deep Reinforcement Learning Approach

Armando Sousa,Liliana Antao,Luis Paulo Reis,Gil Goncalves

DOI: https://doi.org/10.1109/ijcnn48605.2020.9207518

2020-07-01

Abstract:Over the last years, robotics has increased its interest in learning human-like behaviors and activities. One of the most common actions searched, as well as one of the most fun to replicate, is the ability to play sports. This has been made possible with the steady increase of automated learning, encouraged by the tremendous developments in computational power and improved reinforcement learning (RL) algorithms. This paper implements a beginner Robot player for precision ball sports like boccia and bocce. A new simulated environment (PrecisionBall) is created, and a seven degree-of-freedom (DoF) robotic arm, is able to learn from scratch how to win the game and throw different types of balls towards the goal (the jack), using deep reinforcement learning. The environment is compliant with OpenAI Gym, using the MuJoCo realistic physics engine for a realistic simulation. A brief comparison of the convergence of different RL algorithms is performed. Several ball weights and various types of materials correspondent to bocce and boccia are tested, as well as different friction coefficients. Results show that the robot achieves a maximum success rate of 92.7% and mean of 75.7% for the best case. While learning to play these sports with the DDPG+HER algorithm, the robotic agent acquired some relevant skills that allowed it to win.
Achieving Human Level Competitive Robot Table Tennis

David B. D'Ambrosio,Saminda Abeyruwan,Laura Graesser,Atil Iscen,Heni Ben Amor,Alex Bewley,Barney J. Reed,Krista Reymann,Leila Takayama,Yuval Tassa,Krzysztof Choromanski,Erwin Coumans,Deepali Jain,Navdeep Jaitly,Natasha Jaques,Satoshi Kataoka,Yuheng Kuang,Nevena Lazic,Reza Mahjourian,Sherry Moore,Kenneth Oslund,Anish Shankar,Vikas Sindhwani,Vincent Vanhoucke,Grace Vesom,Peng Xu,Pannag R. Sanketi

2024-08-08

Abstract:Achieving human-level speed and performance on real world tasks is a north star for the robotics research community. This work takes a step towards that goal and presents the first learned robot agent that reaches amateur human-level performance in competitive table tennis. Table tennis is a physically demanding sport which requires human players to undergo years of training to achieve an advanced level of proficiency. In this paper, we contribute (1) a hierarchical and modular policy architecture consisting of (i) low level controllers with their detailed skill descriptors which model the agent's capabilities and help to bridge the sim-to-real gap and (ii) a high level controller that chooses the low level skills, (2) techniques for enabling zero-shot sim-to-real including an iterative approach to defining the task distribution that is grounded in the real-world and defines an automatic curriculum, and (3) real time adaptation to unseen opponents. Policy performance was assessed through 29 robot vs. human matches of which the robot won 45% (13/29). All humans were unseen players and their skill level varied from beginner to tournament level. Whilst the robot lost all matches vs. the most advanced players it won 100% matches vs. beginners and 55% matches vs. intermediate players, demonstrating solidly amateur human-level performance. Videos of the matches can be viewed at <a class="link-external link-https" href="https://sites.google.com/view/competitive-robot-table-tennis" rel="external noopener nofollow">this https URL</a>

Robotics
Policy Decision of Curling in Real Competition Scenes

Qian Xiao,Zongmin Li,Xiangdong Wang,Yujie Liu,Yachuan Li,Chaozhi Yang,Feimo Li

DOI: https://doi.org/10.1007/s40747-022-00921-4

IF: 6.7

2022-01-01

Complex & Intelligent Systems

Abstract:Policy decision of curling refers to providing strategy suggestions for curling competition with the help of computers. Existing curling agents have achieved good results in the digital scenarios, but cannot make correct decisions when applied to actual competition and training scenes. In this paper, a strategies decision agent in the real scene has been proposed. The competition situation was acquired by a Situation-Aware Network and mapped by a Digital Extraction module. We designed Curling MCTS to explore the best strategy in continuous space. The effectiveness of our framework has been verified by experiments and evaluated by China's wheelchair curling team at China Disabled Sports Management Center. With the help of our system, China's wheelchair curling team trained effectively and won the championship in the XIII Paralympic Winter Games (2022, Beijing). In addition, a new curling target detection dataset was provided.
The CoachAI Badminton Environment: A Novel Reinforcement Learning Environment with Realistic Opponents (Student Abstract)

Kuang-Da Wang,Wei-Yao Wang,Yu-Tse Chen,Yu-Heng Lin,Wen-Chih Peng

DOI: https://doi.org/10.1609/aaai.v38i21.30523

2024-03-24

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:The growing demand for precise sports analysis has been explored to improve athlete performance in various sports (e.g., basketball, soccer). However, existing methods for different sports face challenges in validating strategies in environments due to simple rule-based opponents leading to performance gaps when deployed in real-world matches. In this paper, we propose the CoachAI Badminton Environment, a novel reinforcement learning (RL) environment with realistic opponents for badminton, which serves as a compelling example of a turn-based game. It supports researchers in exploring various RL algorithms with the badminton context by integrating state-of-the-art tactical-forecasting models and real badminton game records. The Badminton Benchmarks are proposed with multiple widely adopted RL algorithms to benchmark the performance of simulating matches against real players. To advance novel algorithms and developments in badminton analytics, we make our environment open-source, enabling researchers to simulate more complex badminton sports scenarios based on this foundation. Our code is available at https://github.com/wywyWang/CoachAI-Projects/tree/main/CoachAI%20Badminton%20Environment.
Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Ki Deng,Yanjie Li,Songshuo Lu,Yongjin Mu,Xizheng Pang,Qi Liu

DOI: https://doi.org/10.1109/robio55434.2022.10011827

2022-01-01

Abstract:With the booming development of artificial in-telligence, the autonomous decision-making of robots on the battlefield has become a future trend. In the field of en-tertainment games, some institutions have already attained outstanding results in multi-agent decision-making tasks by using reinforcement learning algorithms. But in the field of robot confrontation game, the robot confrontation strategies are still based on the simple logic of artificial design in most cases, which hinders the further improvement of robot strategies. In this paper, a reinforcement-learning-based multi-robot control method is proposed to improve the strategy performance. We enhanced the reinforcement learning algorithm PPO with the self-play method by easy-to-implement tricks for multi-agent training and improve training efficiency. In simulated experiments based on the rules of the RoboMaster University AI Challenge, we show our method has a much higher winning percentage than traditional approaches like behavior tree.
Dota 2 with Large Scale Deep Reinforcement Learning

OpenAI,:,Christopher Berner,Greg Brockman,Brooke Chan,Vicki Cheung,Przemysław Dębiak,Christy Dennison,David Farhi,Quirin Fischer,Shariq Hashme,Chris Hesse,Rafal Józefowicz,Scott Gray,Catherine Olsson,Jakub Pachocki,Michael Petrov,Henrique P. d. O. Pinto,Jonathan Raiman,Tim Salimans,Jeremy Schlatter,Jonas Schneider,Szymon Sidor,Ilya Sutskever,Jie Tang,Filip Wolski,Susan Zhang,Henrique P. d.O. Pinto

DOI: https://doi.org/10.48550/arXiv.1912.06680

IF: 5.414

2019-12-13

Machine Learning

Abstract:On April 13th, 2019, OpenAI Five became the first AI system to defeat the world champions at an esports game. The game of Dota 2 presents novel challenges for AI systems such as long time horizons, imperfect information, and complex, continuous state-action spaces, all challenges which will become increasingly central to more capable AI systems. OpenAI Five leveraged existing reinforcement learning techniques, scaled to learn from batches of approximately 2 million frames every 2 seconds. We developed a distributed training system and tools for continual training which allowed us to train OpenAI Five for 10 months. By defeating the Dota 2 world champion (Team OG), OpenAI Five demonstrates that self-play reinforcement learning can achieve superhuman performance on a difficult task.
A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics

Puze Liu,Jonas Günster,Niklas Funk,Simon Gröger,Dong Chen,Haitham Bou-Ammar,Julius Jankowski,Ante Marić,Sylvain Calinon,Andrej Orsula,Miguel Olivares-Mendez,Hongyi Zhou,Rudolf Lioutikov,Gerhard Neumann,Amarildo Likmeta Amirhossein Zhalehmehrabi,Thomas Bonenfant,Marcello Restelli,Davide Tateo,Ziyuan Liu,Jan Peters

2024-11-09

Abstract:Machine learning methods have a groundbreaking impact in many application domains, but their application on real robotic platforms is still limited. Despite the many challenges associated with combining machine learning technology with robotics, robot learning remains one of the most promising directions for enhancing the capabilities of robots. When deploying learning-based approaches on real robots, extra effort is required to address the challenges posed by various real-world factors. To investigate the key factors influencing real-world deployment and to encourage original solutions from different researchers, we organized the Robot Air Hockey Challenge at the NeurIPS 2023 conference. We selected the air hockey task as a benchmark, encompassing low-level robotics problems and high-level tactics. Different from other machine learning-centric benchmarks, participants need to tackle practical challenges in robotics, such as the sim-to-real gap, low-level control issues, safety problems, real-time requirements, and the limited availability of real-world data. Furthermore, we focus on a dynamic environment, removing the typical assumption of quasi-static motions of other real-world benchmarks. The competition's results show that solutions combining learning-based approaches with prior knowledge outperform those relying solely on data when real-world deployment is challenging. Our ablation study reveals which real-world factors may be overlooked when building a learning-based solution. The successful real-world air hockey deployment of best-performing agents sets the foundation for future competitions and follow-up research directions.

Robotics,Artificial Intelligence,Machine Learning
Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning

Andrej Orsula

2024-06-02

Abstract:In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents learn solely from sparse rewards while incorporating self-play to iteratively refine their behaviour over time. The robotic manipulator is interfaced using continuous high-level actions for position-based control in the Cartesian plane while having partial observability of the environment with stochastic transitions. We demonstrate that agents are prone to overfitting when trained solely against a single playstyle, highlighting the importance of self-play for generalization to novel strategies of unseen opponents. Furthermore, the impact of the imagination horizon is explored in the competitive setting of the highly dynamic game of air hockey, with longer horizons resulting in more stable learning and better overall performance.

Robotics,Artificial Intelligence,Machine Learning
From mimic to counteract: a two-stage reinforcement learning algorithm for Google research football

Junjie Zhao,Jiangwen Lin,Xinyan Zhang,Yuanbai Li,Xianzhong Zhou,Yuxiang Sun

DOI: https://doi.org/10.1007/s00521-024-09455-x

2024-02-22

Neural Computing and Applications

Abstract:Deep reinforcement learning has proven to be effective in various video games, such as Atari games, StarCraft II, Google research football (GRF), and Dota II. We participated in the 2022 IEEE Conference on Games Football AI Competition and ranked in the top eight. Despite recent efforts, building agents for GRF still suffers from multi-agent coordination, sparse rewards, and stochastic environments. To address these issues and achieve good outcomes in the competition, we devised a reinforcement learning algorithm that uses deep reinforcement learning from demonstrations and policy distillation. In this study, we innovatively propose a two-stage algorithm named mimic-to-counteract reinforcement learning (MCRL) based on the historical game logs of opponents, we encountered during the warm-up session and formulated partner agents function similarly to human sparring partners, whereby they simulate opponents with diverse styles of play, enabling primary players to practice against a range of policies, they may encounter in real competitions. Additionally, we trained numerous mentor agents capable of restraining the sparring partners. We distilled their policies and amalgamated them to train a potent primary agent. Empirical results show that the proposed MCRL algorithm can efficiently search for valuable strategies with stable updates and balance the relationship between policy iteration and policy style deviation. Also, the primary agent can learn diverse but coordinated counteracting strategies and ranks in the top eight in the competition.

computer science, artificial intelligence
The CoachAI Badminton Environment: Bridging the Gap between a Reinforcement Learning Environment and Real-World Badminton Games

Kuang-Da Wang,Yu-Tse Chen,Yu-Heng Lin,Wei-Yao Wang,Wen-Chih Peng

DOI: https://doi.org/10.1609/aaai.v38i21.30584

2024-03-24

Proceedings of the AAAI Conference on Artificial Intelligence

Abstract:We present the CoachAI Badminton Environment, a reinforcement learning (RL) environment tailored for AI-driven sports analytics. In contrast to traditional environments using rule-based opponents or simplistic physics-based randomness, our environment integrates authentic opponent AIs and realistic randomness derived from real-world matches data to bridge the performance gap encountered in real-game deployments. This novel feature enables RL agents to seamlessly adapt to genuine scenarios. The CoachAI Badminton Environment empowers researchers to validate strategies in intricate real-world settings, offering: i) Realistic opponent simulation for RL training; ii) Visualizations for evaluation; and iii) Performance benchmarks for assessing agent capabilities. By bridging the RL environment with actual badminton games, our environment is able to advance the discovery of winning strategies for players. Our code is available at https://github.com/wywyWang/CoachAI-Projects/tree/main/Strategic%20Environment.
Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning

Florian Fuchs,Yunlong Song,Elia Kaufmann,Davide Scaramuzza,Peter Drr,Peter Durr

DOI: https://doi.org/10.1109/lra.2021.3064284

IF: 5.2

2021-07-01

IEEE Robotics and Automation Letters

Abstract:Autonomous car racing is a major challenge in robotics. It raises fundamental problems for classical approaches such as planning minimum-time trajectories under uncertain dynamics and controlling the car at the limits of its handling. Besides, the requirement of minimizing the lap time, which is a sparse objective, and the difficulty of collecting training data from human experts have also hindered researchers from directly applying learning-based approaches to solve the problem. In the present work, we propose a learning-based system for autonomous car racing by leveraging a high-fidelity physical car simulation, a course-progress proxy reward, and deep reinforcement learning. We deploy our system in Gran Turismo Sport, a world-leading car simulator known for its realistic physics simulation of different race cars and tracks, which is even used to recruit human race car drivers. Our trained policy achieves autonomous racing performance that goes beyond what had been achieved so far by the built-in AI, and at the same time, outperforms the fastest driver in a dataset of over 50,000 human players.

robotics
Asynchronous Advantage Actor-Critic Agent for Starcraft II

Basel Alghanem,Keerthana P G

DOI: https://doi.org/10.48550/arXiv.1807.08217

IF: 14.4

2018-07-22

Artificial Intelligence

Abstract:Deep reinforcement learning, and especially the Asynchronous Advantage Actor-Critic algorithm, has been successfully used to achieve super-human performance in a variety of video games. Starcraft II is a new challenge for the reinforcement learning community with the release of pysc2 learning environment proposed by Google Deepmind and Blizzard Entertainment. Despite being a target for several AI developers, few have achieved human level performance. In this project we explain the complexities of this environment and discuss the results from our experiments on the environment. We have compared various architectures and have proved that transfer learning can be an effective paradigm in reinforcement learning research for complex scenarios requiring skill transfer.
SCC: an efficient deep reinforcement learning agent mastering the game of StarCraft II

Xiangjun Wang,Junxiao Song,Penghui Qi,Peng Peng,Zhenkun Tang,Wei Zhang,Weimin Li,Xiongjun Pi,Jujie He,Chao Gao,Haitao Long,Quan Yuan

DOI: https://doi.org/10.48550/arXiv.2012.13169

IF: 5.414

2020-12-24

Machine Learning

Abstract:AlphaStar, the AI that reaches GrandMaster level in StarCraft II, is a remarkable milestone demonstrating what deep reinforcement learning can achieve in complex Real-Time Strategy (RTS) games. However, the complexities of the game, algorithms and systems, and especially the tremendous amount of computation needed are big obstacles for the community to conduct further research in this direction. We propose a deep reinforcement learning agent, StarCraft Commander (SCC). With order of magnitude less computation, it demonstrates top human performance defeating GrandMaster players in test matches and top professional players in a live event. Moreover, it shows strong robustness to various human strategies and discovers novel strategies unseen from human plays. In this paper, we will share the key insights and optimizations on efficient imitation learning and reinforcement learning for StarCraft II full game.
A Human Mixed Strategy Approach to Deep Reinforcement Learning

Ngoc Duy Nguyen,Saeid Nahavandi,Thanh Nguyen

DOI: https://doi.org/10.1109/SMC.2018.00682

2018-04-05

Abstract:In 2015, Google's DeepMind announced an advancement in creating an autonomous agent based on deep reinforcement learning (DRL) that could beat a professional player in a series of 49 Atari games. However, the current manifestation of DRL is still immature, and has significant drawbacks. One of DRL's imperfections is its lack of "exploration" during the training process, especially when working with high-dimensional problems. In this paper, we propose a mixed strategy approach that mimics behaviors of human when interacting with environment, and create a "thinking" agent that allows for more efficient exploration in the DRL training process. The simulation results based on the Breakout game show that our scheme achieves a higher probability of obtaining a maximum score than does the baseline DRL algorithm, i.e., the asynchronous advantage actor-critic method. The proposed scheme therefore can be applied effectively to solving a complicated task in a real-world application.

Machine Learning,Artificial Intelligence
Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations

Hongjia Li,Tianshu Wei,Ao Ren,Qi Zhu,Yanzhi Wang

DOI: https://doi.org/10.48550/arXiv.1710.03792

2017-10-11

Abstract:The recent breakthroughs of deep reinforcement learning (DRL) technique in Alpha Go and playing Atari have set a good example in handling large state and actions spaces of complicated control problems. The DRL technique is comprised of (i) an offline deep neural network (DNN) construction phase, which derives the correlation between each state-action pair of the system and its value function, and (ii) an online deep Q-learning phase, which adaptively derives the optimal action and updates value estimates. In this paper, we first present the general DRL framework, which can be widely utilized in many applications with different optimization objectives. This is followed by the introduction of three specific applications: the cloud computing resource allocation problem, the residential smart grid task scheduling problem, and building HVAC system optimal control problem. The effectiveness of the DRL technique in these three cyber-physical applications have been validated. Finally, this paper investigates the stochastic computing-based hardware implementations of the DRL framework, which consumes a significant improvement in area efficiency and power consumption compared with binary-based implementation counterparts.

Artificial Intelligence

An adaptive deep reinforcement learning framework enables curling robots with human-like performance in real-world conditions

Mastering Curling with RL-revised Decision Tree

Towards High Level Skill Learning: Learn to Return Table Tennis Ball Using Monte-Carlo Based Policy Gradient Method.

An AI-Based Curling Game System for Winter Olympics

CURLing the Dream: Contrastive Representations for World Modeling in Reinforcement Learning

Deep Q-Network for AI Soccer

Learning to Play Precision Ball Sports from scratch: a Deep Reinforcement Learning Approach

Achieving Human Level Competitive Robot Table Tennis

Policy Decision of Curling in Real Competition Scenes

The CoachAI Badminton Environment: A Novel Reinforcement Learning Environment with Realistic Opponents (Student Abstract)

Multi-Robot Real-time Game Strategy Learning Based on Deep Reinforcement Learning.

Dota 2 with Large Scale Deep Reinforcement Learning

A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics

Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning

From mimic to counteract: a two-stage reinforcement learning algorithm for Google research football

The CoachAI Badminton Environment: Bridging the Gap between a Reinforcement Learning Environment and Real-World Badminton Games

Super-Human Performance in Gran Turismo Sport Using Deep Reinforcement Learning

Asynchronous Advantage Actor-Critic Agent for Starcraft II

SCC: an efficient deep reinforcement learning agent mastering the game of StarCraft II

A Human Mixed Strategy Approach to Deep Reinforcement Learning

Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations