Abstract:As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, S&P 500, HSI, SSE 50, and CSI 300; (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-the-art DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link https://github.com/AI4Finance-LLC/FinRL-Library.

RL-X: A Deep Reinforcement Learning Library (not only) for RoboCup

Robot Simulation and Reinforcement Learning Training Platform Based on Distributed Architecture.

RobocupGym: A challenging continuous control benchmark in Robocup

Reinforcement Learning Within the Classical Robotics Stack: A Case Study in Robot Soccer

Coordination and Machine Learning in Multi-Robot Systems: Applications in Robotic Soccer

rSoccer: A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer

SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning

RobotDrlSim: A Real Time Robot Simulation Platform for Reinforcement Learning and Human Interactive Demonstration Learning

Development of a Simulation Environment for Robot Soccer Game with Deep Reinforcement Learning and Role Assignment

A Framework for Studying Reinforcement Learning and Sim-to-Real in Robot Soccer

Designing a Skilled Soccer Team for RoboCup: Exploring Skill-Set-Primitives through Reinforcement Learning

RLtools: A Fast, Portable Deep Reinforcement Learning Library for Continuous Control

Learning Agile Soccer Skills for a Bipedal Robot with Deep Reinforcement Learning

Scilab-RL: A software framework for efficient reinforcement learning and cognitive modeling research

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

Efficient Reinforcement Learning Development with RLzoo

CytonRL: an Efficient Reinforcement Learning Open-source Toolkit Implemented in C++

Learning to Play Soccer by Reinforcement and Applying Sim-to-Real to Compete in the Real World

RLlib: Abstractions for distributed reinforcement learning

ChainerRL: A Deep Reinforcement Learning Library

Learning Robot Soccer from Egocentric Vision with Deep Reinforcement Learning