Abstract:As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, S&P 500, HSI, SSE 50, and CSI 300; (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-the-art DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link https://github.com/AI4Finance-LLC/FinRL-Library.

CytonRL: an Efficient Reinforcement Learning Open-source Toolkit Implemented in C++

CaiRL: A High-Performance Reinforcement Learning Environment Toolkit

RLtools: A Fast, Portable Deep Reinforcement Learning Library for Continuous Control

SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learning

ELF: An Extensive, Lightweight and Flexible Research Platform for Real-time Strategy Games

rlpyt: A Research Code Base for Deep Reinforcement Learning in PyTorch

RL-X: A Deep Reinforcement Learning Library (not only) for RoboCup

Double A3C: Deep Reinforcement Learning on OpenAI Gym Games

XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library

HackAtari: Atari Learning Environments for Robust and Continual Reinforcement Learning

RobocupGym: A challenging continuous control benchmark in Robocup

Cleanba: A Reproducible and Efficient Distributed Reinforcement Learning Platform

FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance

Karolos: An Open-Source Reinforcement Learning Framework for Robot-Task Environments

Enabling A Network AI Gym for Autonomous Cyber Agents

Sample-efficient Reinforcement Learning in Robotic Table Tennis

Pearl: A Production-ready Reinforcement Learning Agent

LExCI: A Framework for Reinforcement Learning with Embedded Systems

CtRL-Sim: Reactive and Controllable Driving Agents with Offline Reinforcement Learning

TLeague: A Framework for Competitive Self-Play based Distributed Multi-Agent Reinforcement Learning

Scilab-RL: A software framework for efficient reinforcement learning and cognitive modeling research