Abstract:Recently, reinforcement learning has been applied to cryptocurrencies to make profitable trades. However, cryptocurrency trading is a very challenging task due to the volatility of the market, especially during bearish periods. In addressing this problem, the existing literature employs single-agent techniques such as deep Q-network (DQN), advantage actor-critic (A2C), and proximal policy optimization (PPO), or their ensembles. Moreover, in the context of cryptocurrencies, the mechanisms for restricting losses during a bearish market are insufficiently robust. Consequently, the performance of reinforcement learning methods for cryptocurrency trading in the existing literature is constrained. To overcome this limitation, we propose a novel cryptocurrency trading method based on multi-agent proximal policy optimization (MAPPO) with a collaborative multi-agent scheme and a local-global reward function to optimize both the individual and collective performance of the agents. Both a multi-objective optimization technique and a multi-scale continuous loss (MSCL) reward are used to train agents using a progressive penalty to avoid consecutive losses of portfolio value. For evaluation, we compared our method to multiple baselines. As a result, better cumulative returns are achieved than when baseline methods are used. In addition, the superiority of our method is emphasized by the result of the bearish test set, where only our method can make a profit. Specifically, our method obtains a 2.36% cumulative return, whereas the baseline methods result in negative cumulative returns. In comparison to FinRL-Ensemble, a reinforcement learning-based method, our method achieves a 46.05% greater cumulative return in the bullish test set.

Optimizing Market Making using Multi-Agent Reinforcement Learning

Multi-Agent Deep Reinforcement Learning for High-Frequency Multi-Market Making

Extending Deep Reinforcement Learning Frameworks in Cryptocurrency Market Making

Reinforcement Learning Approaches to Optimal Market Making

Reinforcement Learning for Market Making in a Multi-agent Dealer Market

Deep Reinforcement Learning for Market Making

Multi-agent reinforcement learning in a realistic limit order book market simulation

Deep Reinforcement Learning for High-Frequency Market Making

Reinforcement Learning in Non-Markov Market-Making

Optimal Execution with Reinforcement Learning

Optimizing Trading Strategies in Quantitative Markets using Multi-Agent Reinforcement Learning

Market Making Strategy Optimization via Deep Reinforcement Learning

Towards Multi-Agent Reinforcement Learning driven Over-The-Counter Market Simulations

Optimizing Automated Trading Systems with Deep Reinforcement Learning

Optimizing Portfolio with Two-Sided Transactions and Lending: A Reinforcement Learning Framework

A reinforcement learning approach to improve the performance of the Avellaneda-Stoikov market-making algorithm

Stock Market Trading Agent Using On-Policy Reinforcement Learning Algorithms

Multi-Agent Deep Reinforcement Learning With Progressive Negative Reward for Cryptocurrency Trading

Market Making with Deep Reinforcement Learning from Limit Order Books

Multiagent-based deep reinforcement learning framework for multi-asset adaptive trading and portfolio management