January , 2017 ] Deep Q-trading
Yang Wang,Dong Wang,Shiyue Zhang,Yang Feng,Shi-Zhu Li,Qiang Zhou
2017-01-01
Abstract:Correspondence: wangyang@cslt.riit.tsinghua.edu.cn Center for Speech and Language Technology, Research Institute of Information Technology, Tsinghua University, ROOM 1-303, BLDG FIT, 100084 Beijing, China Department of Computer Science, Tsinghua University, ROOM 1-303, BLDG FIT, 100084 Beijing, China Full list of author information is available at the end of the article Abstract Algorithmic trading is a hot topic in machine learning. Compared to other methods, reinforcement learning (RL), particularly Q-learning, can learn decision rules directly with reasonable reward, and therefore is suitable for learning trading strategies. Recently, Q-learning based on deep neural models, also known as deep Q-learning, has been successfully applied to some challenging tasks like game playing and robot motion. In this paper, we propose to employ deep Q-learning to build an end-to-end deep Q-trading system which can automatically determine what position to hold at each trading time. Our experimental results show that the deep Q-trading system can outperform the buy-and-hold strategy as well as the strategy learned by recurrent reinforcement learning (RRL) that was known to be more effective than Q-learning.