Resource-constrained Deep Learning: Challenges and Practices

Jianxin WU,Bin-Bin GAO,Xiu-Shen WEI,Jian-Hao LUO
DOI: https://doi.org/10.1360/n112017-00216
2018-01-01
Scientia Sinica Informationis
Abstract:Deep learning has made significant progress in recent years. However, deep learning models require many computation-related resources, and their learning process requires a large number of data points and their labels. Hence, the reduction of resource consumption of deep learning, i.e., resource-constrained deep learning, is a current research focus. In this study, we first analyze deep learning's thirst for various types of resources and the challenges they lead to and thereafter briefly introduce research progress from three aspects: data, label, and computation resources. Further, we provide detailed introductions of these areas using our research results as examples.
What problem does this paper attempt to address?