Abstract:Recent breakthroughs in deep learning and artificial intelligence technologies have enabled numerous mobile applications. While traditional computation paradigms rely on mobile sensing and cloud computing, deep learning implemented on mobile devices provides several advantages. These advantages include low communication bandwidth, small cloud computing resource cost, quick response time, and improved data privacy. Research and development of deep learning on mobile and embedded devices has recently attracted much attention. This paper provides a timely review of this fast-paced field to give the researcher, engineer, practitioner, and graduate student a quick grasp on the recent advancements of deep learning on mobile devices. In this paper, we discuss hardware architectures for mobile deep learning, including Field Programmable Gate Arrays, Application Specific Integrated Circuit, and recent mobile Graphic Processing Units. We present Size, Weight, Area and Power considerations and their relation to algorithm optimizations, such as quantization, pruning, compression, and approximations that simplify computation while retaining performance accuracy. We cover existing systems and give a state-of-the-industry review of TensorFlow, MXNet, Mobile AI Compute Engine, and Paddle-mobile deep learning platform. We discuss resources for mobile deep learning practitioners, including tools, libraries, models, and performance benchmarks. We present applications of various mobile sensing modalities to industries, ranging from robotics, healthcare and multi-media, biometrics to autonomous drive and defense. We address the key deep learning challenges to overcome, including low quality data, and small training/adaptation data sets. In addition, the review provides numerous citations and links to existing code bases implementing various technologies.

Toward Efficient Execution of Mainstream Deep Learning Frameworks on Mobile Devices: Architectural Implications

Deep Learning on Mobile and Embedded Devices: State-of-the-art, Challenges, and Future Directions

Explore Training of Deep Convolutional Neural Networks on Battery-powered Mobile Devices: Design and Application

Close the Gap Between Deep Learning and Mobile Intelligence by Incorporating Training in the Loop

Deep Model Compression for Mobile Platforms: A Survey

Performance Analysis and Characterization of Training Deep Learning Models on Mobile Devices

On-Demand Deep Model Compression for Mobile Devices

Enable Deep Learning on Mobile Devices: Methods, Systems, and Applications

Deep Learning on Mobile and Embedded Devices

AsyMo: Scalable and Efficient Deep-Learning Inference on Asymmetric Mobile CPUs

A Survey of Deep Learning on Mobile Devices: Applications, Optimizations, Challenges, and Research Opportunities

Deep Learning on Mobile Devices - A Review

Towards Implementing Energy-aware Data-driven Intelligence for Smart Health Applications on Mobile Platforms

Understanding Sensor Data Using Deep Learning Methods on Resource-Constrained Edge Devices.

FastDeepIoT: Towards Understanding and Optimizing Neural Network Execution Time on Mobile and Embedded Devices

Mobile or FPGA? A Comprehensive Evaluation on Energy Efficiency and a Unified Optimization Framework

Energy-efficient Deployment of Deep Learning Applications on Cortex-M based Microcontrollers using Deep Compression

Benchmarking of DL Libraries and Models on Mobile Devices

Deep Learning Frameworks Evaluation for Image Classification on Resource Constrained Device

Deep Learning Inference on Heterogeneous Mobile Processors: Potentials and Pitfalls

A Comprehensive Benchmark of Deep Learning Libraries on Mobile Devices