Abstract:How to efficiently deploy machine learning models on mobile devices has drawn a lot of attention in both academia and industries, among which the model training is a critical part.However, with increasingly public attention on data privacy and the recently adopted laws and regulations, it becomes harder for developers to collect training data from users and thus they cannot train high-quality models.Researchers have been exploring approaches to training neural networks on decentralized data.Those efforts will be summarized and their limitations be pointed out.To this end, this work presents a novel neural network training paradigm on mobile devices, which distributes all training computations associated with private data on local devices and requires no data to be uploaded in any form.Such training paradigm is named autonomous learning.To deal with two main challenges of autonomous learning, i.e., limited data volume and insufficient computing power available on mobile devices, this paper designs and implements the first autonomous learning system AutLearn.It incorporates the cloud (public data and pre-training)-client (private data and transfer learning) cooperation methodology and data augmentation techniques to ensure the model convergence on mobile devices.Furthermore, by optimization techniques such as model compression, neural network compiler, and runtime cache reuse, AutLearn can significantly reduce the on-client training cost.Two classical scenarios of autonomous learning are implemented based on AutLearn, with a set of experiments carried out.The results show that AutLearn can train the neural networks with comparable or even higher accuracy compared to traditional centralized/federated training mode with privacy preserved.AutLearn can also remarkably cut the computational and energy cost of neural network training on mobile devices.

MapReduce-based Backpropagation Neural Network over large scale mobile data

Close the Gap Between Deep Learning and Mobile Intelligence by Incorporating Training in the Loop

Explore Training of Deep Convolutional Neural Networks on Battery-powered Mobile Devices: Design and Application

Parallelizing Backpropagation Neural Network Using MapReduce and Cascading Model.

Large-scale Artificial Neural Network: MapReduce-based Deep Learning.

MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning

A Parallel Adaboost-Backpropagation Neural Network for Massive Image Dataset Classification

Fuzzy Method and Neural Network Model Parallel Implementation of Multi-Layer Neural Network Based on Cloud Computing for Real Time Data Transmission in Large Offshore Platform

High-Performance Machine Learning for Large-Scale Data Classification Considering Class Imbalance

Parallel Implementation of Multilayered Neural Networks Based on Map-Reduce on Cloud Computing Clusters.

The Parallelization of Back Propagation Neural Network in MapReduce and Spark

A parallel computing platform for training large scale neural networks

Prediction and Big Data Impact Analysis of Telecom Churn by Backpropagation Neural Network Algorithm from the Perspective of Business Model

Cascading Model Based Back Propagation Neural Network in Enabling Precise Classification

Big Data: A Parallel Particle Swarm Optimization-Back-Propagation Neural Network Algorithm Based on MapReduce

A High Performance Deep Learning Load Classification Method for the Massive Class Imbalanced Load Data

Research on parallel strategy of convolution neural network in distributed environment

Parallel implementation of multilayered neural networks based on Map-Reduce on cloud computing clusters

Autonomous Learning System Towards Mobile Intelligence

Learning Markov Blanket Bayesian Network for Big Data in MapReduce.

Developing a Novel Hybrid Biogeography-Based Optimization Algorithm for Multilayer Perceptron Training under Big Data Challenge.