Abstract:Contemporary machine learning methods have evolved from conventional algorithms to deep neural networks (DNNs) that are computation- and data- intensive. Thus, they are suitable to be deployed in the cloud that can offer high computational capacity and scalable resources. However, the cloud computing paradigm is not optimal for delay- and energy-sensitive applications. To mitigate these problems, a battery of distributed DNNs have been proposed to allow a fast inference with device-edge-cloud synergy. Furthermore, although distributed deployment of DNNs on real communication networks is an important research topic, the legacy network architecture cannot meet the requirements of these distributed deep neural networks due to the complicated management and manual configuration, etc. To cope with these requirements, we develop a novel and explicit Intelligent Software Defined Networking (ISDN) that aims to manage the bandwidth and computing resources across the network via the SDN paradigm. We first identify the difficulties of deploying distributed intelligent computing in the current network architecture. Then, we explain how to address these problems by introducing the ISDN architecture. Specifically, we develop a dynamic routing method to enable Quality-of-Service (QoS) communication based on the SDN paradigm and propose a Markov Decision Process (MDP) based dynamic task offloading model to achieve the optimal offloading policy of DNN tasks. We develop a simulation platform based on Mininet to measure its performance advantages over traditional architectures. Extensive experimental results show that compared with the traditional network architecture, our architecture based on the SDN paradigm can perform better in terms of both network throughput and resource utilization.

When In-Network Computing Meets Distributed Machine Learning

ClickINC: In-network Computing as a Service in Heterogeneous Programmable Data-center Networks

In-Network Computing Powered Mobile Edge: Toward High Performance Industrial IoT

Towards Inference Delivery Networks: Distributing Machine Learning with Optimality Guarantees

NetRPC: Enabling In-Network Computation in Remote Procedure Calls

Rethinking Data Center Networks: Machine Learning Enables Network Intelligence

IN3: A Framework for In-Network Computation of Neural Networks in the Programmable Data Plane

Machine Learning Empowered Intelligent Data Center Networking: A Survey

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

Optimize Resource Placement for In-Network Computing

Unleashing In-network Computing on Scientific Workloads

Hierarchical and Distributed Machine Learning Inference Beyond the Edge

Distributed Machine Learning in D2D-Enabled Heterogeneous Networks: Architectures, Performance, and Open Challenges

Resource-Efficient Distributed Deep Neural Networks Empowered by Intelligent Software-Defined Networking.

Optimal In-Network Distribution of Learning Functions for a Secure-by-Design Programmable Data Plane of Next-Generation Networks

A Review of the In-Network Computing and Its Role in the Edge-Cloud Continuum

Traffic Management for Distributed Machine Learning in RDMA-enabled Data Center Networks.

Network-Aware Distributed Machine Learning Over Wide Area Network

Distributed Machine Learning for Wireless Communication Networks: Techniques, Architectures, and Applications

D2D-Enabled Data Sharing for Distributed Machine Learning at Wireless Network Edge

Machine Learning for Networking: Workflow, Advances and Opportunities