Abstract:In this paper, we propose a multi-branch neural network architecture named Coupled Modular Neural Network (CMNN). A CMNN is a network consisting of $\beta $ closely coupled sub-networks, where $\beta $ is termed as the branching factor in this paper. We call the whole network a super-graph and each sub-network a sub-graph. Each sub-graph is a stand-alone neural network and shares a common block with other sub-graphs. To effectively leverage the super-graph we propose a simple but easy-to-implement Round-Robin-based learning algorithm. Each training iteration contains two phases. In the first phase, we choose a sub-graph in a Round-Robin fashion and train it using knowledge of the super-graph (distillation). In the second phase, we fine-tune the super-graph based on the updated sub-graphs. This algorithm produces a different copy of the super-graph at each iteration which acts as an improved teacher network for the sub-graph; and a different copy of one of the sub-graphs which functions as a new building block for the super-graph. To validate and test CMNN and the proposed algorithm, we conduct experiments on CIFAR-10, CIFAR-100, Tiny ImageNet and a private On-Road-Risk (ORR) datasets. Empirical results on all these four datasets indicate that we not only obtain a strong sub-graph network, the learning framework can also produce strong ensemble performance which substantiates the diversity introduced throughout the learning framework.

Task Decomposition and Module Combination Based on Class Relations: a Modular Neural Network for Pattern Classification

Task Decomposition Based on Class Relations: A Modular Neural Network Architecture for Pattern Classification

Decompose Learning: Combine Feature Extraction and Classification

Task Decomposition and Modular Single-Hidden-layer Perceptron Classifiers for Multi-Class Learning Problems

Decomposition and Parallel Learning of Imbalanced Classification Problems by Min-Max Modular Neural Network

CMNN: Coupled Modular Neural Network.

ModularBoost: an Efficient Network Inference Algorithm Based on Module Decomposition.

Neural Network Module Decomposition and Recomposition

Co-Evolutionary Modular Neural Networks for Automatic Problem Decomposition

Automatic Feature Extraction Based Structure Decomposition Method for Multi-Classification

A Matrix Modular Neural Network Based on Task Decomposition with Subspace Division by Adaptive Affinity Propagation Clustering

Modular neural network via exploring category hierarchy

Massively Parallel Classification of Single-Trial EEG Signals Using a Min-Max Modular Neural Network

Module Combination Based on Decision Tree in Min-Max Modular Network

Modularizing Deep Learning via Pairwise Learning With Kernels

Adaptive Task Decomposition And Modular Multilayer Perceptrons For Letter Recognition

A modular k-nearest neighbor classification method for massively parallel text categorization

Multitask Learning With Enhanced Modules.

Tree-Like Branching Network for Multi-class Classification

A Parallel and Modular Multi-Sieving Neural Network Architecture with Multiple Control Networks

Class-modular Multi-Layer Perceptions, Task Decomposition and Virtually Balanced Training Subsets