Abstract:Traditional Convolutional Neural Networks (CNNs) typically use the same activation function (usually ReLU) for all neurons with non-linear mapping operations. For example, the deep convolutional architecture Inception-v4 uses ReLU. To improve the classification performance of traditional CNNs, a new "Multi-function Convolutional Neural Network" (MCNN) is created by using different activation functions for different neurons. For $n$ neurons and $m$ different activation functions, there are a total of $m^n-m$ MCNNs and only $m$ traditional CNNs. Therefore, the best model is very likely to be chosen from MCNNs because there are $m^n-2m$ more MCNNs than traditional CNNs. For performance analysis, two different datasets for two applications (classifying handwritten digits from the MNIST database and classifying brain MRI images into one of the four stages of Alzheimer's disease (AD)) are used. For both applications, an activation function is randomly selected for each layer of a MCNN. For the AD diagnosis application, MCNNs using a newly created multi-function Inception-v4 architecture are constructed. Overall, simulations show that MCNNs can outperform traditional CNNs in terms of multi-class classification accuracy for both applications. An important future research work will be to efficiently select the best MCNN from $m^n-m$ candidate MCNNs. Current CNN software only provides users with partial functionality of MCNNs since different layers can use different activation functions but not individual neurons in the same layer. Thus, modifying current CNN software systems such as ResNets, DenseNets, and Dual Path Networks by using multiple activation functions and developing more effective and faster MCNN software systems and tools would be very useful to solve difficult practical image classification problems.

Midcn: A Multiple Instance Deep Convolutional Network For Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

Multiple Instance Learning Convolutional Neural Networks for Object Recognition

Multiple instance dense connected convolution neural network for aerial image scene classification

A Remote-Sensing Scene-Image Classification Method Based on Deep Multiple-Instance Learning with a Residual Dense Attention ConvNet

Pyramidal Multiple Instance Detection Network With Mask Guided Self-Correction for Weakly Supervised Object Detection

CNN: Single-label to Multi-label

MDCN: Multi-Scale, Deep Inception Convolutional Neural Networks for Efficient Object Detection

Classifying and Segmenting Microscopy Images Using Convolutional Multiple Instance Learning

A Prototype Learning Based Multi-Instance Convolutional Neural Network

CC-DCNet: Dynamic Convolutional Neural Network with Contrastive Constraints for Identifying Lung Cancer Subtypes on Multi-modality Images

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Contextual Features and Information Bottleneck-Based Multi-Input Network for Breast Cancer Classification from Contrast-Enhanced Spectral Mammography

Multi-path Convolutional Neural Networks for Complex Image Classification

Multi-function Convolutional Neural Networks for Improving Image Classification Performance

Multi-DeepNet: A Novel Weakly-Supervised Multi-Task and Multi-View-Oriented Convolution Neural Network for COVID-19 Diagnosis from CT Images

Hybrid multiple instance learning network for weakly supervised medical image classification and localization

Hierarchical Bilinear Convolutional Neural Network for Image Classification.

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Fine-Grained Classification via Mixture of Deep Convolutional Neural Networks

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition