Abstract:Deep Neural Networks (DNNs) are commonly used methods in computational intelligence. Most prevalent DNN-based image classification methods are dedicated to promoting the performance by designing complicated network architectures and requiring large amounts of model parameters. These large-scale DNN-based models are performed on all images consistently. However, since there are meaningful differences between images, it is difficult to accurately classify all images by a consistent network architecture. For example, a deeper network is fit for the images that are difficult to be distinguished, but may lead to model overfitting for simple images. Therefore, we should selectively use different models to deal with different images, which is similar to the human cognition mechanism, in which different levels of neurons are activated according to the difficulty of object recognition. To this end, we propose a Hierarchical Convolutional Neural Network (HCNN) for image classification in this paper. HCNNs comprise multiple sub-networks, which can be viewed as different levels of neurons in humans, and these sub-networks are used to classify the images progressively. Specifically, we first initialize the weight of each image and each image category, and these images and initial weights are used for training the first sub-network. Then, according to the predicted results of the first sub-network, the weights of misclassified images are increased, while the weights of correctly classified images are decreased. Furthermore, the images with the updated weights are used for training the next sub-networks. Similar operations are performed on all sub-networks. In the test stage, each image passes through the sub-networks in turn. If the prediction confidences in a sub-network are higher than a given threshold, then the results are output directly. Otherwise, deeper visual features need to be learned successively by the subsequent sub-networks until a reliable image classification result is obtained or the last sub-network is reached. Experimental results show that HCNNs can obtain better results than classical CNNs and the existing models based on ensemble learning. HCNNs have 2.68% higher accuracy than Residual Network 50 (Resnet50) on the ultrasonic image dataset, 1.19% than Resnet50 on the chimpanzee facial image dataset, and 10.86% than Adaboost-CNN on the CIFAR-10 dataset. Furthermore, the HCNN is extensible, since the types of sub-networks and their combinations can be dynamically adjusted.

One-dimensional DCNN Feature Selective Transformation with LSTM-RDN for Image Classification

Research on Image Classification Method of Features of Combinatorial Convolution

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

Cropnet: Deep Spatial-Temporal-Spectral Feature Learning Network for Crop Classification from Time-Series Multi-Spectral Images

HCFNN: High-order Coverage Function Neural Network for Image Classification

Transform-Invariant Convolutional Neural Networks for Image Classification and Search

On the Selective and Invariant Representation of DCNN for High-Resolution Remote Sensing Image Recognition

Low-rank sparse feature selection for image classification

Learning Transformation-Invariant Representations for Image Recognition with Drop Transformation Networks.

Selective Convolutional Neural Networks and Cascade Classifiers for Remote Sensing Image Classification

Image classification using regularized convolutional neural network design with dimensionality reduction modules: RCNN–DRM

A Novel Progressive Image Classification Method Based on Hierarchical Convolutional Neural Networks

Two-Stage Selective Ensemble of CNN via Deep Tree Training for Medical Image Classification

Study Of The Application Of Deep Convolutional Neural Networks (Cnns) In Processing Sensor Data And Biomedical Images

DBCvT: Double Branch Convolutional Transformer for Medical Image Classification

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Performance Evaluation of Deep Learning Classification Network for Image Features

LDCNet: A Lightweight Multi-Scale Convolutional Neural Network Using Local Dense Connectivity for Image Recognition

Fine-Grained Image Classification Using Modified DCNNs Trained by Cascaded Softmax and Generalized Large-Margin Losses

Robust Image Matching By Dynamic Feature Selection

Recognition Oriented Facial Image Quality Assessment Via Deep Convolutional Neural Network