Abstract:More and more social media images are produced on the Internet. Social image classification is an important task in many fields, such as public opinion analysis and sensitive image detection. Although convolutional neural networks (CNN) have achieved amazing achievements in the field of image classification. However, social images are special multi-label images. social image classification still has a lot of space for improvement. In one aspect, we find that many methods using CNN networks for classification tasks mainly use the top-level features, which contain limited information. In the real world, social images usually contain multiple semantic objects with different scales. Using the top-level features to classify different objects may not be the most suitable. Therefore, we propose a multi-branch prediction network. Since the shallow structure of the CNN network can capture some low-level features of the image, such as boundary, color, and so on, while the deeper features can capture some high-level semantics of the image, so different branches can get different representations for multi-label image classification. Subsequently, we also use the feature fusion module for each branch feature, using other branch features as a slight supplement. An efficient attention mechanism is introduced after the fusion module of each branch, which embeds the position information of the feature map into the channel attention so that the branch prediction can locate and identify the object area more accurately. In particular, a multi-branch independent prediction strategy is adopted in this work. The branch result with the highest prediction probability is regarded as the prediction of the whole network. Experiments show that the accuracy of the classification method proposed in this paper is better than other methods for multi-label classification problems.

Multi-branch Aggregate Convolutional Neural Network for Image Classification.

Database Systems for Advanced Applications

Research on Image Classification Method of Features of Combinatorial Convolution

Class-aware Convolution and Attentive Aggregation for Image Classification.

Bi-branch deconvolution-based convolutional neural network for image classification

Scene Classification Via Learning a Multi-Branch Convolutional Network.

Multi-branch Prediction Network for Multi-label Social Image Classification.

An Image Classification Method Based on Adaptive Attention Mechanism and Feature Extraction Network

Hierarchical Bilinear Convolutional Neural Network for Image Classification.

Multi-Branch Regression Network For Building Classification Using Remote Sensing Images

Multi-path Convolutional Neural Networks for Complex Image Classification

A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification

Image Classification via Multi-branch Position Attention Network.

Remote Sensing Image Scene Classification Based on Deep Multi-branch Feature Fusion Network

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Hierarchical Transfer Convolutional Neural Networks for Image Classification

A Multi-branch Feature Fusion Model Based on Convolutional Neural Network for Hyperspectral Remote Sensing Image Classification

Multi-branch RA Capsule Network and Its Application in Image Classification

Feature Correlation Analysis of Two-Branch Convolutional Networks for Multi-Source Image Classification.

An Ensemble Learning Framework for Convolutional Neural Network Based on Multiple Classifiers

Deep Feature Aggregation Framework Driven by Graph Convolutional Network for Scene Classification in Remote Sensing.