Performance Evaluation of Deep Learning Classification Network for Image Features

Qiang Li,Yingjian Yang,Yingwei Guo,Wei Li,Yang Liu,Han Liu,Yan Kang
DOI: https://doi.org/10.1109/access.2020.3048956
IF: 3.9
2021-01-01
IEEE Access
Abstract:Deep learning (DL) has emerged as a powerful image processing technique that learns the features of the data and produces state-of-the-art prediction results. The decade from 2010 to 2020 is a real revival of DL, which has come to a turning point in history. In image classification, many deep learning networks have been proposed by scholars, and each of them has its own strengthness. It is very important and efficient for the researchers and the developers to know the performance of these networks, especially for the beginners, so as to give them a transplant instruction by an objective evaluation index. In this paper, we constructed different data sets from three aspects, texture, shape, and measurement scale to test the performance of nine mainstream image classification networks. Cross-contrast experiments were performed to analyze the sensitivity of factors which influence the stability of image classification networks. Experimental results shown that in the 27 image datasets generated by the three image factors, the classification performance of AlexNet, GoogleNet, VggNet, and DenseNet is better. The perfomance comparison of these networks are showed and discussed in details. Code and pretrained models are available at https://github.com/liqiang12689/image-classification-finall.
computer science, information systems,telecommunications,engineering, electrical & electronic
What problem does this paper attempt to address?
The main aim of this paper is to evaluate and compare the performance of different deep learning image classification networks and to explore the advantages and disadvantages of these networks when handling different types of image features such as shape, texture, and scale. Specifically, the objectives of the paper include: 1. **Constructing datasets**: The authors constructed different datasets from three basic aspects: shape, texture, and scale, to test the performance of nine mainstream image classification networks. 2. **Performance evaluation**: Analyzing the sensitivity of factors affecting the stability of image classification networks through cross-comparison experiments. 3. **Network comparison**: Conducting a detailed performance comparison of networks such as AlexNet, GoogleNet, VggNet, and DenseNet, and discussing their performance on different image datasets. 4. **Providing guidance**: Offering objective evaluation metrics for researchers and developers to help them choose the appropriate network architecture when dealing with different types of image features. In short, this paper aims to provide valuable reference information for researchers in the related field by systematically and comprehensively evaluating the performance of various deep learning image classification networks, thereby enabling a better understanding and application of these networks.