Abstract:Deep Convolutional Neural Networks (CNN) have evolved as popular machine learning models for image classification during the past few years, due to their ability to learn the problem-specific features directly from the input images. The success of deep learning models solicits architecture engineering rather than hand-engineering the features. However, designing state-of-the-art CNN for a given task remains a non-trivial and challenging task, especially when training data size is less. To address this phenomena, transfer learning has been used as a popularly adopted technique. While transferring the learned knowledge from one task to another, fine-tuning with the target-dependent Fully Connected (FC) layers generally produces better results over the target task. In this paper, the proposed AutoFCL model attempts to learn the structure of FC layers of a CNN automatically using Bayesian optimization. To evaluate the performance of the proposed AutoFCL, we utilize five pre-trained CNN models such as VGG-16, ResNet, DenseNet, MobileNet, and NASNetMobile. The experiments are conducted on three benchmark datasets, namely CalTech-101, Oxford-102 Flowers, and UC Merced Land Use datasets. Fine-tuning the newly learned (target-dependent) FC layers leads to state-of-the-art performance, according to the experiments carried out in this research. The proposed AutoFCL method outperforms the existing methods over CalTech-101 and Oxford-102 Flowers datasets by achieving the accuracy of 94.38% and 98.89%, respectively. However, our method achieves comparable performance on the UC Merced Land Use dataset with 96.83% accuracy. The source codes of this research are available at <a class="link-external link-https" href="https://github.com/shabbeersh/AutoFCL" rel="external noopener nofollow">this https URL</a>.

Research on the Fine-tuning Technology Based on Faster R-CNN.

A Study on Training Fine-Tuning of Convolutional Neural Networks.

Pay Attention to Convolution Filters: Towards Fast and Accurate Fine-Grained Transfer Learning

Transfer learning and fine‐tuned transfer learning methods' effectiveness analyse in the CNN‐based deep learning models

Object Detection in VHR Image Using Transfer Learning with Deformable Convolution

RSCNN: A CNN-Based Method to Enhance Low-Light Remote-Sensing Images

Multifaceted Analysis of Fine-Tuning in Deep Model for Visual Recognition

An Improved Faster R-CNN for Small Object Detection

Face Detection Using Improved Faster RCNN

Face Detection System Based on Deep Learning

Few-Shot Object Detection of Remote Sensing Images via Two-Stage Fine-Tuning

AutoFCL: Automatically Tuning Fully Connected Layers for Handling Small Dataset

Game Robot'S Vision Based On Faster Rcnn

Enhancing Few-Shot Object Detection with Modified Faster R-CNN and Transfer Learning

Research on Cone Bucket Target Detection Based on Improved Faster R-CNN Deep Network

The Optimization of Face Detection Technology Based on Neural Network and Deep Learning

Effective Domain Knowledge Transfer with Soft Fine-tuning

On the Large-Scale Transferability of Convolutional Neural Networks.

Face Detection of Innovation Base Based on Faster RCNN.

An improved deep learning-based optimal object detection system from images

Efficient Convolutional Neural Networks Utilizing Fine-Grained Fast Fourier Transforms