Abstract:Transfer learning enables solving a specific task having limited data by using the pre-trained deep networks trained on large-scale datasets. Typically, while transferring the learned knowledge from source task to the target task, the last few layers are fine-tuned (re-trained) over the target dataset. However, these layers are originally designed for the source task that might not be suitable for the target task. In this paper, we introduce a mechanism for automatically tuning the Convolutional Neural Networks (CNN) for improved transfer learning. The pre-trained CNN layers are tuned with the knowledge from target data using Bayesian Optimization. First, we train the final layer of the base CNN model by replacing the number of neurons in the softmax layer with the number of classes involved in the target task. Next, the pre-trained CNN is tuned automatically by observing the classification performance on the validation data (greedy criteria). To evaluate the performance of the proposed method, experiments are conducted on three benchmark datasets, e.g., CalTech-101, CalTech-256, and Stanford Dogs. The classification results obtained through the proposed AutoTune method outperforms the standard baseline transfer learning methods over the three datasets by achieving $95.92\%$, $86.54\%$, and $84.67\%$ accuracy over CalTech-101, CalTech-256, and Stanford Dogs, respectively. The experimental results obtained in this study depict that tuning of the pre-trained CNN layers with the knowledge from the target dataset confesses better transfer learning ability. The source codes are available at <a class="link-external link-https" href="https://github.com/JekyllAndHyde8999/AutoTune_CNN_TransferLearning" rel="external noopener nofollow">this https URL</a>.

Co-Tuning for Transfer Learning.

Bi-tuning: Efficient Transfer from Pre-trained Models

AutoTune: Automatically Tuning Convolutional Neural Networks for Improved Transfer Learning

CoTuning: A Large-Small Model Collaborating Distillation Framework for Better Model Generalization

Transferring Pretrained Networks to Small Data Via Category Decorrelation.

SpotTune: Transfer Learning Through Adaptive Fine-Tuning

Bi-tuning of Pre-trained Representations

Adaptive multi-source domain collaborative fine-tuning for transfer learning

Effective Domain Knowledge Transfer with Soft Fine-tuning

Boosting Fine-Tuning Via Conditional Online Knowledge Transfer

Combining Denoising Autoencoders with Contrastive Learning to fine-tune Transformer Models

Multi-task Convolutional Neural Network with Coarse-to-fine Knowledge Transfer for Long-Tailed Classification

A New Semi-Supervised Inductive Transfer Learning Framework:Co-Transfer

A new semi-supervised inductive transfer learning framework: Co-Transfer

Gated Transfer Network for Transfer Learning

Features are fate: a theory of transfer learning in high-dimensional regression

Multifaceted Analysis of Fine-Tuning in Deep Model for Visual Recognition

CoTuner: A Hierarchical Learning Framework for Coordinately Optimizing Resource Partitioning and Parameter Tuning.

Two-Stage Fine-Tuning: A Novel Strategy for Learning Class-Imbalanced Data

DR-Tune: Improving Fine-tuning of Pretrained Visual Models by Distribution Regularization with Semantic Calibration

Pay Attention to Convolution Filters: Towards Fast and Accurate Fine-Grained Transfer Learning