Abstract:In the context of medical imaging and machine learning, one of the most pressing challenges is the effective adaptation of pre-trained models to specialized medical contexts. Despite the availability of advanced pre-trained models, their direct application to the highly specialized and diverse field of medical imaging often falls short due to the unique characteristics of medical data. This study provides a comprehensive analysis on the performance of various fine-tuning methods applied to pre-trained models across a spectrum of medical imaging domains, including X-ray, MRI, Histology, Dermoscopy, and Endoscopic surgery. We evaluated eight fine-tuning strategies, including standard techniques such as fine-tuning all layers or fine-tuning only the classifier layers, alongside methods such as gradually unfreezing layers, regularization based fine-tuning and adaptive learning rates. We selected three well-established CNN architectures (ResNet-50, DenseNet-121, and VGG-19) to cover a range of learning and feature extraction scenarios. Although our results indicate that the efficacy of these fine-tuning methods significantly varies depending on both the architecture and the medical imaging type, strategies such as combining Linear Probing with Full Fine-tuning resulted in notable improvements in over 50% of the evaluated cases, demonstrating general effectiveness across medical domains. Moreover, Auto-RGN, which dynamically adjusts learning rates, led to performance enhancements of up to 11% for specific modalities. Additionally, the DenseNet architecture showed more pronounced benefits from alternative fine-tuning approaches compared to traditional full fine-tuning. This work not only provides valuable insights for optimizing pre-trained models in medical image analysis but also suggests the potential for future research into more advanced architectures and fine-tuning methods.

A Study on Training Fine-Tuning of Convolutional Neural Networks.

Fine-Tuning And Visualization Of Convolutional Neural Networks

Multifaceted Analysis of Fine-Tuning in Deep Model for Visual Recognition

Research on the Fine-tuning Technology Based on Faster R-CNN.

CNNComparator: Comparative Analytics of Convolutional Neural Networks.

The Investigation of Multiple Optimization Methods on Convolutional Neural Network

Contrastive-Adversarial and Diffusion: Exploring pre-training and fine-tuning strategies for sulcal identification

A Systematic Evaluation: Fine-Grained CNN vs. Traditional CNN Classifiers

How Deeply to Fine-Tune a Convolutional Neural Network: A Case Study Using a Histopathology Dataset

Effective Domain Knowledge Transfer with Soft Fine-tuning

Review of Convolutional Neural Network Optimization and Training in Image Processing

Evolving Convolutional Neural Network And Its Application In Fine-Grained Visual Categorization

Improving classification accuracy of fine-tuned CNN models: Impact of hyperparameter optimization

AutoFCL: Automatically Tuning Fully Connected Layers for Handling Small Dataset

Refining Architectures of Deep Convolutional Neural Networks

Alleviating Representational Shift for Continual Fine-tuning.

Optimization of CNN through Novel Training Strategy for Visual Classification Problems

Improved Fine-tuning by Leveraging Pre-training Data: Theory and Practice

Growing a Brain: Fine-Tuning by Increasing Model Capacity

Comparison of fine-tuning strategies for transfer learning in medical image classification