Abstract:Purpose: To perform an in-depth evaluation of current state of the art techniques in training neural networks to identify appropriate approaches in small datasets. Method: In total, 112,120 frontal-view X-ray images from the NIH ChestXray14 dataset were used in our analysis. Two tasks were studied: unbalanced multi-label classification of 14 diseases, and binary classification of pneumonia vs non-pneumonia. All datasets were randomly split into training, validation, and testing (70%, 10%, and 20%). Two popular convolution neural networks (CNNs), DensNet121 and ResNet50, were trained using PyTorch. We performed several experiments to test: (a) whether transfer learning using pretrained networks on ImageNet are of value to medical imaging/physics tasks (e.g., predicting toxicity from radiographic images after training on images from the internet), (b) whether using pretrained networks trained on problems that are similar to the target task helps transfer learning (e.g., using X-ray pretrained networks for X-ray target tasks), (c) whether freeze deep layers or change all weights provides an optimal transfer learning strategy, (d) the best strategy for the learning rate policy, and (e) what quantity of data is needed in order to appropriately deploy these various strategies (N = 50 to N = 77 880). Results: In the multi-label problem, DensNet121 needed at least 1600 patients to be comparable to, and 10 000 to outperform, radiomics-based logistic regression. In classifying pneumonia vs non-pneumonia, both CNN and radiomics-based methods performed poorly when N < 2000. For small datasets ( < 2000), however, a significant boost in performance (>15% increase on AUC) comes from a good selection of the transfer learning dataset, dropout, cycling learning rate, and freezing and unfreezing of deep layers as training progresses. In contrast, if sufficient data are available (>35 000), little or no tweaking is needed to obtain impressive performance. While transfer learning using X-ray images from other anatomical sites improves performance, we also observed a similar boost by using pretrained networks from ImageNet. Having source images from the same anatomical site, however, outperforms every other methodology, by up to 15%. In this case, DL models can be trained with as little as N = 50. Conclusions: While training DL models in small datasets (N < 2000) is challenging, no tweaking is necessary for bigger datasets (N > 35 000). Using transfer learning with images from the same anatomical site can yield remarkable performance in new tasks with as few as N = 50. Surprisingly, we did not find any advantage for using images from other anatomical sites over networks that have been trained using ImageNet. This indicates that features learned may not be as general as currently believed, and performance decays rapidly even by just changing the anatomical site of the images.

Enhancing radioisotope identification in gamma spectra with transfer learning

Transfer Learning in Automated Gamma Spectral Identification

Transfer learning for radio galaxy classification

Identification of High Energy Gamma Particles From the Cherenkov Gamma Telescope Data Using a Deep Learning Approach

A novel approach for feature extraction from a gamma-ray energy spectrum based on image descriptor transferring for radionuclide identification

Transfer learning based on atomic feature extraction for the prediction of experimental ¹³C chemical shifts

Advancing Gamma-Ray Burst Identification through Transfer Learning with Convolutional Neural Networks

Classification of radioxenon spectra with deep learning algorithm

Unsupervised Learning for Improved Gamma-Ray Spectrometry in Pixelated Cadmium Zinc Telluride (CZT) Detectors

Convolutional Neural Networks for Challenges in Automated Nuclide Identification

Identification of Distorted Gamma-Ray Signature Patterns Using Digital Filtering and Auto-Associative Memory Implemented with a Hopfield Neural Network

The Development of a Feature-Driven Analytical Approach for Gamma-Ray Spectral Analysis

Generalised gamma spectrometry simulator for problems in nuclide identification

Radioisotope Identification with Scintillation Detector Based on Artificial Neural Networks Using Simulated Training Data

Explaining machine-learning models for gamma-ray detection and identification

Deep learning techniques for Imaging Air Cherenkov Telescopes

SpectraFM: Tuning into Stellar Foundation Models

Improving Radioactive Material Localization by Leveraging Cyber-Security Model Optimizations

Improving uranium oxide pathway discernment and generalizability using contrastive self-supervised learning

Convolutional Neural Networks and Raman Spectroscopy for Semi-Supervised Dataset Construction and Transfer Learning Applications in Real-Time Quantitative Detection

Targeted transfer learning to improve performance in small medical physics datasets