Abstract:The application of deep learning techniques for the analysis of neuroimaging has been increasing recently. The 3D Convolutional Neural Network (CNN) technology, which is commonly adopted to encode volumetric information, requires a large number of datasets. However, due to the nature of the medical domain, there are limitations in the number of data available. This is because the cost of acquiring imaging is expensive and the use of personnel to annotate diagnostic labels is resource-intensive. For these reasons, several prior studies have opted to use comparatively lighter 2D CNNs instead of the complex 3D CNN technology. They analyze using projected 2D datasets created from representative slices extracted from 3D volumetric imaging. However, this approach, by selecting only projected 2D slices from the entire volume, reflects only partial volumetric information. This poses a risk of developing lesion diagnosis systems without a deep understanding of the interrelations among volumetric data. We propose a novel 3D-to-2D knowledge distillation framework that utilizes not only the projected 2D dataset but also the original 3D volumetric imaging dataset. This framework is designed to employ volumetric prior knowledge in training 2D CNNs. Our proposed method includes three modules: (i) a 3D teacher network that encodes volumetric prior knowledge from the 3D dataset, (ii) a 2D student network that encodes partial volumetric information from the 2D dataset, and aims to develop an understanding of the original volumetric imaging, and (iii) a distillation loss introduced to reduce the gap in the graph representation expressing the relationship between data in the feature embedding spaces of (i) and (ii), thereby enhancing the final performance. The effectiveness of our proposed method is demonstrated by improving the classification performance orthogonally across various 2D projection methods on two datasets from the 123I-DaTscan SPECT and 18 F-AV133 PET from Parkinson's Progression Markers Initiative (PPMI). Notably, when our approach is applied to the FuseMe approach, it achieves an F1 score of 98.30%, which is higher than that of the 3D teacher network (97.66%).

A Deep Transfer Learning Framework for 3D Brain Imaging Based on Optimal Mass Transport

Deep Transfer Learning of Brain Shape Morphometry Predicts Body Mass Index (BMI) in the UK Biobank

Fast and Lightweight Network Improves Serial Brain Section Stitching

Deep Transfer Learning for Cerebral Cortex Using Area-Preserving Geometry Mapping.

Medical Transformer: Universal Brain Encoder for 3D MRI Analysis

A Novel Transfer Learning Approach to Enhance Deep Neural Network Classification of Brain Functional Connectomes

Deep Transfer Learning for Brain Magnetic Resonance Image Multi-class Classification

Multi-Center Brain Imaging Classification Using a Novel 3D CNN Approach.

From Neonatal To Adult Brain Mr Image Segmentation In A Few Seconds Using 3d-Like Fully Convolutional Network And Transfer Learning

Deep Learning and Transfer Learning for Brain Tumor Detection and Classification

Adopting transfer learning for neuroimaging: a comparative analysis with a custom 3D convolution neural network model

Large-Scale Functional Connectome Fingerprinting for Generalization and Transfer Learning in Neuroimaging

DeepVolume: Brain Structure and Spatial Connection-Aware Network for Brain MRI Super-Resolution

Optimising brain age estimation through transfer learning: A suite of pre‐trained foundation models for improved performance and generalisability in a clinical setting

Going deeper with brain morphometry using neural networks

Improving Effectiveness of Different Deep Transfer Learning-Based Models for Detecting Brain Tumors From MR Images

Automated detection of critical findings in multi-parametric brain MRI using a system of 3D neural networks

An enhanced deep learning method for multi-class brain tumor classification using deep transfer learning

Enhancement and evaluation for deep learning-based classification of volumetric neuroimaging with 3D-to-2D knowledge distillation

Anatomical Foundation Models for Brain MRIs

A Federated Deep Learning Framework for 3D Brain MRI Images.