Abstract:Cryo-electron tomography (Cryo-ET) is an emerging technology for three-dimensional (3D) visualization of macromolecular structures in the near-native state. To recover structures of macromolecules, millions of diverse macromolecules captured in tomograms should be accurately classified into structurally homogeneous subsets. Although existing supervised deep learning–based methods have improved classification accuracy, such trained models have limited ability to classify novel macromolecules that are unseen in the training stage. To adapt the trained model to the macromolecule classification of a novel class, massive labeled macromolecules of the novel class are needed. However, data labeling is very time-consuming and labor-intensive. In this work, we propose a novel few-shot learning method for the classification of novel macromolecules (named FSCC). A two-stage training strategy is designed in FSCC to enhance the generalization ability of the model to novel macromolecules. First, FSCC uses contrastive learning to pre-train the model on a sufficient number of labeled macromolecules. Second, FSCC uses distribution calibration to re-train the classifier, enabling the model to classify macromolecules of novel classes (unseen class in the pre-training). Distribution calibration transfers learned knowledge in the pre-training stage to novel macromolecules with limited labeled macromolecules of novel class. Experiments were performed on both synthetic and real datasets. On the synthetic datasets, compared with the state-of-the-art (SOTA) method based on supervised deep learning, FSCC achieves competitive performance. To achieve such performance, FSCC only needs five labeled macromolecules per novel class. However, the SOTA method needs 1100 ∼ 1500 labeled macromolecules per novel class. On the real datasets, FSCC improves the accuracy by 5% ∼ 16% when compared to the baseline model. These demonstrate good generalization ability of contrastive learning and calibration distribution to classify novel macromolecules with very few labeled macromolecules.

Deep Learning-Based Strategy for Macromolecules Classification with Imbalanced Data from Cellular Electron Cryotomography

Improved deep learning based macromolecules structure classification from electron cryo tomograms

Deep Learning-Based Subdivision Approach for Large Scale Macromolecules Structure Recovery from Electron Cryo Tomograms

Domain Randomization for Macromolecule Structure Classification and Segmentation in Electron Cyro-tomograms.

Multi-task Learning for Macromolecule Classification, Segmentation and Coarse Structural Recovery in Cryo-Tomography

Deep learning based supervised semantic segmentation of Electron Cryo-Subtomograms

Few-shot Learning for Classification of Novel Macromolecular Structures in Cryo-Electron Tomograms.

Macromolecules Structural Classification with a 3D Dilated Dense Network in Cryo-Electron Tomography

Deep Active Learning for Cryo-Electron Tomography Classification.

DeepLearnMOR: a Deep-Learning Framework for Fluorescence Image-Based Classification of Organelle Morphology.

One-Shot Learning With Attention-Guided Segmentation in Cryo-Electron Tomography

Few Shot Domain Adaptation for in Situ Macromolecule Structural Classification in Cryoelectron Tomograms.

Dilated-DenseNet For Macromolecule Classification In Cryo-electron Tomography.

Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography

FSCC: Few-Shot Learning for Macromolecule Classification Based on Contrastive Learning and Distribution Calibration in Cryo-Electron Tomography.

Deep learning strategy for small dataset from atomic force microscopy mechano-imaging on macrophages phenotypes

A survey of deep learning-based methods for cryo-electron tomography data analysis

DeepOrientation: Deep Orientation Estimation of Macromolecules in Cryo-electron tomography

Cryo-shift: reducing domain shift in cryo-electron subtomograms with unsupervised domain adaptation and randomization

Cell abundance aware deep learning for cell detection on highly imbalanced pathological data

Efficient Cell Classification of Mitochondrial Images by Using Deep Learning