Abstract:Cryo-electron tomography (cryo-ET) provides 3D visualization of subcellular components in the near-native state and at sub-molecular resolutions in single cells, demonstrating an increasingly important role in structural biology in situ. However, systematic recognition and recovery of macromolecular structures in cryo-ET data remain challenging as a result of low signal-to-noise ratio (SNR), small sizes of macromolecules, and high complexity of the cellular environment. Subtomogram structural classification is an essential step for such task. Although acquisition of large amounts of subtomograms is no longer an obstacle due to advances in automation of data collection, obtaining the same number of structural labels is both computation and labor intensive. On the other hand, existing deep learning based supervised classification approaches are highly demanding on labeled data and have limited ability to learn about new structures rapidly from data containing very few labels of such new structures. In this work, we propose a novel approach for subtomogram classification based on few-shot learning. With our approach, classification of unseen structures in the training data can be conducted given few labeled samples in test data through instance embedding. Experiments were performed on both simulated and real datasets. Our experimental results show that we can make inference on new structures given only five labeled samples for each class with a competitive accuracy (> 0.86 on the simulated dataset with SNR = 0.1), or even one sample with an accuracy of 0.7644. The results on real datasets are also promising with accuracy > 0.9 on both conditions and even up to 1 on one of the real datasets. Our approach achieves significant improvement compared with the baseline method and has strong capabilities of generalizing to other cellular components.

Knowledge Transfer from Macro-world to Micro-world: Enhancing 3D Cryo-ET Classification through Fine-Tuning Video-based Deep Models

Deep Active Learning for Cryo-Electron Tomography Classification.

Rapid Synthesis of Cryo-ET Data for Training Deep Learning Models

Three-Dimensional Virtual Optical Clearing with Cycle-Consistent Generative Adversarial Network

Few Shot Domain Adaptation for in Situ Macromolecule Structural Classification in Cryoelectron Tomograms.

Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography

Algorithm-driven Advances for Scientific CT Instruments: From Model-based to Deep Learning-based Approaches

AITom: Open-source AI platform for cryo-electron tomography data analysis

Few-shot Learning for Classification of Novel Macromolecular Structures in Cryo-Electron Tomograms.

CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations

Training-free CryoET Tomogram Segmentation

A survey of deep learning-based methods for cryo-electron tomography data analysis

Annotating CryoET Volumes: A Machine Learning Challenge

DeepOrientation: Deep Orientation Estimation of Macromolecules in Cryo-electron tomography

Simulating the cellular context in synthetic datasets for cryo-electron tomography

Cryo-shift: reducing domain shift in cryo-electron subtomograms with unsupervised domain adaptation and randomization

Video Pretraining Advances 3D Deep Learning on Chest CT Tasks

Improved deep learning based macromolecules structure classification from electron cryo tomograms

Multi-task Learning for Macromolecule Classification, Segmentation and Coarse Structural Recovery in Cryo-Tomography

Finding Nano-Ötzi: Cryo-Electron Tomography Visualization Guided by Learned Segmentation

Deep Learning-Based Strategy for Macromolecules Classification with Imbalanced Data from Cellular Electron Cryotomography