Abstract:Cryo-electron tomography (cryo-ET) provides 3D visualization of subcellular components in the near-native state and at sub-molecular resolutions in single cells, demonstrating an increasingly important role in structural biology in situ. However, systematic recognition and recovery of macromolecular structures in cryo-ET data remain challenging as a result of low signal-to-noise ratio (SNR), small sizes of macromolecules, and high complexity of the cellular environment. Subtomogram structural classification is an essential step for such task. Although acquisition of large amounts of subtomograms is no longer an obstacle due to advances in automation of data collection, obtaining the same number of structural labels is both computation and labor intensive. On the other hand, existing deep learning based supervised classification approaches are highly demanding on labeled data and have limited ability to learn about new structures rapidly from data containing very few labels of such new structures. In this work, we propose a novel approach for subtomogram classification based on few-shot learning. With our approach, classification of unseen structures in the training data can be conducted given few labeled samples in test data through instance embedding. Experiments were performed on both simulated and real datasets. Our experimental results show that we can make inference on new structures given only five labeled samples for each class with a competitive accuracy (> 0.86 on the simulated dataset with SNR = 0.1), or even one sample with an accuracy of 0.7644. The results on real datasets are also promising with accuracy > 0.9 on both conditions and even up to 1 on one of the real datasets. Our approach achieves significant improvement compared with the baseline method and has strong capabilities of generalizing to other cellular components.

One-Shot Learning With Attention-Guided Segmentation in Cryo-Electron Tomography

Few-shot Learning for Classification of Novel Macromolecular Structures in Cryo-Electron Tomograms.

Training-free CryoET Tomogram Segmentation

Deep learning based supervised semantic segmentation of Electron Cryo-Subtomograms

Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography

Multi-task Learning for Macromolecule Classification, Segmentation and Coarse Structural Recovery in Cryo-Tomography

Deep Active Learning for Cryo-Electron Tomography Classification.

Rapid Synthesis of Cryo-ET Data for Training Deep Learning Models

Subcellular structure segmentation from cryo-electron tomograms via machine learning

A survey of deep learning-based methods for cryo-electron tomography data analysis

Deep-learning with synthetic data enables automated picking of cryo-EM particle images of biological macromolecules.

Fast Particle Picking For Cryo-Electron Tomography Using One-Stage Detection

Deep Learning-Based Subdivision Approach for Large Scale Macromolecules Structure Recovery from Electron Cryo Tomograms

Central Feature Network Enables Accurate Detection of Both Small and Large Particles in Cryo-Electron Tomography

Few Shot Domain Adaptation for in Situ Macromolecule Structural Classification in Cryoelectron Tomograms.

Structure Detection in Three-Dimensional Cellular Cryoelectron Tomograms by Reconstructing Two-Dimensional Annotated Tilt Series

Domain Randomization for Macromolecule Structure Classification and Segmentation in Electron Cyro-tomograms.

Deep Learning-Based Strategy for Macromolecules Classification with Imbalanced Data from Cellular Electron Cryotomography

Finding Nano-Ötzi: Cryo-Electron Tomography Visualization Guided by Learned Segmentation

Dilated-DenseNet For Macromolecule Classification In Cryo-electron Tomography.

Improved deep learning based macromolecules structure classification from electron cryo tomograms