Abstract:Abstract Background and Objective Cryo-electron tomography (cryo-ET) is an imaging technique that enables 3D visualization of the native cellular environment at sub-nanometer resolution, providing unpreceded insights into the molecular organization of cells. However, cryo-electron tomograms suffer from low signal-to-noise ratios and anisotropic resolution, which makes subsequent image analysis challenging. In particular, the automated detection of membrane-embedded proteins is a problem still lacking satisfactory solutions. Methods We present MemBrain – a new deep learning-based pipeline that automatically detects membrane-bound protein complexes in cryo-electron tomograms. After subvolumes are sampled along a segmented membrane, each subvolume is assigned a score using a convolutional neural network (CNN), and protein positions are extracted by a clustering algorithm. Incorporating rotational subvolume normalization and using a tiny receptive field simplify the task of protein detection and thus facilitate the network training. Results MemBrain requires only a small quantity of training labels and achieves excellent performance with only a single annotated membrane (F1 score: 0.88). A detailed evaluation shows that our fully trained pipeline outperforms existing classical computer vision-based and CNN-based approaches by a large margin (F1 score: 0.92 vs. max. 0.63). Furthermore, in addition to protein center positions, MemBrain can determine protein orientations, which has not been implemented by any existing CNN-based method to date. We also show that a pre-trained MemBrain program generalizes to tomograms acquired using different cryo-ET methods and depicting different types of cells. Conclusions MemBrain is a powerful and label-efficient tool for the detection of membrane protein complexes in cryo-ET data, with the potential to be used in a wide range of biological studies. It is generalizable to various kinds of tomograms, making it possible to use pretrained models for different tasks. Its efficiency in terms of required annotations also allows rapid training and fine-tuning of models. The corresponding code, pretrained models, and instructions for operating the MemBrain program can be found at: https://github.com/CellArchLab/MemBrain

Macromolecule Particle Picking and Segmentation of a KLH Database by Unsupervised Cryo-EM Image Processing

AutoCryoPicker: an unsupervised learning approach for fully automated single particle picking in Cryo-EM images

Positive-unlabeled convolutional neural networks for particle picking in cryo-electron micrographs

Particle Segmentation Algorithm for Flexible Single Particle Reconstruction.

Subcellular structure segmentation from cryo-electron tomograms via machine learning

Deep-learning with synthetic data enables automated picking of cryo-EM particle images of biological macromolecules.

A Machine Learning Pipeline for Membrane Segmentation of Cryo-Electron Tomograms

ColabSeg: An interactive tool for editing, processing, and visualizing membrane segmentations from cryo-ET data

A deep convolutional neural network approach to single-particle recognition in cryo-electron microscopy

TransPicker: a Transformer-based Framework for Particle Picking in Cryoem Micrographs

An Unsupervised Iterative Model for Single-Particle Cryo-EM Image Denoising Based on Siamese Neural Network.

Active Learning to Classify Macromolecular Structures in situ for Less Supervision in Cryo-Electron Tomography

Cryo-EM images of phase separated lipid bilayer vesicles analyzed with a machine learning approach

Training-free CryoET Tomogram Segmentation

Accurate size-based protein localization from cryo-ET tomograms

DeepSLICEM: Clustering CryoEM particles using deep image and similarity graph representations

Improved deep learning based macromolecules structure classification from electron cryo tomograms

MemBrain: A Deep Learning-aided Pipeline for Automated Detection of Membrane Proteins in Cryo-electron Tomograms

A Particle-Filter Framework for Robust Cryoem 3D Reconstruction

MPicker: Visualizing and Picking Membrane Proteins for Cryo-Electron Tomography

Structure Detection in Three-Dimensional Cellular Cryoelectron Tomograms by Reconstructing Two-Dimensional Annotated Tilt Series