Abstract:Abstract Motivation Cryo-electron microscopy (cryo-EM) is a widely used technology for ultrastructure determination, which constructs the 3D structures of protein and macromolecular complex from a set of 2D micrographs. However, limited by the electron beam dose, the micrographs in cryo-EM generally suffer from the extremely low signal-to-noise ratio (SNR), which hampers the efficiency and effectiveness of downstream analysis. Especially, the noise in cryo-EM is not simple additive or multiplicative noise whose statistical characteristics are quite different from the ones in natural image, extremely shackling the performance of conventional denoising methods. Results Here, we introduce the Noise-Transfer2Clean (NT2C), a denoising deep neural network (DNN) for cryo-EM to enhance image contrast and restore specimen signal, whose main idea is to improve the denoising performance by correctly learning the noise distribution of cryo-EM images and transferring the statistical nature of noise into the denoiser. Especially, to cope with the complex noise model in cryo-EM, we design a contrast-guided noise and signal re-weighted algorithm to achieve clean-noisy data synthesis and data augmentation, making our method authentically achieve signal restoration based on noise’s true properties. Our work verifies the feasibility of denoising based on mining the complex cryo-EM noise patterns directly from the noise patches. Comprehensive experimental results on simulated datasets and real datasets show that NT2C achieved a notable improvement in image denoising, especially in background noise removal, compared with the commonly used methods. Moreover, a case study on the real dataset demonstrates that NT2C can greatly alleviate the obstacles caused by the SNR to particle picking and simplify the identifying of particles. Availabilityand implementation The code is available at https://github.com/Lihongjia-ict/NoiseTransfer2Clean/. Supplementary information Supplementary data are available at Bioinformatics online.

Denoising of Transmission Electron Microscopy Images for Atomic Defect Identification

Single-Image-Based Deep Learning for Precise Atomic Defect Identification

Developing and Evaluating Deep Neural Network-Based Denoising for Nanoparticle TEM Images with Ultra-Low Signal-to-Noise

Single-image based deep learning for precise atomic defects identification

A small-dataset-trained deep learning framework for identifying atoms on transmission electron microscopy images

MDD-Net: A novel defect detection model of material microscope image

Leveraging generative adversarial networks to create realistic scanning transmission electron microscopy images

AtomGAN: unsupervised deep learning for fast and accurate defect detection of 2D materials at the atomic scale

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase Contrast Transmission Electron Microscopy Images

A Deep Learning Based Automatic Defect Analysis Framework for In-situ TEM Ion Irradiations

Accurate atomic scanning transmission electron microscopy analysis enabled by deep learning

Unsupervised deep denoising for four-dimensional scanning transmission electron microscopy

Nanoscale defect evaluation framework combining real-time transmission electron microscopy and integrated machine learning-particle filter estimation

Enhancing scanning electron microscopy imaging quality of weakly conductive samples through unsupervised learning

TEMImageNet Training Library and AtomSegNet Deep-Learning Models for High-Precision Atom Segmentation, Localization, Denoising, and Super-Resolution Processing of Atomic-Resolution Images

TEMImageNet training library and AtomSegNet deep-learning models for high-precision atom segmentation, localization, denoising, and deblurring of atomic-resolution images

Noise-Transfer2Clean: denoising cryo-EM images based on noise modeling and transfer

Deep Learning of Crystalline Defects from TEM images: A Solution for the Problem of "Never Enough Training Data"

Deep Learning‐Assisted Quantification of Atomic Dopants and Defects in 2D Materials

Deep convolutional neural networks to restore single-shot electron microscopy images

Learning-based Defect Recognition for Quasi-Periodic Microscope Images