Abstract:Cryo-electron microscopy (cryo-EM) imaging has the unique potential to bridge the gap between cellular and molecular biology. Therefore, cryo-EM three-dimensional (3D) reconstruction has been rapidly developed in recent several years and applied widely in life science research to reveal the structures of large macromolecular assemblies and cellular complexes, which is critical to understanding their functions at all scales. Although the technical breakthrough in recent years, for example, the introduction of the direct detection device (DDD) camera and the development of cryo-EM software tools, made the three cryo-EM pioneers share the 2017 Nobel Prize, several bottleneck problems still exist that hamper the further increase of the resolution of single-particle reconstruction and hold back the application of in situ subnanometer structure determination by cryo-tomography. Radiation damage is still the key limiting factor in cryo-EM. In order to minimize the radiation damage and preserve as much resolution as possible, the imaging conditions of a low dose and weak contrast make cryo-EM images extremely noisy with very low signal-to-noise ratios (SNR), generally about 0.1. The high noise will obscure the fine details in cryo-EM images or reconstructed maps. Thus, a method to reduce the level of noise and improve the resolution has become an important issue. In this paper, we systematically reviewed and compared some robust filters in the cryo-EM field of two aspects, single-particle analysis (SPA) and cryo-electron tomography (cryo-ET), and especially studied their applications, such as, 3D reconstruction, visualization, structural analysis, and interpretation. Conventional approaches to noise reduction in cryo-EM imaging include the use of Gaussian, median, and bilateral filters, among other means. A Gaussian filter selects an appropriate filter kernel to conduct spatial convolution with a noisy image. Although noise with larger standard deviations in cryo-EM images can be suppressed and satisfactory performance is achieved in certain cases, this filter also blurs the images and over-smooths small-scale image features. This is especially detrimental when precise quantitative information needs to be extracted. Unlike a Gaussian filter, a median filter is based on the order statistics of the image and selects the median intensity in a window of the adjacent pixels to denoise the image. Although this filter is robust to outliers, it suffers from aliasing problems that possibly result in incorrect information for cryo-EM structure interpretation. A bilateral filter is a nonlinear filter that performs spatial weighted averaging and is more selective in the pixels allowing to contribute to the weighted sum, excluding the high frequency noise from the smoothing process. Thus, this filter can be used to smooth out noise while maintaining the edge details, which is similar to an anisotropic diffusion filter, and distinct from a Gaussian filter but its utility will be limited when the SNR of a cryo-EM image is very low. Generally, spatial filtering methods have the disadvantage of losing image resolution when reducing noise. A wavelet transform can exploit the wavelet's natural ability to separate a signal from noise at multiple image scales to allow for joint resolution in both the spatial and frequency domains, and thus has the potential to outperform existing methods. The modified wavelet shrinkage filter we developed can offer a remarkable improvement in image quality with a good compromise between detail preservation and noise smoothing. We expect that our review study on different filters can provide benefits to cryo-EM applications and the interpretation of biological structures.

Noise Reduction Algorithm on the Extremely Low Signal-noise Ratio CryoEM Images Based on Deep Learning Methods-DWT-CAE

Noise-Transfer2Clean: denoising cryo-EM images based on noise modeling and transfer

CDAE: A Cascade of Denoising Autoencoders for Noise Reduction in the Clustering of Single-Particle Cryo-EM Images

An optimized locally adaptive non-local means denoising filter for cryo-electron microscopy data.

[Progress in filters for denoising cryo-electron microscopy images]

An Unsupervised Iterative Model for Single-Particle Cryo-EM Image Denoising Based on Siamese Neural Network.

A deep convolutional neural network approach to single-particle recognition in cryo-electron microscopy

Enhancing the signal-to-noise ratio and generating contrast for cryo-EM images with convolutional neural networks

Robust single-particle cryo-EM image denoising and restoration

A Zernike-moment-based non-local denoising filter for cryo-EM images

CryoMAE: Few-Shot Cryo-EM Particle Picking with Masked Autoencoders

DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EM

Refinement of cryo-EM 3D maps with a self-supervised denoising model: crefDenoiser

A survey of deep learning-based methods for cryo-electron tomography data analysis

Multiple-image super-resolution of cryo-electron micrographs based on deep internal learning

Cryo-Electron Microscopy Image Analysis Using Multi-Frequency Vector Diffusion Maps

Deep-learning with synthetic data enables automated picking of cryo-EM particle images of biological macromolecules.

Denoising, Deblurring, and optical Deconvolution for cryo-ET and light microscopy with a physics-informed deep neural network DeBCR

Attention-guided Quality Assessment for Automated Cryo-EM Grid Screening

Cryo-electron microscope image denoising based on the geodesic distance