Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning

Jay Shenoy,Axel Levy,Frédéric Poitevin,Gordon Wetzstein

2023-12-22

Abstract:X-ray free-electron lasers (XFELs) offer unique capabilities for measuring the structure and dynamics of biomolecules, helping us understand the basic building blocks of life. Notably, high-repetition-rate XFELs enable single particle imaging (X-ray SPI) where individual, weakly scattering biomolecules are imaged under near-physiological conditions with the opportunity to access fleeting states that cannot be captured in cryogenic or crystallized conditions. Existing X-ray SPI reconstruction algorithms, which estimate the unknown orientation of a particle in each captured image as well as its shared 3D structure, are inadequate in handling the massive datasets generated by these emerging XFELs. Here, we introduce X-RAI, an online reconstruction framework that estimates the structure of a 3D macromolecule from large X-ray SPI datasets. X-RAI consists of a convolutional encoder, which amortizes pose estimation over large datasets, as well as a physics-based decoder, which employs an implicit neural representation to enable high-quality 3D reconstruction in an end-to-end, self-supervised manner. We demonstrate that X-RAI achieves state-of-the-art performance for small-scale datasets in simulation and challenging experimental settings and demonstrate its unprecedented ability to process large datasets containing millions of diffraction images in an online fashion. These abilities signify a paradigm shift in X-ray SPI towards real-time capture and reconstruction.

Computer Vision and Pattern Recognition,Machine Learning,Biomolecules

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to efficiently reconstruct the three - dimensional biomolecular structure from a large number of diffraction image datasets in single - particle X - ray diffraction imaging (X - ray SPI). Specifically, the existing X - ray SPI reconstruction algorithms perform poorly when dealing with large datasets generated by high - repetition - rate X - ray free - electron lasers (XFELs), because these algorithms need to conduct an exhaustive search for the unknown particle directions in each diffraction image, and this process is not suitable for large - scale datasets.

The paper introduces a new online reconstruction framework named X - RAI, which aims to estimate the structure of 3D macromolecules through a convolutional encoder and a physics - based decoder. Among them, the convolutional encoder can amortize the pose estimation in large - scale datasets, while the physics - based decoder uses implicit neural representations to achieve high - quality 3D reconstruction, and the whole process is carried out in an end - to - end self - supervised manner. X - RAI can achieve real - time capture and reconstruction, and is especially suitable for processing datasets containing millions of diffraction images, which marks the transformation of X - ray SPI technology towards the real - time capture and reconstruction paradigm.