Abstract:Efficient, reproducible and accountable single-particle cryo-electron microscopy structure determination is tedious and often impeded by the lack of a standardized procedure for data analysis and processing. To address this issue, we have developed the FMI Live Analysis and Reconstruction Engine (CryoFLARE). CryoFLARE is a modular open-source platform offering easy integration of new processing algorithms developed by the cryo-EM community. It provides a user-friendly interface that allows fast setup of standardized workflows, serving the need of pharmaceutical industry and academia alike who need to optimize throughput of their microscope. To consistently document how data is processed, CryoFLARE contains an integrated reporting facility to create reports. Live analysis and processing parallel to data acquisition are used to monitor and optimize data quality. Problems at the level of the sample preparation (heterogeneity, ice thickness, sparse particles, areas selected for acquisition, etc.) or misalignments of the microscope optics can quickly be detected and rectified before data collection is continued. Interfacing with automated data collection software for retrieval of acquisition metadata reduces user input needed for analysis, and with it minimizes potential sources of errors and workflow inconsistencies. Local and remote export support in Relion-compatible job and data format allows seamless integration into the refinement process. The support for nonlinear workflows and fine-grained scheduling for mixed workflows with separate CPU and GPU based calculation steps ensures optimal use of processing hardware. CryoFLARE's flexibility allows it to be used for all types of image acquisitions, ranging from sample screening to high-resolution data collection, and it offers a new alternative for setting up image processing workflows. It can be used without modifications of the hardware/software delivered by the microscope supplier. As it runs on a server in parallel to the hardware used for acquisition, it can easily be set up for remote display connections and fast control of the acquisition status.

A Processing and Analytics System for Microscopy Data Workflows: The Pycroscopy Ecosystem of Packages

AEcroscoPy: A software-hardware framework empowering microscopy toward automated and autonomous experimentation

USID and Pycroscopy -- Open frameworks for storing and analyzing spectroscopic and imaging data

AEcroscopy: A Software–Hardware Framework Empowering Microscopy Toward Automated and Autonomous Experimentation

Nipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in Python

Pytometry: Flow and Mass Cytometry Analytics in Python

An integrated platform for high-throughput nanoscopy

Machine Learning for Microscopy Data Analysis: Toward Real-time Optical and Electrical Characterization of Sub-micron Materials

Big data in contemporary electron microscopy: challenges and opportunities in data transfer, compute and management

Live Analysis and Reconstruction of Single-Particle Cryo-Electron Microscopy Data with CryoFLARE

An open-source software package for on-the-fly deskewing and live viewing of volumetric lightsheet microscopy data

Image processing tools for petabyte-scale light sheet microscopy data

Squidpy: a scalable framework for spatial omics analysis

Implementing dynamic high-performance computing supported workflows on Scanning Transmission Electron Microscope

ObiWan-Microbi: OMERO-based integrated workflow for annotating microbes in the cloud

Realizing smart scanning transmission electron microscopy using high performance computing

TOMOMAN: a software package for large scale cryo-electron tomography data preprocessing, community data sharing, and collaborative computing

A Complete Data Processing Workflow for Cryo-Et and Subtomogram Averaging

Streaming Large-Scale Electron Microscopy Data to a Supercomputing Facility

High-Content Digital Microscopy with Python