Abstract:The pycroscopy ecosystem of packages enables ingestion, machine learning and statistical analysis, processing, and visualization of a large variety of microscopy data from many different vendors in a reproducible and accessible fashion. This ecosystem enables rapid generation of analytical workflows that can form the basis of autonomous laboratories leveraging experiments with computation and simulations for physical discovery. Major advancements in fields as diverse as biology and quantum computing have relied on a multitude of microscopy techniques. Despite the considerable proliferation of these instruments, significant bottlenecks remain in terms of processing, analysis, storage, and retrieval of the acquired datasets. Aside from lack of file standards, individual domain‐specific analysis packages are often disjoint from the underlying datasets, and thus keeping track of analysis and processing steps remains tedious for the end‐user, hampering reproducibility. Here, the pycroscopy ecosystem of packages is introduced, an open‐source python‐based ecosystem underpinned by a common data model. The data model, termed the N‐dimensional spectral imaging data format, is realized in pycroscopy's sidpy package. This package is built on top of dask arrays, thus leveraging dask array attributes, but expanding them to accelerate microscopy relevant analysis and visualization. Several examples of the use of the pycroscopy ecosystem to create workflows for data ingestion and analysis of scanning transmission electron microscopy (STEM) and scanning probe microscopy data are shown. Adoption of such standardized routines will be critical to usher in the next generation of autonomous instruments where processing, computation, and meta‐data storage will be critical to overall experimental operations.

High-Content Digital Microscopy with Python

An integrated platform for high-throughput nanoscopy

Towards high-throughput 3D insect capture for species discovery and diagnostics

Open source tools for management and archiving of digital microscopy data to allow integration with patient pathology and treatment information

Digital microscopy for boosting database integration and analysis in TMA studies

A Microscope Setup and Methodology for Capturing Hyperspectral and RGB Histopathological Imaging Databases

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Snapshot Hyperspectral Volumetric Microscopy

High-throughput profiling of tissue and tissue model microarrays: Combined transmitted light and 3-color fluorescence digital pathology

A Processing and Analytics System for Microscopy Data Workflows: The Pycroscopy Ecosystem of Packages

Focus Quality Assessment of High-Throughput Whole Slide Imaging in Digital Pathology

Depth-enhanced high-throughput microscopy by compact PSF engineering

High-Performance Image Analysis and Visualization for Three-dimensional Light Microscopy

High‐Throughput, Label‐Free and Slide‐Free Histological Imaging by Computational Microscopy and Unsupervised Learning

An automated system for whole microscopic image acquisition and analysis

MicroAnalyzer: A Python Tool for Automated Bacterial Analysis with Fluorescence Microscopy

Slim: interoperable slide microscopy viewer and annotation tool for imaging data science and computational pathology

Rethinking Histology Slide Digitization Workflows for Low-Resource Settings

Introduction to Digital Image Analysis in Whole-slide Imaging: A White Paper from the Digital Pathology Association

AEcroscoPy: A software-hardware framework empowering microscopy toward automated and autonomous experimentation

A Color Image Processing Pipeline for Digital Microscope