Abstract:Significance: Advanced digital control of microscopes and programmable data acquisition workflows have become increasingly important for improving the throughput and reproducibility of optical imaging experiments. Combinations of imaging modalities have enabled a more comprehensive understanding of tissue biology and tumor microenvironments in histopathological studies. However, insufficient imaging throughput and complicated workflows still limit the scalability of multimodal histopathology imaging. Aim: We present a hardware-software co-design of a whole slide scanning system for high-throughput multimodal tissue imaging, including brightfield (BF) and laser scanning microscopy. Approach: The system can automatically detect regions of interest using deep neural networks in a low-magnification rapid BF scan of the tissue slide and then conduct high-resolution BF scanning and laser scanning imaging on targeted regions with deep learning-based run-time denoising and resolution enhancement. The acquisition workflow is built using Pycro-Manager, a Python package that bridges hardware control libraries of the Java-based open-source microscopy software Micro-Manager in a Python environment. Results: The system can achieve optimized imaging settings for both modalities with minimized human intervention and speed up the laser scanning by an order of magnitude with run-time image processing. Conclusions: The system integrates the acquisition pipeline and data analysis pipeline into a single workflow that improves the throughput and reproducibility of multimodal histopathological imaging.

A Novel Multimodal Laser Scanning Microscope Control System

Design of A Real-Time Portable Confocal Scanning Laser Microscope

Soft Control of Scanning Probe Microscope with High Flexibility.

A New Multichannel Spectral Imaging Laser Scanning Confocal Microscope

Scanning Probe Microscope Controlled by Single Personal Computer with Linux

Design and Control of a Novel 3-D Piezoelectric Scanning Coaxial Optical Microscope System

A Novel Mechatronic Design of a 3D Laser Scanning System

Study on electronic control system for laser scanning confocal fluorescence microscope

Portable Multi-Spectral Lens-Less Microscope with Wavelength-Self-calibrating Imaging Sensor

Control of a CNC laser engraver machine for non-metallic materials

Wide-angle high-precision electronically controlled continuous beam scanning implementation based on MLAS cascaded AFOC

Hardware-software co-design of an open-source automatic multimodal whole slide histopathology imaging system

3d Imaging System Of Two-Photon Excitation Laser Scanning Microscopy

Development of a Novel Multi-Line Laser Triangulation Scanning System Based on the Rotary Diffraction Grating

Software controlling algorithms for the system performance optimization of confocal laser scanning microscope.

The realization of the motion control in the laser micro-processing system

Multimodal nonlinear microscope based on a compact fiber-format laser source

Electronic Control System For Laser Tweezers & Scissors Workstation

A New Multiple Robot Laser 3D Scanning System

Novel Control Platform Development for PMLSM Drive System Based on Virtual Instrument

A Modular, Open-Source, Slide-Scanning Microscope for Diagnostic Applications in Resource-Constrained Settings.